2023-07-19T20:09:01.000 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-19T20:09:01.001 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344198 --name yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344198/orig.config.yaml 2023-07-19T20:09:01.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:09:01.146 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344198 branch: wip-yuri4-testing-2023-07-06-0738-reef description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} email: null first_in_suite: false job_id: '7344198' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri4-testing-2023-07-06-0738-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 796ba272b844628dfe71207e1e29131fa2eea4cd ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 796ba272b844628dfe71207e1e29131fa2eea4cd kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2023-07-06-0738-reef sha1: 796ba272b844628dfe71207e1e29131fa2eea4cd owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 8052 sha1: 796ba272b844628dfe71207e1e29131fa2eea4cd sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri4-testing-2023-07-06-0738-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_796ba272b844628dfe71207e1e29131fa2eea4cd/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 796ba272b844628dfe71207e1e29131fa2eea4cd syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCVUqcg8yw5J2UoBenTJCQQ47FvEhMnvhSStRB/aEPd+fxaptn4eib9AJCMQBq26bBebsf6AlKS5qmXiSnYYEjR3HXGWi2yJXzKgtdkPRy82EivYsbwuvMQc1ttn6j/lv3acNKVIJdR8whW1It1Zqb8RT4lyT4+uEJevyX+5eRKF4EHEoiUp4/iFBpxkihJburhecm2vu1TUN6GTVvB2zkMYKlhs7NjyrO3sN16/ABAgyThJmZ+UPPHEC0wlmbtU3W77qLwtprfs4pzB1jXXtCn8FGsdh1MX+PeWbNDFzdg+e81k2AmFVkquyBZoZLBJADuCY407lUdsIHpzDDq8pE5i+gzhlnhnEG4HEjuQSFhfd/qvlGqp7V9yFV3OQzpzjIbLgXYuesXMYxEbj3huAGKhBw6QuYVhUUTEP4IzAB0G0nK4upJnpVuFYXQMGAnrM4oghAWxKIkSD4mWVrDmG1btNsZfpTi2ks0nc8DQb8j6iG/JZtIzo4rtGk2JuhmdM= smithi124.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCT6mj6hZGnzyHL+bVojVqFh8FX1/5kXAbqR6LTxTJCOYKqqItHkpD0MV9pVcepNRmTeXE+qaxtMqAUEKvdKEe8GtvhZ/Y9o4/SJYUeRWkxWAe6RTEpM3oM8XBfSyokrB+RzXOorJKKYGE1lLSp13DPXLLhyOsHUBZdebB7Pg3rS2WLI9H1ew2yfZNiTdUIDlgRjtkPU6Ck/yLRr97FXth4OcRE/3f2jiJeo2Q2JKexgAacQimKe/n1iQABVE1gig6bx+Fw9fIQ6TTFhblcWXb34V5sGKfZa+NrMNQS9Bz3qIg1vC3+1HUkiDQP7rIJ53fj2udWIJbChDcMz8QqjaMCpUWHWckKLxeg02NPO+5EZhNptq5zpfabblH4jxucthK9aLlGajjWnX2iPo2apJIPgqMO+L5vkzPb8TnMtUA5r+3blz4ccui1R5KDOzZK1lYMow0USzg0xGIo2W6m149x9bthJbXrohWvDhsBQsVCI856B22nPCJNUIWvOea2PqE= smithi130.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzyDjIR8G1gJoiIDRsjD7QC7isPwPKdjsKmz/s72zVjJmDbPOAqQO/pGlR/rdk1ZohFia8mPqio9tmKuy+l9KvrDxVzSIG8KnmQxYzlEb6iYZ7VPZlVAfGH5Gf92Ygyjv2CiKWMAztSEky04uLMXsTJoLEkTKGMERk5AJn9QMYk/qoENJ/uIjucBEEApGhreXd80HIML4DIt3/JFwJpGdv8tWSun8ZVbIU5zrTQHSBgnfiobBjTvF+gXqKkcDZm4fyfJrhnpKfPG+ppLowCIYdTqU0eAFv4LjHRSz/KBiZj1f9YKKs4jyp43u1mBxWw9mgqeYJ+56GAQIMacVac7zVZJuOScgIARwfSEUnC2+eSf7bExiRItWHFAEVdmj7Yf35+j627YMQjtFjvNeFcQ0JipgBdFkoUxZP7QtfgBiOF+IknpedgCQNRcYXZwC3Iii2KHg7AuTHxKF/vRIi0EE8rNnA5MjdTUNQFMQrzRqqJsSTQOQYFvo9puplYFg7PwE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 79491cb69dd37a1eafb93b3471998174bdfa2fd9 timestamp: 2023-07-19_19:57:09 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-19T20:09:01.147 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_796ba272b844628dfe71207e1e29131fa2eea4cd/qa; will attempt to use it 2023-07-19T20:09:01.148 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_796ba272b844628dfe71207e1e29131fa2eea4cd/qa/tasks 2023-07-19T20:09:01.148 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-19T20:09:01.150 INFO:teuthology.task.internal:Checking packages... 2023-07-19T20:09:01.194 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '796ba272b844628dfe71207e1e29131fa2eea4cd' 2023-07-19T20:09:01.194 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-19T20:09:01.195 INFO:teuthology.packaging:ref: None 2023-07-19T20:09:01.195 INFO:teuthology.packaging:tag: None 2023-07-19T20:09:01.196 INFO:teuthology.packaging:branch: wip-yuri4-testing-2023-07-06-0738-reef 2023-07-19T20:09:01.196 INFO:teuthology.packaging:sha1: 796ba272b844628dfe71207e1e29131fa2eea4cd 2023-07-19T20:09:01.197 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri4-testing-2023-07-06-0738-reef 2023-07-19T20:09:01.547 INFO:teuthology.task.internal:Found packages for ceph version 18.1.2-35.g796ba272 2023-07-19T20:09:01.548 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-19T20:09:01.555 INFO:teuthology.task.internal:no buildpackages task found 2023-07-19T20:09:01.555 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-19T20:09:01.575 INFO:teuthology.task.internal:Saving configuration 2023-07-19T20:09:01.611 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-19T20:09:01.617 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T20:09:01.652 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344198', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 20:03:48.866776', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ+auxjPlBYV9XTlpfa9LpsHplaT1w+q3qzOAkUwGDukPLFG87VYpBoUU326827lsAmbK9r45EbxcU0o7FzoJOg='} 2023-07-19T20:09:01.678 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344198', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 20:03:48.864779', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGlmSkOZhZFxw8QzfLTQMnvkK48df/ZPZZEcDdDPONJHCmhrFqGtvHAFR7SEytGjGLRImhbloL4Q7W2laIydTgk='} 2023-07-19T20:09:01.702 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344198', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 20:03:48.868084', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAyyxwbovzOYSkTti0TSE614BCSDjObqiQcGL+Afs2TadRBQd686RKaeQdnBa8GzVcBSqPof3BtiJVBf2B1rzeA='} 2023-07-19T20:09:01.702 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-19T20:09:01.708 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-07-19T20:09:01.708 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-07-19T20:09:01.709 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['client.0'] 2023-07-19T20:09:01.709 INFO:teuthology.run_tasks:Running task console_log... 2023-07-19T20:09:01.837 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa010109310>, signals=[15]) 2023-07-19T20:09:01.839 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-19T20:09:01.846 INFO:teuthology.task.internal:Opening connections... 2023-07-19T20:09:01.847 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2023-07-19T20:09:01.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:09:01.919 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi124.front.sepia.ceph.com 2023-07-19T20:09:01.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:09:01.987 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2023-07-19T20:09:01.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:09:02.058 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-19T20:09:02.066 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2023-07-19T20:09:02.088 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2023-07-19T20:09:02.089 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-07-19T20:09:02.150 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2023-07-19T20:09:02.150 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8" 2023-07-19T20:09:02.150 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2023-07-19T20:09:02.150 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2023-07-19T20:09:02.150 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8" 2023-07-19T20:09:02.150 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8" 2023-07-19T20:09:02.151 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-19T20:09:02.151 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2023-07-19T20:09:02.151 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-19T20:09:02.151 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2023-07-19T20:09:02.151 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T20:09:02.151 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T20:09:02.151 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-19T20:09:02.152 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-07-19T20:09:02.177 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-07-19T20:09:02.199 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-07-19T20:09:02.200 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-07-19T20:09:02.260 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream" 2023-07-19T20:09:02.261 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8" 2023-07-19T20:09:02.261 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2023-07-19T20:09:02.261 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2023-07-19T20:09:02.261 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8" 2023-07-19T20:09:02.261 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-07-19T20:09:02.261 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-19T20:09:02.262 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-07-19T20:09:02.262 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-19T20:09:02.262 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/" 2023-07-19T20:09:02.262 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T20:09:02.262 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T20:09:02.262 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-19T20:09:02.263 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-07-19T20:09:02.286 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2023-07-19T20:09:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2023-07-19T20:09:02.311 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2023-07-19T20:09:02.371 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2023-07-19T20:09:02.372 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="8" 2023-07-19T20:09:02.372 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2023-07-19T20:09:02.372 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2023-07-19T20:09:02.372 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="8" 2023-07-19T20:09:02.372 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el8" 2023-07-19T20:09:02.372 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-19T20:09:02.373 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2023-07-19T20:09:02.373 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-19T20:09:02.373 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2023-07-19T20:09:02.373 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T20:09:02.373 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T20:09:02.373 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-19T20:09:02.373 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2023-07-19T20:09:02.393 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-19T20:09:02.403 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-19T20:09:02.436 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-19T20:09:02.437 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2023-07-19T20:09:02.441 DEBUG:teuthology.orchestra.run.smithi124:> test '!' -e /home/ubuntu/cephtest 2023-07-19T20:09:02.444 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2023-07-19T20:09:02.468 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-19T20:09:02.474 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-19T20:09:02.474 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2023-07-19T20:09:02.508 DEBUG:teuthology.orchestra.run.smithi124:> test -z $(ls -A /var/lib/ceph) 2023-07-19T20:09:02.510 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2023-07-19T20:09:02.549 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-19T20:09:02.637 INFO:teuthology.run_tasks:Running task kernel... 2023-07-19T20:09:02.654 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-07-19T20:09:02.655 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-07-19T20:09:02.655 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-07-19T20:09:02.656 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-19T20:09:02.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-19T20:09:02.678 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-19T20:09:03.084 DEBUG:teuthology.task.kernel:sha1 for client.0 is a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-19T20:09:03.086 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "a440c79eee0258ae07e4988d8690fe6187b8b7a3"... 2023-07-19T20:09:03.086 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2023-07-19T20:09:03.108 INFO:teuthology.orchestra.run.smithi130.stdout:4.18.0-489.el8.x86_64 2023-07-19T20:09:03.109 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-19T20:09:03.109 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-19T20:09:03.109 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum upgrade -y linux-firmware 2023-07-19T20:09:15.783 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - AppStream 3.0 MB/s | 31 MB 00:10 2023-07-19T20:09:24.399 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - BaseOS 14 MB/s | 41 MB 00:02 2023-07-19T20:09:30.935 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - Extras 35 kB/s | 18 kB 00:00 2023-07-19T20:09:32.660 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - Extras common packages 4.2 kB/s | 6.6 kB 00:01 2023-07-19T20:09:33.186 INFO:teuthology.orchestra.run.smithi130.stdout:Copr repo for python3-asyncssh owned by ceph 9.2 kB/s | 3.5 kB 00:00 2023-07-19T20:10:25.912 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 304 kB/s | 16 MB 00:52 2023-07-19T20:10:29.647 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 423 kB/s | 24 kB 00:00 2023-07-19T20:10:33.068 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-07-19T20:10:33.069 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-07-19T20:10:33.070 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repo Size 2023-07-19T20:10:33.070 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-07-19T20:10:33.070 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2023-07-19T20:10:33.070 INFO:teuthology.orchestra.run.smithi130.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-19T20:10:33.071 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:10:33.071 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-07-19T20:10:33.071 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-07-19T20:10:33.071 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 1 Package 2023-07-19T20:10:33.072 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:10:33.072 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 266 M 2023-07-19T20:10:33.072 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-07-19T20:10:56.146 INFO:teuthology.orchestra.run.smithi130.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 12 MB/s | 266 MB 00:22 2023-07-19T20:10:56.147 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-07-19T20:10:56.147 INFO:teuthology.orchestra.run.smithi130.stdout:Total 12 MB/s | 266 MB 00:23 2023-07-19T20:10:57.720 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-07-19T20:10:57.775 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-07-19T20:10:57.775 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-07-19T20:10:59.449 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-07-19T20:10:59.478 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-07-19T20:11:17.108 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-07-19T20:11:17.455 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-19T20:11:17.702 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-19T20:11:17.944 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-19T20:11:17.945 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-19T20:11:18.625 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-19T20:11:18.625 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:11:18.625 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2023-07-19T20:11:18.625 INFO:teuthology.orchestra.run.smithi130.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-19T20:11:18.625 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:11:18.625 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-07-19T20:11:18.775 INFO:teuthology.task.kernel:Downloading kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on client.0... 2023-07-19T20:11:18.776 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-19T20:11:19.173 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ 2023-07-19T20:11:19.173 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-19T20:11:19.176 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi130.front.sepia.ceph.com to complete... 2023-07-19T20:23:18.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-07-19 20:23:18 URL:https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm [380684764/380684764] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-19T20:23:18.004 INFO:teuthology.orchestra.run.smithi130.stderr:FINISHED --2023-07-19 20:23:18-- 2023-07-19T20:23:18.004 INFO:teuthology.orchestra.run.smithi130.stderr:Total wall clock time: 11m 59s 2023-07-19T20:23:18.005 INFO:teuthology.orchestra.run.smithi130.stderr:Downloaded: 1 files, 363M in 11m 58s (518 KB/s) 2023-07-19T20:23:18.006 INFO:teuthology.task.kernel:Installing kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on client.0... 2023-07-19T20:23:18.006 DEBUG:teuthology.orchestra.run.smithi130:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-19T20:23:19.675 INFO:teuthology.orchestra.run.smithi130.stdout:Verifying... ######################################## 2023-07-19T20:23:19.719 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing... ######################################## 2023-07-19T20:23:19.829 INFO:teuthology.orchestra.run.smithi130.stdout:Updating / installing... 2023-07-19T20:23:57.769 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-6.5.0_rc1_ga440c79eee02-1 ######################################## 2023-07-19T20:24:20.633 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi130.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-19T20:24:20.633 DEBUG:teuthology.orchestra.run.smithi130:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-19T20:24:20.693 INFO:teuthology.orchestra.run.smithi130.stdout:/boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-19T20:24:20.693 INFO:teuthology.orchestra.run.smithi130.stdout:/boot/config-6.5.0-rc1-ga440c79eee02 2023-07-19T20:24:20.693 INFO:teuthology.orchestra.run.smithi130.stdout:/boot/vmlinuz-6.5.0-rc1-ga440c79eee02 2023-07-19T20:24:20.693 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02 2023-07-19T20:24:20.694 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel 2023-07-19T20:24:20.694 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch 2023-07-19T20:24:20.694 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86 2023-07-19T20:24:20.694 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto 2023-07-19T20:24:20.694 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-19T20:24:20.694 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-19T20:24:20.695 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-19T20:24:20.695 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-19T20:24:20.695 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-19T20:24:20.695 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-19T20:24:20.695 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-19T20:24:20.695 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-19T20:24:20.695 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-19T20:24:20.695 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-19T20:24:20.696 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-19T20:24:20.696 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-19T20:24:20.696 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-19T20:24:20.696 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-19T20:24:20.696 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-19T20:24:20.696 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-19T20:24:20.697 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-19T20:24:20.697 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-19T20:24:20.697 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-19T20:24:20.697 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-19T20:24:20.697 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel 2023-07-19T20:24:20.697 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu 2023-07-19T20:24:20.697 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce 2023-07-19T20:24:20.698 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-19T20:24:20.698 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm 2023-07-19T20:24:20.698 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-19T20:24:20.698 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-19T20:24:20.698 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm.ko 2023-07-19T20:24:20.698 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto 2023-07-19T20:24:20.699 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ansi_cprng.ko 2023-07-19T20:24:20.699 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/anubis.ko 2023-07-19T20:24:20.699 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/arc4.ko 2023-07-19T20:24:20.699 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx 2023-07-19T20:24:20.699 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_memcpy.ko 2023-07-19T20:24:20.699 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_pq.ko 2023-07-19T20:24:20.699 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-19T20:24:20.699 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_tx.ko 2023-07-19T20:24:20.700 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_xor.ko 2023-07-19T20:24:20.700 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/raid6test.ko 2023-07-19T20:24:20.700 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authenc.ko 2023-07-19T20:24:20.700 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authencesn.ko 2023-07-19T20:24:20.700 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blake2b_generic.ko 2023-07-19T20:24:20.700 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_common.ko 2023-07-19T20:24:20.700 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_generic.ko 2023-07-19T20:24:20.701 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/camellia_generic.ko 2023-07-19T20:24:20.701 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast5_generic.ko 2023-07-19T20:24:20.701 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast6_generic.ko 2023-07-19T20:24:20.701 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast_common.ko 2023-07-19T20:24:20.701 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ccm.ko 2023-07-19T20:24:20.701 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cmac.ko 2023-07-19T20:24:20.701 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crc32_generic.ko 2023-07-19T20:24:20.701 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_engine.ko 2023-07-19T20:24:20.702 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_user.ko 2023-07-19T20:24:20.702 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cts.ko 2023-07-19T20:24:20.702 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/des_generic.ko 2023-07-19T20:24:20.702 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/dh_generic.ko 2023-07-19T20:24:20.702 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/echainiv.ko 2023-07-19T20:24:20.702 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/essiv.ko 2023-07-19T20:24:20.702 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/fcrypt.ko 2023-07-19T20:24:20.702 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/khazad.ko 2023-07-19T20:24:20.703 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4.ko 2023-07-19T20:24:20.703 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4hc.ko 2023-07-19T20:24:20.703 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/md4.ko 2023-07-19T20:24:20.703 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/michael_mic.ko 2023-07-19T20:24:20.703 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcbc.ko 2023-07-19T20:24:20.703 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcrypt.ko 2023-07-19T20:24:20.703 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/rmd160.ko 2023-07-19T20:24:20.704 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/seed.ko 2023-07-19T20:24:20.704 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/serpent_generic.ko 2023-07-19T20:24:20.704 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tcrypt.ko 2023-07-19T20:24:20.704 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tea.ko 2023-07-19T20:24:20.704 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_common.ko 2023-07-19T20:24:20.704 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_generic.ko 2023-07-19T20:24:20.704 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/vmac.ko 2023-07-19T20:24:20.705 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/wp512.ko 2023-07-19T20:24:20.705 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xcbc.ko 2023-07-19T20:24:20.705 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xor.ko 2023-07-19T20:24:20.705 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xxhash_generic.ko 2023-07-19T20:24:20.705 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers 2023-07-19T20:24:20.705 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi 2023-07-19T20:24:20.705 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-19T20:24:20.705 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_pad.ko 2023-07-19T20:24:20.706 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/custom_method.ko 2023-07-19T20:24:20.706 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/ec_sys.ko 2023-07-19T20:24:20.706 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/platform_profile.ko 2023-07-19T20:24:20.706 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbs.ko 2023-07-19T20:24:20.706 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbshc.ko 2023-07-19T20:24:20.706 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/video.ko 2023-07-19T20:24:20.706 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata 2023-07-19T20:24:20.707 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/acard-ahci.ko 2023-07-19T20:24:20.707 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ahci_platform.ko 2023-07-19T20:24:20.707 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ata_generic.ko 2023-07-19T20:24:20.707 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/libahci_platform.ko 2023-07-19T20:24:20.707 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_acpi.ko 2023-07-19T20:24:20.707 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ali.ko 2023-07-19T20:24:20.707 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_amd.ko 2023-07-19T20:24:20.707 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_artop.ko 2023-07-19T20:24:20.708 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atiixp.ko 2023-07-19T20:24:20.708 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atp867x.ko 2023-07-19T20:24:20.708 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd640.ko 2023-07-19T20:24:20.708 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd64x.ko 2023-07-19T20:24:20.708 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cypress.ko 2023-07-19T20:24:20.708 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_efar.ko 2023-07-19T20:24:20.708 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt366.ko 2023-07-19T20:24:20.709 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt37x.ko 2023-07-19T20:24:20.709 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-19T20:24:20.709 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-19T20:24:20.709 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it8213.ko 2023-07-19T20:24:20.709 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it821x.ko 2023-07-19T20:24:20.709 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_jmicron.ko 2023-07-19T20:24:20.709 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_marvell.ko 2023-07-19T20:24:20.709 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_mpiix.ko 2023-07-19T20:24:20.710 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_netcell.ko 2023-07-19T20:24:20.710 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ninja32.ko 2023-07-19T20:24:20.710 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87410.ko 2023-07-19T20:24:20.710 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87415.ko 2023-07-19T20:24:20.710 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_oldpiix.ko 2023-07-19T20:24:20.710 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_opti.ko 2023-07-19T20:24:20.710 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_optidma.ko 2023-07-19T20:24:20.711 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pcmcia.ko 2023-07-19T20:24:20.711 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-19T20:24:20.711 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-19T20:24:20.711 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_piccolo.ko 2023-07-19T20:24:20.711 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_rdc.ko 2023-07-19T20:24:20.711 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sch.ko 2023-07-19T20:24:20.711 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_serverworks.ko 2023-07-19T20:24:20.711 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sil680.ko 2023-07-19T20:24:20.712 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sis.ko 2023-07-19T20:24:20.712 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sl82c105.ko 2023-07-19T20:24:20.712 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_triflex.ko 2023-07-19T20:24:20.712 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_via.ko 2023-07-19T20:24:20.712 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pdc_adma.ko 2023-07-19T20:24:20.712 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_inic162x.ko 2023-07-19T20:24:20.712 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_mv.ko 2023-07-19T20:24:20.713 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_nv.ko 2023-07-19T20:24:20.713 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_promise.ko 2023-07-19T20:24:20.713 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_qstor.ko 2023-07-19T20:24:20.713 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil.ko 2023-07-19T20:24:20.713 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil24.ko 2023-07-19T20:24:20.713 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sis.ko 2023-07-19T20:24:20.713 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_svw.ko 2023-07-19T20:24:20.713 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sx4.ko 2023-07-19T20:24:20.714 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_uli.ko 2023-07-19T20:24:20.714 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_via.ko 2023-07-19T20:24:20.714 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_vsc.ko 2023-07-19T20:24:20.714 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay 2023-07-19T20:24:20.714 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay/ks0108.ko 2023-07-19T20:24:20.714 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base 2023-07-19T20:24:20.714 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap 2023-07-19T20:24:20.715 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-19T20:24:20.715 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-19T20:24:20.715 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma 2023-07-19T20:24:20.715 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma/bcma.ko 2023-07-19T20:24:20.715 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block 2023-07-19T20:24:20.715 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe 2023-07-19T20:24:20.715 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe/aoe.ko 2023-07-19T20:24:20.715 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/brd.ko 2023-07-19T20:24:20.716 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd 2023-07-19T20:24:20.716 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd/drbd.ko 2023-07-19T20:24:20.716 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/floppy.ko 2023-07-19T20:24:20.716 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/loop.ko 2023-07-19T20:24:20.716 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx 2023-07-19T20:24:20.716 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-19T20:24:20.716 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/nbd.ko 2023-07-19T20:24:20.717 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk 2023-07-19T20:24:20.717 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk/null_blk.ko 2023-07-19T20:24:20.717 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/pktcdvd.ko 2023-07-19T20:24:20.717 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/rbd.ko 2023-07-19T20:24:20.717 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/virtio_blk.ko 2023-07-19T20:24:20.717 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback 2023-07-19T20:24:20.717 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-19T20:24:20.717 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkfront.ko 2023-07-19T20:24:20.718 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram 2023-07-19T20:24:20.718 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram/zram.ko 2023-07-19T20:24:20.718 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char 2023-07-19T20:24:20.718 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hangcheck-timer.ko 2023-07-19T20:24:20.718 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random 2023-07-19T20:24:20.718 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-19T20:24:20.719 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-19T20:24:20.719 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-19T20:24:20.719 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/via-rng.ko 2023-07-19T20:24:20.719 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-19T20:24:20.719 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi 2023-07-19T20:24:20.719 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-19T20:24:20.719 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-19T20:24:20.720 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-19T20:24:20.720 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-19T20:24:20.720 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-19T20:24:20.720 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-19T20:24:20.720 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/lp.ko 2023-07-19T20:24:20.720 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave 2023-07-19T20:24:20.720 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave/mwave.ko 2023-07-19T20:24:20.720 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ppdev.ko 2023-07-19T20:24:20.721 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tlclk.ko 2023-07-19T20:24:20.721 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm 2023-07-19T20:24:20.721 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm.ko 2023-07-19T20:24:20.721 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-19T20:24:20.721 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-19T20:24:20.721 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-19T20:24:20.721 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-19T20:24:20.721 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-19T20:24:20.722 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/uv_mmtimer.ko 2023-07-19T20:24:20.722 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/virtio_console.ko 2023-07-19T20:24:20.722 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq 2023-07-19T20:24:20.722 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-19T20:24:20.722 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-19T20:24:20.722 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-19T20:24:20.722 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-19T20:24:20.723 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-19T20:24:20.723 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-19T20:24:20.723 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto 2023-07-19T20:24:20.723 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp 2023-07-19T20:24:20.723 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-19T20:24:20.723 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp.ko 2023-07-19T20:24:20.723 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel 2023-07-19T20:24:20.723 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat 2023-07-19T20:24:20.724 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common 2023-07-19T20:24:20.724 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-19T20:24:20.724 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-19T20:24:20.724 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-19T20:24:20.724 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-aes.ko 2023-07-19T20:24:20.724 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-sha.ko 2023-07-19T20:24:20.724 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio 2023-07-19T20:24:20.725 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-19T20:24:20.725 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca 2023-07-19T20:24:20.725 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca/dca.ko 2023-07-19T20:24:20.725 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq 2023-07-19T20:24:20.725 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-19T20:24:20.725 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma 2023-07-19T20:24:20.725 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw 2023-07-19T20:24:20.725 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-19T20:24:20.726 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat 2023-07-19T20:24:20.726 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-19T20:24:20.726 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac 2023-07-19T20:24:20.726 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/amd64_edac.ko 2023-07-19T20:24:20.726 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/e752x_edac.ko 2023-07-19T20:24:20.726 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/edac_mce_amd.ko 2023-07-19T20:24:20.726 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3000_edac.ko 2023-07-19T20:24:20.727 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3200_edac.ko 2023-07-19T20:24:20.727 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5100_edac.ko 2023-07-19T20:24:20.727 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5400_edac.ko 2023-07-19T20:24:20.727 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7300_edac.ko 2023-07-19T20:24:20.727 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7core_edac.ko 2023-07-19T20:24:20.727 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i82975x_edac.ko 2023-07-19T20:24:20.727 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/ie31200_edac.ko 2023-07-19T20:24:20.727 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/sb_edac.ko 2023-07-19T20:24:20.728 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/x38_edac.ko 2023-07-19T20:24:20.728 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware 2023-07-19T20:24:20.728 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/edd.ko 2023-07-19T20:24:20.728 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-19T20:24:20.728 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio 2023-07-19T20:24:20.728 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-ich.ko 2023-07-19T20:24:20.728 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-19T20:24:20.728 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid 2023-07-19T20:24:20.729 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-appleir.ko 2023-07-19T20:24:20.729 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-aureal.ko 2023-07-19T20:24:20.729 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-axff.ko 2023-07-19T20:24:20.729 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-dr.ko 2023-07-19T20:24:20.729 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elecom.ko 2023-07-19T20:24:20.729 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elo.ko 2023-07-19T20:24:20.729 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-emsff.ko 2023-07-19T20:24:20.729 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gaff.ko 2023-07-19T20:24:20.730 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gt683r.ko 2023-07-19T20:24:20.730 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gyration.ko 2023-07-19T20:24:20.730 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-19T20:24:20.730 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-19T20:24:20.730 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtekff.ko 2023-07-19T20:24:20.730 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-hyperv.ko 2023-07-19T20:24:20.730 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-icade.ko 2023-07-19T20:24:20.730 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-keytouch.ko 2023-07-19T20:24:20.731 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-kye.ko 2023-07-19T20:24:20.731 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lcpower.ko 2023-07-19T20:24:20.731 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-led.ko 2023-07-19T20:24:20.731 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lenovo.ko 2023-07-19T20:24:20.731 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-19T20:24:20.731 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-19T20:24:20.731 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-multitouch.ko 2023-07-19T20:24:20.731 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-ortek.ko 2023-07-19T20:24:20.732 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-penmount.ko 2023-07-19T20:24:20.732 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-petalynx.ko 2023-07-19T20:24:20.732 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-picolcd.ko 2023-07-19T20:24:20.732 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-pl.ko 2023-07-19T20:24:20.732 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-plantronics.ko 2023-07-19T20:24:20.732 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-primax.ko 2023-07-19T20:24:20.732 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-rmi.ko 2023-07-19T20:24:20.733 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-19T20:24:20.733 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-common.ko 2023-07-19T20:24:20.733 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-19T20:24:20.733 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-19T20:24:20.733 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-19T20:24:20.733 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-19T20:24:20.733 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-19T20:24:20.733 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-19T20:24:20.734 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-19T20:24:20.734 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-19T20:24:20.734 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-19T20:24:20.734 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat.ko 2023-07-19T20:24:20.734 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-saitek.ko 2023-07-19T20:24:20.734 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-samsung.ko 2023-07-19T20:24:20.734 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-19T20:24:20.734 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sjoy.ko 2023-07-19T20:24:20.735 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sony.ko 2023-07-19T20:24:20.735 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-speedlink.ko 2023-07-19T20:24:20.735 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-steelseries.ko 2023-07-19T20:24:20.735 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sunplus.ko 2023-07-19T20:24:20.735 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-19T20:24:20.735 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tivo.ko 2023-07-19T20:24:20.735 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tmff.ko 2023-07-19T20:24:20.735 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-topseed.ko 2023-07-19T20:24:20.736 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-twinhan.ko 2023-07-19T20:24:20.736 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-uclogic.ko 2023-07-19T20:24:20.736 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-waltop.ko 2023-07-19T20:24:20.736 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-wiimote.ko 2023-07-19T20:24:20.736 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-xinmo.ko 2023-07-19T20:24:20.736 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zpff.ko 2023-07-19T20:24:20.736 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zydacron.ko 2023-07-19T20:24:20.737 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/uhid.ko 2023-07-19T20:24:20.737 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/wacom.ko 2023-07-19T20:24:20.737 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv 2023-07-19T20:24:20.737 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_balloon.ko 2023-07-19T20:24:20.737 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_utils.ko 2023-07-19T20:24:20.737 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_vmbus.ko 2023-07-19T20:24:20.737 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon 2023-07-19T20:24:20.737 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru.ko 2023-07-19T20:24:20.738 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru3.ko 2023-07-19T20:24:20.738 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-19T20:24:20.738 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7414.ko 2023-07-19T20:24:20.738 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7418.ko 2023-07-19T20:24:20.738 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adc128d818.ko 2023-07-19T20:24:20.738 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1025.ko 2023-07-19T20:24:20.738 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1026.ko 2023-07-19T20:24:20.738 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1029.ko 2023-07-19T20:24:20.739 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1031.ko 2023-07-19T20:24:20.739 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm9240.ko 2023-07-19T20:24:20.739 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ads7828.ko 2023-07-19T20:24:20.739 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7410.ko 2023-07-19T20:24:20.739 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7411.ko 2023-07-19T20:24:20.739 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7462.ko 2023-07-19T20:24:20.739 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7470.ko 2023-07-19T20:24:20.740 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7475.ko 2023-07-19T20:24:20.740 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7x10.ko 2023-07-19T20:24:20.740 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/amc6821.ko 2023-07-19T20:24:20.740 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/applesmc.ko 2023-07-19T20:24:20.740 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asb100.ko 2023-07-19T20:24:20.740 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asc7621.ko 2023-07-19T20:24:20.740 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-19T20:24:20.740 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/atxp1.ko 2023-07-19T20:24:20.741 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/coretemp.ko 2023-07-19T20:24:20.741 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-19T20:24:20.741 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dme1737.ko 2023-07-19T20:24:20.741 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds1621.ko 2023-07-19T20:24:20.741 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds620.ko 2023-07-19T20:24:20.741 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc1403.ko 2023-07-19T20:24:20.742 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc6w201.ko 2023-07-19T20:24:20.742 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71805f.ko 2023-07-19T20:24:20.742 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71882fg.ko 2023-07-19T20:24:20.742 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f75375s.ko 2023-07-19T20:24:20.742 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fam15h_power.ko 2023-07-19T20:24:20.742 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fschmd.ko 2023-07-19T20:24:20.742 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g760a.ko 2023-07-19T20:24:20.743 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g762.ko 2023-07-19T20:24:20.743 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl518sm.ko 2023-07-19T20:24:20.743 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl520sm.ko 2023-07-19T20:24:20.743 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-19T20:24:20.743 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5500_temp.ko 2023-07-19T20:24:20.743 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5k_amb.ko 2023-07-19T20:24:20.743 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmaem.ko 2023-07-19T20:24:20.744 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmpex.ko 2023-07-19T20:24:20.744 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina209.ko 2023-07-19T20:24:20.744 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina2xx.ko 2023-07-19T20:24:20.744 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/it87.ko 2023-07-19T20:24:20.744 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k10temp.ko 2023-07-19T20:24:20.744 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k8temp.ko 2023-07-19T20:24:20.744 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lineage-pem.ko 2023-07-19T20:24:20.744 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm63.ko 2023-07-19T20:24:20.745 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm73.ko 2023-07-19T20:24:20.745 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm75.ko 2023-07-19T20:24:20.745 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm77.ko 2023-07-19T20:24:20.745 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm78.ko 2023-07-19T20:24:20.745 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm80.ko 2023-07-19T20:24:20.745 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm83.ko 2023-07-19T20:24:20.745 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm85.ko 2023-07-19T20:24:20.745 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm87.ko 2023-07-19T20:24:20.746 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm90.ko 2023-07-19T20:24:20.746 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm92.ko 2023-07-19T20:24:20.746 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm93.ko 2023-07-19T20:24:20.746 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95234.ko 2023-07-19T20:24:20.746 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95241.ko 2023-07-19T20:24:20.746 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95245.ko 2023-07-19T20:24:20.746 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc2945.ko 2023-07-19T20:24:20.747 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4151.ko 2023-07-19T20:24:20.747 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4215.ko 2023-07-19T20:24:20.747 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4222.ko 2023-07-19T20:24:20.747 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4245.ko 2023-07-19T20:24:20.747 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4260.ko 2023-07-19T20:24:20.747 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4261.ko 2023-07-19T20:24:20.747 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max16065.ko 2023-07-19T20:24:20.747 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1619.ko 2023-07-19T20:24:20.748 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1668.ko 2023-07-19T20:24:20.748 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max197.ko 2023-07-19T20:24:20.748 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6639.ko 2023-07-19T20:24:20.748 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6650.ko 2023-07-19T20:24:20.748 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6697.ko 2023-07-19T20:24:20.748 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/mcp3021.ko 2023-07-19T20:24:20.748 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6683.ko 2023-07-19T20:24:20.748 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775-core.ko 2023-07-19T20:24:20.749 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775.ko 2023-07-19T20:24:20.749 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct7802.ko 2023-07-19T20:24:20.749 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87360.ko 2023-07-19T20:24:20.749 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87427.ko 2023-07-19T20:24:20.749 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pcf8591.ko 2023-07-19T20:24:20.749 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus 2023-07-19T20:24:20.750 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-19T20:24:20.750 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-19T20:24:20.750 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-19T20:24:20.750 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-19T20:24:20.750 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-19T20:24:20.750 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-19T20:24:20.750 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-19T20:24:20.750 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-19T20:24:20.751 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-19T20:24:20.751 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-19T20:24:20.751 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-19T20:24:20.751 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-19T20:24:20.751 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/powr1220.ko 2023-07-19T20:24:20.751 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5627.ko 2023-07-19T20:24:20.751 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5636.ko 2023-07-19T20:24:20.752 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-19T20:24:20.752 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht15.ko 2023-07-19T20:24:20.752 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht21.ko 2023-07-19T20:24:20.752 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/shtc1.ko 2023-07-19T20:24:20.752 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sis5595.ko 2023-07-19T20:24:20.752 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47b397.ko 2023-07-19T20:24:20.752 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m1.ko 2023-07-19T20:24:20.752 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m192.ko 2023-07-19T20:24:20.753 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/thmc50.ko 2023-07-19T20:24:20.753 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp102.ko 2023-07-19T20:24:20.753 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp103.ko 2023-07-19T20:24:20.753 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp401.ko 2023-07-19T20:24:20.753 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp421.ko 2023-07-19T20:24:20.753 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via-cputemp.ko 2023-07-19T20:24:20.753 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via686a.ko 2023-07-19T20:24:20.753 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt1211.ko 2023-07-19T20:24:20.754 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt8231.ko 2023-07-19T20:24:20.754 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627ehf.ko 2023-07-19T20:24:20.754 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627hf.ko 2023-07-19T20:24:20.754 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83781d.ko 2023-07-19T20:24:20.754 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83791d.ko 2023-07-19T20:24:20.754 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83792d.ko 2023-07-19T20:24:20.754 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83793.ko 2023-07-19T20:24:20.754 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83795.ko 2023-07-19T20:24:20.755 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l785ts.ko 2023-07-19T20:24:20.755 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l786ng.ko 2023-07-19T20:24:20.755 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c 2023-07-19T20:24:20.755 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos 2023-07-19T20:24:20.755 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-19T20:24:20.755 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-19T20:24:20.755 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses 2023-07-19T20:24:20.755 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-19T20:24:20.756 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-19T20:24:20.756 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-19T20:24:20.756 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-19T20:24:20.756 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-19T20:24:20.756 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-19T20:24:20.756 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-19T20:24:20.756 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-19T20:24:20.757 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-19T20:24:20.757 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-19T20:24:20.757 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-19T20:24:20.757 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-19T20:24:20.757 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-19T20:24:20.757 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-19T20:24:20.757 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-19T20:24:20.758 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-19T20:24:20.758 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-19T20:24:20.758 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-19T20:24:20.758 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-19T20:24:20.758 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-19T20:24:20.758 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-19T20:24:20.758 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-19T20:24:20.758 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-19T20:24:20.759 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-dev.ko 2023-07-19T20:24:20.759 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-mux.ko 2023-07-19T20:24:20.759 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-19T20:24:20.759 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-smbus.ko 2023-07-19T20:24:20.759 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-stub.ko 2023-07-19T20:24:20.759 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband 2023-07-19T20:24:20.759 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core 2023-07-19T20:24:20.759 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-19T20:24:20.760 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_core.ko 2023-07-19T20:24:20.760 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-19T20:24:20.760 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-19T20:24:20.760 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-19T20:24:20.760 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-19T20:24:20.760 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-19T20:24:20.760 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw 2023-07-19T20:24:20.761 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4 2023-07-19T20:24:20.761 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-19T20:24:20.761 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4 2023-07-19T20:24:20.761 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-19T20:24:20.761 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5 2023-07-19T20:24:20.761 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-19T20:24:20.761 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca 2023-07-19T20:24:20.761 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-19T20:24:20.762 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp 2023-07-19T20:24:20.762 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib 2023-07-19T20:24:20.762 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-19T20:24:20.762 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser 2023-07-19T20:24:20.762 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-19T20:24:20.762 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert 2023-07-19T20:24:20.762 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-19T20:24:20.762 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp 2023-07-19T20:24:20.763 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-19T20:24:20.763 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt 2023-07-19T20:24:20.763 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-19T20:24:20.763 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input 2023-07-19T20:24:20.763 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport 2023-07-19T20:24:20.763 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-19T20:24:20.763 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-19T20:24:20.763 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/gameport.ko 2023-07-19T20:24:20.764 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/lightning.ko 2023-07-19T20:24:20.764 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/ns558.ko 2023-07-19T20:24:20.764 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/joydev.ko 2023-07-19T20:24:20.764 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard 2023-07-19T20:24:20.764 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-19T20:24:20.764 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse 2023-07-19T20:24:20.764 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/appletouch.ko 2023-07-19T20:24:20.765 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/bcm5974.ko 2023-07-19T20:24:20.765 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/cyapatp.ko 2023-07-19T20:24:20.765 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-19T20:24:20.765 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/sermouse.ko 2023-07-19T20:24:20.765 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-19T20:24:20.765 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-19T20:24:20.765 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-19T20:24:20.765 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4 2023-07-19T20:24:20.766 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-19T20:24:20.766 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio 2023-07-19T20:24:20.766 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/altera_ps2.ko 2023-07-19T20:24:20.766 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/arc_ps2.ko 2023-07-19T20:24:20.766 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-19T20:24:20.766 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/serio_raw.ko 2023-07-19T20:24:20.766 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/sparse-keymap.ko 2023-07-19T20:24:20.766 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu 2023-07-19T20:24:20.767 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd 2023-07-19T20:24:20.767 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-19T20:24:20.767 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds 2023-07-19T20:24:20.767 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-blinkm.ko 2023-07-19T20:24:20.767 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm3530.ko 2023-07-19T20:24:20.767 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lp3944.ko 2023-07-19T20:24:20.767 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-ss4200.ko 2023-07-19T20:24:20.767 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger 2023-07-19T20:24:20.768 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-19T20:24:20.768 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-19T20:24:20.768 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-19T20:24:20.768 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-19T20:24:20.768 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-19T20:24:20.768 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-19T20:24:20.768 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-19T20:24:20.769 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-19T20:24:20.769 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md 2023-07-19T20:24:20.769 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache 2023-07-19T20:24:20.769 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache/bcache.ko 2023-07-19T20:24:20.769 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-bio-prison.ko 2023-07-19T20:24:20.769 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache-smq.ko 2023-07-19T20:24:20.769 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache.ko 2023-07-19T20:24:20.769 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-crypt.ko 2023-07-19T20:24:20.770 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-delay.ko 2023-07-19T20:24:20.770 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-flakey.ko 2023-07-19T20:24:20.770 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-log-userspace.ko 2023-07-19T20:24:20.770 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-multipath.ko 2023-07-19T20:24:20.770 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-queue-length.ko 2023-07-19T20:24:20.770 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-raid.ko 2023-07-19T20:24:20.770 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-round-robin.ko 2023-07-19T20:24:20.770 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-service-time.ko 2023-07-19T20:24:20.771 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-switch.ko 2023-07-19T20:24:20.771 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-thin-pool.ko 2023-07-19T20:24:20.771 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-verity.ko 2023-07-19T20:24:20.771 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/faulty.ko 2023-07-19T20:24:20.771 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/linear.ko 2023-07-19T20:24:20.771 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/multipath.ko 2023-07-19T20:24:20.771 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data 2023-07-19T20:24:20.771 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-19T20:24:20.772 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid0.ko 2023-07-19T20:24:20.772 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid1.ko 2023-07-19T20:24:20.772 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid10.ko 2023-07-19T20:24:20.772 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid456.ko 2023-07-19T20:24:20.772 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message 2023-07-19T20:24:20.772 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion 2023-07-19T20:24:20.772 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptbase.ko 2023-07-19T20:24:20.773 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptctl.ko 2023-07-19T20:24:20.773 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptfc.ko 2023-07-19T20:24:20.773 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptlan.ko 2023-07-19T20:24:20.773 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptsas.ko 2023-07-19T20:24:20.773 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptscsih.ko 2023-07-19T20:24:20.773 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptspi.ko 2023-07-19T20:24:20.773 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd 2023-07-19T20:24:20.773 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_ich.ko 2023-07-19T20:24:20.774 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_sch.ko 2023-07-19T20:24:20.774 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/mfd-core.ko 2023-07-19T20:24:20.774 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/sm501.ko 2023-07-19T20:24:20.774 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/viperboard.ko 2023-07-19T20:24:20.774 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/vx855.ko 2023-07-19T20:24:20.774 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/wl1273-core.ko 2023-07-19T20:24:20.774 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc 2023-07-19T20:24:20.774 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl 2023-07-19T20:24:20.775 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-19T20:24:20.775 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds9802als.ko 2023-07-19T20:24:20.775 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds990x.ko 2023-07-19T20:24:20.775 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/bh1770glc.ko 2023-07-19T20:24:20.775 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710 2023-07-19T20:24:20.775 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710/cb710.ko 2023-07-19T20:24:20.775 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom 2023-07-19T20:24:20.775 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/at24.ko 2023-07-19T20:24:20.776 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-19T20:24:20.776 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-19T20:24:20.776 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/max6875.ko 2023-07-19T20:24:20.776 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/enclosure.ko 2023-07-19T20:24:20.776 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/hpilo.ko 2023-07-19T20:24:20.776 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29003.ko 2023-07-19T20:24:20.776 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29020.ko 2023-07-19T20:24:20.776 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d 2023-07-19T20:24:20.777 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-19T20:24:20.777 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-19T20:24:20.777 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei 2023-07-19T20:24:20.777 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-me.ko 2023-07-19T20:24:20.777 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-txe.ko 2023-07-19T20:24:20.777 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei.ko 2023-07-19T20:24:20.777 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru 2023-07-19T20:24:20.778 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-19T20:24:20.778 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp 2023-07-19T20:24:20.778 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-19T20:24:20.778 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-19T20:24:20.778 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-19T20:24:20.778 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_7xx1.ko 2023-07-19T20:24:20.778 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_core.ko 2023-07-19T20:24:20.778 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tsl2550.ko 2023-07-19T20:24:20.779 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_balloon.ko 2023-07-19T20:24:20.779 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci 2023-07-19T20:24:20.779 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-19T20:24:20.779 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net 2023-07-19T20:24:20.779 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding 2023-07-19T20:24:20.779 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding/bonding.ko 2023-07-19T20:24:20.779 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa 2023-07-19T20:24:20.779 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53 2023-07-19T20:24:20.780 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-19T20:24:20.780 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-19T20:24:20.780 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-19T20:24:20.780 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx 2023-07-19T20:24:20.780 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-19T20:24:20.780 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dummy.ko 2023-07-19T20:24:20.780 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/eql.ko 2023-07-19T20:24:20.780 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet 2023-07-19T20:24:20.781 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com 2023-07-19T20:24:20.781 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-19T20:24:20.781 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-19T20:24:20.781 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-19T20:24:20.781 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-19T20:24:20.781 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390 2023-07-19T20:24:20.781 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-19T20:24:20.782 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-19T20:24:20.782 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-19T20:24:20.782 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-19T20:24:20.782 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec 2023-07-19T20:24:20.782 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-19T20:24:20.782 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere 2023-07-19T20:24:20.782 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-19T20:24:20.782 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon 2023-07-19T20:24:20.783 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-19T20:24:20.783 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera 2023-07-19T20:24:20.783 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-19T20:24:20.783 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd 2023-07-19T20:24:20.783 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-19T20:24:20.783 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-19T20:24:20.783 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-19T20:24:20.783 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros 2023-07-19T20:24:20.784 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx 2023-07-19T20:24:20.784 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-19T20:24:20.784 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-19T20:24:20.784 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-19T20:24:20.784 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-19T20:24:20.784 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-19T20:24:20.784 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx 2023-07-19T20:24:20.784 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-19T20:24:20.785 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-19T20:24:20.785 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom 2023-07-19T20:24:20.785 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-19T20:24:20.785 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-19T20:24:20.785 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-19T20:24:20.785 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-19T20:24:20.785 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-19T20:24:20.786 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet 2023-07-19T20:24:20.786 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-19T20:24:20.786 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-19T20:24:20.786 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade 2023-07-19T20:24:20.786 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna 2023-07-19T20:24:20.786 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-19T20:24:20.786 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio 2023-07-19T20:24:20.786 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-19T20:24:20.787 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-19T20:24:20.787 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-19T20:24:20.787 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-19T20:24:20.787 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-19T20:24:20.787 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-19T20:24:20.787 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-19T20:24:20.787 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-19T20:24:20.787 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-19T20:24:20.788 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-19T20:24:20.788 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco 2023-07-19T20:24:20.788 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic 2023-07-19T20:24:20.788 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-19T20:24:20.788 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec 2023-07-19T20:24:20.788 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip 2023-07-19T20:24:20.788 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-19T20:24:20.789 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-19T20:24:20.789 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-19T20:24:20.789 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-19T20:24:20.789 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-19T20:24:20.789 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-19T20:24:20.789 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink 2023-07-19T20:24:20.789 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-19T20:24:20.789 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-19T20:24:20.790 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dnet.ko 2023-07-19T20:24:20.790 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex 2023-07-19T20:24:20.790 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet 2023-07-19T20:24:20.790 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-19T20:24:20.790 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ethoc.ko 2023-07-19T20:24:20.790 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/fealnx.ko 2023-07-19T20:24:20.790 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel 2023-07-19T20:24:20.790 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-19T20:24:20.791 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000 2023-07-19T20:24:20.791 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-19T20:24:20.791 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e 2023-07-19T20:24:20.791 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-19T20:24:20.791 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k 2023-07-19T20:24:20.791 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-19T20:24:20.791 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e 2023-07-19T20:24:20.791 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-19T20:24:20.792 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf 2023-07-19T20:24:20.792 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-19T20:24:20.792 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb 2023-07-19T20:24:20.792 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-19T20:24:20.792 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf 2023-07-19T20:24:20.792 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-19T20:24:20.792 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-19T20:24:20.792 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-19T20:24:20.793 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-19T20:24:20.793 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-19T20:24:20.793 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/jme.ko 2023-07-19T20:24:20.793 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell 2023-07-19T20:24:20.793 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-19T20:24:20.793 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-19T20:24:20.793 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-19T20:24:20.793 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox 2023-07-19T20:24:20.794 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-19T20:24:20.794 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-19T20:24:20.794 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-19T20:24:20.794 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-19T20:24:20.794 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-19T20:24:20.794 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-19T20:24:20.794 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel 2023-07-19T20:24:20.795 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-19T20:24:20.795 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom 2023-07-19T20:24:20.795 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-19T20:24:20.795 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-19T20:24:20.795 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi 2023-07-19T20:24:20.795 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-19T20:24:20.795 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-19T20:24:20.795 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion 2023-07-19T20:24:20.796 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-19T20:24:20.796 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia 2023-07-19T20:24:20.796 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-19T20:24:20.796 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines 2023-07-19T20:24:20.796 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-19T20:24:20.796 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-19T20:24:20.796 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic 2023-07-19T20:24:20.796 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-19T20:24:20.797 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-19T20:24:20.797 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-19T20:24:20.797 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-19T20:24:20.797 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-19T20:24:20.797 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc 2023-07-19T20:24:20.797 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-19T20:24:20.797 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek 2023-07-19T20:24:20.797 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-19T20:24:20.798 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-19T20:24:20.798 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-19T20:24:20.798 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-19T20:24:20.798 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker 2023-07-19T20:24:20.798 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-19T20:24:20.798 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc 2023-07-19T20:24:20.798 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-19T20:24:20.799 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan 2023-07-19T20:24:20.799 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-19T20:24:20.799 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis 2023-07-19T20:24:20.799 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-19T20:24:20.799 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-19T20:24:20.799 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc 2023-07-19T20:24:20.799 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-19T20:24:20.799 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-19T20:24:20.800 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-19T20:24:20.800 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-19T20:24:20.800 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro 2023-07-19T20:24:20.800 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-19T20:24:20.800 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-19T20:24:20.800 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-19T20:24:20.800 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun 2023-07-19T20:24:20.801 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-19T20:24:20.801 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-19T20:24:20.801 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-19T20:24:20.801 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-19T20:24:20.801 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti 2023-07-19T20:24:20.801 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-19T20:24:20.801 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti 2023-07-19T20:24:20.801 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-19T20:24:20.802 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via 2023-07-19T20:24:20.802 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-19T20:24:20.802 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-19T20:24:20.802 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet 2023-07-19T20:24:20.802 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-19T20:24:20.802 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-19T20:24:20.802 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom 2023-07-19T20:24:20.802 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-19T20:24:20.803 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/geneve.ko 2023-07-19T20:24:20.803 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv 2023-07-19T20:24:20.803 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-19T20:24:20.803 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154 2023-07-19T20:24:20.803 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-19T20:24:20.803 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ifb.ko 2023-07-19T20:24:20.803 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan 2023-07-19T20:24:20.803 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-19T20:24:20.804 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvlan.ko 2023-07-19T20:24:20.804 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvtap.ko 2023-07-19T20:24:20.804 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio 2023-07-19T20:24:20.804 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio.ko 2023-07-19T20:24:20.804 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-19T20:24:20.804 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-19T20:24:20.804 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-19T20:24:20.805 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mii.ko 2023-07-19T20:24:20.805 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/net_failover.ko 2023-07-19T20:24:20.805 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/netconsole.ko 2023-07-19T20:24:20.805 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/nlmon.ko 2023-07-19T20:24:20.805 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs 2023-07-19T20:24:20.805 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-19T20:24:20.805 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-19T20:24:20.805 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy 2023-07-19T20:24:20.806 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/amd.ko 2023-07-19T20:24:20.806 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-19T20:24:20.806 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-19T20:24:20.806 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-19T20:24:20.806 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm87xx.ko 2023-07-19T20:24:20.806 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/broadcom.ko 2023-07-19T20:24:20.806 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/cicada.ko 2023-07-19T20:24:20.807 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/davicom.ko 2023-07-19T20:24:20.807 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/dp83640.ko 2023-07-19T20:24:20.807 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/et1011c.ko 2023-07-19T20:24:20.807 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/icplus.ko 2023-07-19T20:24:20.807 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/lxt.ko 2023-07-19T20:24:20.807 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/marvell.ko 2023-07-19T20:24:20.807 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/micrel.ko 2023-07-19T20:24:20.807 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/national.ko 2023-07-19T20:24:20.808 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/phylink.ko 2023-07-19T20:24:20.808 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/qsemi.ko 2023-07-19T20:24:20.808 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/realtek.ko 2023-07-19T20:24:20.808 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/smsc.ko 2023-07-19T20:24:20.808 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/ste10Xp.ko 2023-07-19T20:24:20.808 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/vitesse.ko 2023-07-19T20:24:20.808 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp 2023-07-19T20:24:20.809 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-19T20:24:20.809 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_async.ko 2023-07-19T20:24:20.809 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-19T20:24:20.809 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-19T20:24:20.809 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-19T20:24:20.809 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-19T20:24:20.809 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppoe.ko 2023-07-19T20:24:20.809 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppox.ko 2023-07-19T20:24:20.810 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pptp.ko 2023-07-19T20:24:20.810 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip 2023-07-19T20:24:20.810 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slhc.ko 2023-07-19T20:24:20.810 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slip.ko 2023-07-19T20:24:20.810 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/sungem_phy.ko 2023-07-19T20:24:20.810 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tap.ko 2023-07-19T20:24:20.810 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team 2023-07-19T20:24:20.810 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team.ko 2023-07-19T20:24:20.811 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-19T20:24:20.811 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-19T20:24:20.811 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-19T20:24:20.811 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_random.ko 2023-07-19T20:24:20.811 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-19T20:24:20.811 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tun.ko 2023-07-19T20:24:20.811 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/veth.ko 2023-07-19T20:24:20.811 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/virtio_net.ko 2023-07-19T20:24:20.812 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3 2023-07-19T20:24:20.812 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-19T20:24:20.812 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan 2023-07-19T20:24:20.812 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan/vxlan.ko 2023-07-19T20:24:20.812 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback 2023-07-19T20:24:20.812 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-19T20:24:20.812 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netfront.ko 2023-07-19T20:24:20.813 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb 2023-07-19T20:24:20.813 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb/ntb.ko 2023-07-19T20:24:20.813 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme 2023-07-19T20:24:20.813 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host 2023-07-19T20:24:20.813 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme-core.ko 2023-07-19T20:24:20.813 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme.ko 2023-07-19T20:24:20.813 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport 2023-07-19T20:24:20.813 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport.ko 2023-07-19T20:24:20.814 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_cs.ko 2023-07-19T20:24:20.814 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_pc.ko 2023-07-19T20:24:20.814 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_serial.ko 2023-07-19T20:24:20.814 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci 2023-07-19T20:24:20.814 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug 2023-07-19T20:24:20.814 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-19T20:24:20.814 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie 2023-07-19T20:24:20.814 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-19T20:24:20.815 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/xen-pcifront.ko 2023-07-19T20:24:20.815 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia 2023-07-19T20:24:20.815 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/i82092.ko 2023-07-19T20:24:20.815 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pd6729.ko 2023-07-19T20:24:20.815 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-19T20:24:20.815 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl 2023-07-19T20:24:20.815 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel 2023-07-19T20:24:20.815 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-19T20:24:20.816 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform 2023-07-19T20:24:20.816 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86 2023-07-19T20:24:20.816 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-19T20:24:20.816 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acerhdf.ko 2023-07-19T20:24:20.816 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-19T20:24:20.816 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-19T20:24:20.816 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-19T20:24:20.817 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-19T20:24:20.817 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-19T20:24:20.817 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-19T20:24:20.817 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-19T20:24:20.817 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-19T20:24:20.817 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-19T20:24:20.817 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/hdaps.ko 2023-07-19T20:24:20.817 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel 2023-07-19T20:24:20.818 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-19T20:24:20.818 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel_ips.ko 2023-07-19T20:24:20.818 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-19T20:24:20.818 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-19T20:24:20.818 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-19T20:24:20.818 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-19T20:24:20.818 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-19T20:24:20.818 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-19T20:24:20.819 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-19T20:24:20.819 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-19T20:24:20.819 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-19T20:24:20.819 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi.ko 2023-07-19T20:24:20.819 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap 2023-07-19T20:24:20.819 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-19T20:24:20.819 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-19T20:24:20.819 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps 2023-07-19T20:24:20.820 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients 2023-07-19T20:24:20.820 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-19T20:24:20.820 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-19T20:24:20.820 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps_parport.ko 2023-07-19T20:24:20.820 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/pps_core.ko 2023-07-19T20:24:20.820 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp 2023-07-19T20:24:20.820 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp.ko 2023-07-19T20:24:20.820 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp_kvm.ko 2023-07-19T20:24:20.821 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc 2023-07-19T20:24:20.821 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-19T20:24:20.821 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-19T20:24:20.821 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-19T20:24:20.821 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-19T20:24:20.821 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-19T20:24:20.821 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-19T20:24:20.822 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-19T20:24:20.822 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-19T20:24:20.822 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-19T20:24:20.822 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-19T20:24:20.822 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-19T20:24:20.822 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-em3027.ko 2023-07-19T20:24:20.822 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-19T20:24:20.822 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-19T20:24:20.823 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-19T20:24:20.823 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-19T20:24:20.823 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-19T20:24:20.823 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-19T20:24:20.823 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max6900.ko 2023-07-19T20:24:20.823 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-19T20:24:20.823 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-19T20:24:20.823 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-19T20:24:20.824 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-19T20:24:20.824 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-19T20:24:20.824 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-19T20:24:20.824 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-19T20:24:20.824 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-19T20:24:20.824 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-19T20:24:20.824 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-19T20:24:20.824 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-19T20:24:20.825 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-19T20:24:20.825 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-x1205.ko 2023-07-19T20:24:20.825 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi 2023-07-19T20:24:20.825 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-9xxx.ko 2023-07-19T20:24:20.825 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-sas.ko 2023-07-19T20:24:20.825 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-xxxx.ko 2023-07-19T20:24:20.825 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/BusLogic.ko 2023-07-19T20:24:20.825 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/a100u2w.ko 2023-07-19T20:24:20.826 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid 2023-07-19T20:24:20.826 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-19T20:24:20.826 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/advansys.ko 2023-07-19T20:24:20.826 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx 2023-07-19T20:24:20.826 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-19T20:24:20.826 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-19T20:24:20.826 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/am53c974.ko 2023-07-19T20:24:20.826 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr 2023-07-19T20:24:20.827 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-19T20:24:20.827 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/atp870u.ko 2023-07-19T20:24:20.827 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi 2023-07-19T20:24:20.827 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-19T20:24:20.827 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa 2023-07-19T20:24:20.827 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa/bfa.ko 2023-07-19T20:24:20.827 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc 2023-07-19T20:24:20.827 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-19T20:24:20.828 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i 2023-07-19T20:24:20.828 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-19T20:24:20.828 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ch.ko 2023-07-19T20:24:20.828 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor 2023-07-19T20:24:20.828 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-19T20:24:20.828 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi 2023-07-19T20:24:20.828 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-19T20:24:20.828 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-19T20:24:20.829 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-19T20:24:20.829 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-19T20:24:20.829 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-19T20:24:20.829 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dc395x.ko 2023-07-19T20:24:20.829 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler 2023-07-19T20:24:20.829 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-19T20:24:20.829 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-19T20:24:20.829 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-19T20:24:20.830 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-19T20:24:20.830 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dmx3191d.ko 2023-07-19T20:24:20.830 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r 2023-07-19T20:24:20.830 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-19T20:24:20.830 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esp_scsi.ko 2023-07-19T20:24:20.830 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe 2023-07-19T20:24:20.830 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-19T20:24:20.830 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-19T20:24:20.831 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic 2023-07-19T20:24:20.831 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic/fnic.ko 2023-07-19T20:24:20.831 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hpsa.ko 2023-07-19T20:24:20.831 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hptiop.ko 2023-07-19T20:24:20.831 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hv_storvsc.ko 2023-07-19T20:24:20.831 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/initio.ko 2023-07-19T20:24:20.831 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ipr.ko 2023-07-19T20:24:20.831 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ips.ko 2023-07-19T20:24:20.832 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci 2023-07-19T20:24:20.832 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci/isci.ko 2023-07-19T20:24:20.832 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-19T20:24:20.832 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-19T20:24:20.832 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc 2023-07-19T20:24:20.832 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc/libfc.ko 2023-07-19T20:24:20.832 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi.ko 2023-07-19T20:24:20.833 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-19T20:24:20.833 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas 2023-07-19T20:24:20.833 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas/libsas.ko 2023-07-19T20:24:20.833 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc 2023-07-19T20:24:20.833 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-19T20:24:20.833 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid 2023-07-19T20:24:20.833 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid.ko 2023-07-19T20:24:20.833 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-19T20:24:20.834 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-19T20:24:20.834 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-19T20:24:20.834 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas 2023-07-19T20:24:20.834 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-19T20:24:20.834 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas 2023-07-19T20:24:20.834 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-19T20:24:20.834 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvumi.ko 2023-07-19T20:24:20.834 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001 2023-07-19T20:24:20.835 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-19T20:24:20.835 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pmcraid.ko 2023-07-19T20:24:20.835 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla1280.ko 2023-07-19T20:24:20.835 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx 2023-07-19T20:24:20.835 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-19T20:24:20.835 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-19T20:24:20.835 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx 2023-07-19T20:24:20.835 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-19T20:24:20.836 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/raid_class.ko 2023-07-19T20:24:20.836 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_debug.ko 2023-07-19T20:24:20.836 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-19T20:24:20.836 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-19T20:24:20.836 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-19T20:24:20.836 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-19T20:24:20.836 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-19T20:24:20.836 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ses.ko 2023-07-19T20:24:20.837 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/st.ko 2023-07-19T20:24:20.837 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/stex.ko 2023-07-19T20:24:20.837 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2 2023-07-19T20:24:20.837 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-19T20:24:20.837 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/virtio_scsi.ko 2023-07-19T20:24:20.837 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-19T20:24:20.837 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/wd719x.ko 2023-07-19T20:24:20.837 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb 2023-07-19T20:24:20.838 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb/ssb.ko 2023-07-19T20:24:20.838 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target 2023-07-19T20:24:20.838 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi 2023-07-19T20:24:20.838 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-19T20:24:20.838 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback 2023-07-19T20:24:20.838 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-19T20:24:20.838 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_file.ko 2023-07-19T20:24:20.838 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_iblock.ko 2023-07-19T20:24:20.839 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_mod.ko 2023-07-19T20:24:20.839 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_pscsi.ko 2023-07-19T20:24:20.839 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_user.ko 2023-07-19T20:24:20.839 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc 2023-07-19T20:24:20.839 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-19T20:24:20.839 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal 2023-07-19T20:24:20.839 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel 2023-07-19T20:24:20.839 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal 2023-07-19T20:24:20.840 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-19T20:24:20.840 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-19T20:24:20.840 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-19T20:24:20.840 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-19T20:24:20.840 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-19T20:24:20.840 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-19T20:24:20.840 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-19T20:24:20.841 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-19T20:24:20.841 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-19T20:24:20.841 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-19T20:24:20.841 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-19T20:24:20.841 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-19T20:24:20.841 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-19T20:24:20.841 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-19T20:24:20.841 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-19T20:24:20.842 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty 2023-07-19T20:24:20.842 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless 2023-07-19T20:24:20.842 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-19T20:24:20.842 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_gsm.ko 2023-07-19T20:24:20.842 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_hdlc.ko 2023-07-19T20:24:20.842 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/nozomi.ko 2023-07-19T20:24:20.842 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial 2023-07-19T20:24:20.842 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250 2023-07-19T20:24:20.843 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-19T20:24:20.843 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/arc_uart.ko 2023-07-19T20:24:20.843 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm 2023-07-19T20:24:20.843 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-19T20:24:20.843 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/synclink_gt.ko 2023-07-19T20:24:20.843 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs 2023-07-19T20:24:20.843 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core 2023-07-19T20:24:20.843 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-19T20:24:20.844 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host 2023-07-19T20:24:20.844 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-19T20:24:20.844 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio 2023-07-19T20:24:20.844 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio.ko 2023-07-19T20:24:20.844 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_aec.ko 2023-07-19T20:24:20.844 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_cif.ko 2023-07-19T20:24:20.844 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_pci_generic.ko 2023-07-19T20:24:20.844 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_sercos3.ko 2023-07-19T20:24:20.845 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb 2023-07-19T20:24:20.845 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class 2023-07-19T20:24:20.845 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-acm.ko 2023-07-19T20:24:20.845 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-19T20:24:20.845 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usblp.ko 2023-07-19T20:24:20.845 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usbtmc.ko 2023-07-19T20:24:20.845 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host 2023-07-19T20:24:20.846 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-19T20:24:20.846 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image 2023-07-19T20:24:20.846 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/mdc800.ko 2023-07-19T20:24:20.846 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/microtek.ko 2023-07-19T20:24:20.846 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc 2023-07-19T20:24:20.846 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/adutux.ko 2023-07-19T20:24:20.846 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/appledisplay.ko 2023-07-19T20:24:20.846 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi26.ko 2023-07-19T20:24:20.847 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi62.ko 2023-07-19T20:24:20.847 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ezusb.ko 2023-07-19T20:24:20.847 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/idmouse.ko 2023-07-19T20:24:20.847 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/iowarrior.ko 2023-07-19T20:24:20.847 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-19T20:24:20.847 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ldusb.ko 2023-07-19T20:24:20.847 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/legousbtower.ko 2023-07-19T20:24:20.847 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga 2023-07-19T20:24:20.848 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-19T20:24:20.848 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-19T20:24:20.848 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usb3503.ko 2023-07-19T20:24:20.848 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usblcd.ko 2023-07-19T20:24:20.848 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-19T20:24:20.848 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/uss720.ko 2023-07-19T20:24:20.848 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/yurex.ko 2023-07-19T20:24:20.848 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy 2023-07-19T20:24:20.849 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-generic.ko 2023-07-19T20:24:20.849 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial 2023-07-19T20:24:20.849 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/aircable.ko 2023-07-19T20:24:20.849 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ark3116.ko 2023-07-19T20:24:20.849 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-19T20:24:20.850 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ch341.ko 2023-07-19T20:24:20.850 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cp210x.ko 2023-07-19T20:24:20.850 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cyberjack.ko 2023-07-19T20:24:20.850 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-19T20:24:20.850 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-19T20:24:20.850 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/empeg.ko 2023-07-19T20:24:20.850 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-19T20:24:20.851 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-19T20:24:20.851 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-19T20:24:20.851 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_ti.ko 2023-07-19T20:24:20.851 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipaq.ko 2023-07-19T20:24:20.851 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipw.ko 2023-07-19T20:24:20.851 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ir-usb.ko 2023-07-19T20:24:20.851 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-19T20:24:20.852 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan.ko 2023-07-19T20:24:20.852 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-19T20:24:20.852 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-19T20:24:20.852 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-19T20:24:20.852 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mct_u232.ko 2023-07-19T20:24:20.852 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7720.ko 2023-07-19T20:24:20.852 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7840.ko 2023-07-19T20:24:20.852 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/navman.ko 2023-07-19T20:24:20.853 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/omninet.ko 2023-07-19T20:24:20.853 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/opticon.ko 2023-07-19T20:24:20.853 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/option.ko 2023-07-19T20:24:20.853 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/oti6858.ko 2023-07-19T20:24:20.853 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/pl2303.ko 2023-07-19T20:24:20.853 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcaux.ko 2023-07-19T20:24:20.853 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcserial.ko 2023-07-19T20:24:20.853 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/quatech2.ko 2023-07-19T20:24:20.854 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/safe_serial.ko 2023-07-19T20:24:20.854 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/sierra.ko 2023-07-19T20:24:20.854 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-19T20:24:20.854 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ssu100.ko 2023-07-19T20:24:20.854 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/symbolserial.ko 2023-07-19T20:24:20.854 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-19T20:24:20.854 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-19T20:24:20.855 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_debug.ko 2023-07-19T20:24:20.855 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-19T20:24:20.855 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/visor.ko 2023-07-19T20:24:20.855 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/whiteheat.ko 2023-07-19T20:24:20.855 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-19T20:24:20.855 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage 2023-07-19T20:24:20.855 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/uas.ko 2023-07-19T20:24:20.855 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-19T20:24:20.855 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-19T20:24:20.856 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-19T20:24:20.856 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-19T20:24:20.856 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-19T20:24:20.856 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-19T20:24:20.856 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-19T20:24:20.856 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-karma.ko 2023-07-19T20:24:20.856 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-19T20:24:20.857 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-19T20:24:20.857 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-19T20:24:20.857 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-19T20:24:20.857 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-19T20:24:20.857 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/usb-storage.ko 2023-07-19T20:24:20.857 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip 2023-07-19T20:24:20.857 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-19T20:24:20.858 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-19T20:24:20.858 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-19T20:24:20.858 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio 2023-07-19T20:24:20.858 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci 2023-07-19T20:24:20.858 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-19T20:24:20.858 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-19T20:24:20.858 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio.ko 2023-07-19T20:24:20.859 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-19T20:24:20.859 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost 2023-07-19T20:24:20.859 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost.ko 2023-07-19T20:24:20.859 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-19T20:24:20.859 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_net.ko 2023-07-19T20:24:20.859 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_scsi.ko 2023-07-19T20:24:20.859 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video 2023-07-19T20:24:20.859 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight 2023-07-19T20:24:20.860 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/apple_bl.ko 2023-07-19T20:24:20.860 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lcd.ko 2023-07-19T20:24:20.860 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-19T20:24:20.860 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio 2023-07-19T20:24:20.860 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio.ko 2023-07-19T20:24:20.860 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_balloon.ko 2023-07-19T20:24:20.860 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_mmio.ko 2023-07-19T20:24:20.860 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci.ko 2023-07-19T20:24:20.861 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-19T20:24:20.861 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-19T20:24:20.861 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_ring.ko 2023-07-19T20:24:20.861 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1 2023-07-19T20:24:20.861 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters 2023-07-19T20:24:20.861 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2482.ko 2023-07-19T20:24:20.861 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2490.ko 2023-07-19T20:24:20.861 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves 2023-07-19T20:24:20.862 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-19T20:24:20.862 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-19T20:24:20.862 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-19T20:24:20.862 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-19T20:24:20.862 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-19T20:24:20.862 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-19T20:24:20.862 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-19T20:24:20.862 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-19T20:24:20.863 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-19T20:24:20.863 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-19T20:24:20.863 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-19T20:24:20.863 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/wire.ko 2023-07-19T20:24:20.863 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog 2023-07-19T20:24:20.863 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-19T20:24:20.863 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-19T20:24:20.863 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-19T20:24:20.864 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/hpwdt.ko 2023-07-19T20:24:20.864 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/i6300esb.ko 2023-07-19T20:24:20.864 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-19T20:24:20.864 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-19T20:24:20.864 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ib700wdt.ko 2023-07-19T20:24:20.864 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ibmasr.ko 2023-07-19T20:24:20.864 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-19T20:24:20.865 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-19T20:24:20.865 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it87_wdt.ko 2023-07-19T20:24:20.865 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/machzwd.ko 2023-07-19T20:24:20.865 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/nv_tco.ko 2023-07-19T20:24:20.865 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-19T20:24:20.865 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-19T20:24:20.865 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-19T20:24:20.865 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-19T20:24:20.866 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/softdog.ko 2023-07-19T20:24:20.866 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-19T20:24:20.866 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/via_wdt.ko 2023-07-19T20:24:20.866 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-19T20:24:20.866 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-19T20:24:20.866 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-19T20:24:20.866 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wdt_pci.ko 2023-07-19T20:24:20.866 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/xen_wdt.ko 2023-07-19T20:24:20.867 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen 2023-07-19T20:24:20.867 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-19T20:24:20.867 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-evtchn.ko 2023-07-19T20:24:20.867 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntalloc.ko 2023-07-19T20:24:20.867 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntdev.ko 2023-07-19T20:24:20.867 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback 2023-07-19T20:24:20.867 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-19T20:24:20.867 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-privcmd.ko 2023-07-19T20:24:20.868 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs 2023-07-19T20:24:20.868 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-19T20:24:20.868 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs 2023-07-19T20:24:20.868 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p 2023-07-19T20:24:20.868 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p/9p.ko 2023-07-19T20:24:20.868 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs 2023-07-19T20:24:20.868 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs/affs.ko 2023-07-19T20:24:20.868 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs 2023-07-19T20:24:20.869 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs/befs.ko 2023-07-19T20:24:20.869 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/binfmt_misc.ko 2023-07-19T20:24:20.869 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs 2023-07-19T20:24:20.869 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs/btrfs.ko 2023-07-19T20:24:20.869 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles 2023-07-19T20:24:20.869 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles/cachefiles.ko 2023-07-19T20:24:20.869 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph 2023-07-19T20:24:20.869 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph/ceph.ko 2023-07-19T20:24:20.870 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda 2023-07-19T20:24:20.870 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda/coda.ko 2023-07-19T20:24:20.870 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs 2023-07-19T20:24:20.870 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs/cramfs.ko 2023-07-19T20:24:20.870 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm 2023-07-19T20:24:20.870 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm/dlm.ko 2023-07-19T20:24:20.870 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs 2023-07-19T20:24:20.871 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-19T20:24:20.871 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs 2023-07-19T20:24:20.871 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs/f2fs.ko 2023-07-19T20:24:20.871 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat 2023-07-19T20:24:20.871 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/fat.ko 2023-07-19T20:24:20.871 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/msdos.ko 2023-07-19T20:24:20.871 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/vfat.ko 2023-07-19T20:24:20.871 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache 2023-07-19T20:24:20.872 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache/fscache.ko 2023-07-19T20:24:20.872 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse 2023-07-19T20:24:20.872 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/cuse.ko 2023-07-19T20:24:20.872 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/fuse.ko 2023-07-19T20:24:20.872 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2 2023-07-19T20:24:20.872 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2/gfs2.ko 2023-07-19T20:24:20.872 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs 2023-07-19T20:24:20.873 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs/hfs.ko 2023-07-19T20:24:20.873 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus 2023-07-19T20:24:20.873 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus/hfsplus.ko 2023-07-19T20:24:20.873 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs 2023-07-19T20:24:20.873 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs/isofs.ko 2023-07-19T20:24:20.873 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs 2023-07-19T20:24:20.874 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs/jfs.ko 2023-07-19T20:24:20.874 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd 2023-07-19T20:24:20.874 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd/lockd.ko 2023-07-19T20:24:20.874 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix 2023-07-19T20:24:20.874 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix/minix.ko 2023-07-19T20:24:20.874 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs 2023-07-19T20:24:20.874 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs/netfs.ko 2023-07-19T20:24:20.875 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs 2023-07-19T20:24:20.875 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout 2023-07-19T20:24:20.875 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-19T20:24:20.875 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout 2023-07-19T20:24:20.875 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-19T20:24:20.875 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout 2023-07-19T20:24:20.875 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-19T20:24:20.875 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfs.ko 2023-07-19T20:24:20.876 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv3.ko 2023-07-19T20:24:20.876 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv4.ko 2023-07-19T20:24:20.876 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common 2023-07-19T20:24:20.876 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/grace.ko 2023-07-19T20:24:20.876 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/nfs_acl.ko 2023-07-19T20:24:20.876 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd 2023-07-19T20:24:20.876 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd/nfsd.ko 2023-07-19T20:24:20.877 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2 2023-07-19T20:24:20.877 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2/nilfs2.ko 2023-07-19T20:24:20.877 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls 2023-07-19T20:24:20.877 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-celtic.ko 2023-07-19T20:24:20.877 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-centeuro.ko 2023-07-19T20:24:20.877 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-croatian.ko 2023-07-19T20:24:20.877 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-cyrillic.ko 2023-07-19T20:24:20.877 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-gaelic.ko 2023-07-19T20:24:20.878 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-greek.ko 2023-07-19T20:24:20.878 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-iceland.ko 2023-07-19T20:24:20.878 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-inuit.ko 2023-07-19T20:24:20.878 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-roman.ko 2023-07-19T20:24:20.878 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-romanian.ko 2023-07-19T20:24:20.878 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-turkish.ko 2023-07-19T20:24:20.878 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1250.ko 2023-07-19T20:24:20.878 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1251.ko 2023-07-19T20:24:20.879 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1255.ko 2023-07-19T20:24:20.879 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp737.ko 2023-07-19T20:24:20.879 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp775.ko 2023-07-19T20:24:20.879 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp850.ko 2023-07-19T20:24:20.879 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp852.ko 2023-07-19T20:24:20.879 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp855.ko 2023-07-19T20:24:20.879 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp857.ko 2023-07-19T20:24:20.879 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp860.ko 2023-07-19T20:24:20.880 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp861.ko 2023-07-19T20:24:20.880 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp862.ko 2023-07-19T20:24:20.880 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp863.ko 2023-07-19T20:24:20.880 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp864.ko 2023-07-19T20:24:20.880 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp865.ko 2023-07-19T20:24:20.880 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp866.ko 2023-07-19T20:24:20.880 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp869.ko 2023-07-19T20:24:20.880 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp874.ko 2023-07-19T20:24:20.881 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp932.ko 2023-07-19T20:24:20.881 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp936.ko 2023-07-19T20:24:20.881 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp949.ko 2023-07-19T20:24:20.881 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp950.ko 2023-07-19T20:24:20.881 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_euc-jp.ko 2023-07-19T20:24:20.881 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-1.ko 2023-07-19T20:24:20.881 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-13.ko 2023-07-19T20:24:20.881 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-14.ko 2023-07-19T20:24:20.882 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-15.ko 2023-07-19T20:24:20.882 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-2.ko 2023-07-19T20:24:20.882 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-3.ko 2023-07-19T20:24:20.882 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-4.ko 2023-07-19T20:24:20.882 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-5.ko 2023-07-19T20:24:20.882 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-6.ko 2023-07-19T20:24:20.882 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-7.ko 2023-07-19T20:24:20.882 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-9.ko 2023-07-19T20:24:20.883 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-r.ko 2023-07-19T20:24:20.883 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-ru.ko 2023-07-19T20:24:20.883 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-u.ko 2023-07-19T20:24:20.883 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_utf8.ko 2023-07-19T20:24:20.883 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2 2023-07-19T20:24:20.883 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster 2023-07-19T20:24:20.883 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-19T20:24:20.884 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm 2023-07-19T20:24:20.884 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-19T20:24:20.884 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs 2023-07-19T20:24:20.884 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-19T20:24:20.884 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2.ko 2023-07-19T20:24:20.884 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-19T20:24:20.884 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-19T20:24:20.884 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-19T20:24:20.885 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs 2023-07-19T20:24:20.885 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs/overlay.ko 2023-07-19T20:24:20.885 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore 2023-07-19T20:24:20.885 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore/ramoops.ko 2023-07-19T20:24:20.885 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs 2023-07-19T20:24:20.885 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs/reiserfs.ko 2023-07-19T20:24:20.885 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs 2023-07-19T20:24:20.885 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs/romfs.ko 2023-07-19T20:24:20.886 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb 2023-07-19T20:24:20.886 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client 2023-07-19T20:24:20.886 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client/cifs.ko 2023-07-19T20:24:20.886 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common 2023-07-19T20:24:20.886 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_arc4.ko 2023-07-19T20:24:20.886 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_md4.ko 2023-07-19T20:24:20.886 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs 2023-07-19T20:24:20.887 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs/squashfs.ko 2023-07-19T20:24:20.887 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv 2023-07-19T20:24:20.887 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv/sysv.ko 2023-07-19T20:24:20.887 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf 2023-07-19T20:24:20.887 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf/udf.ko 2023-07-19T20:24:20.887 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs 2023-07-19T20:24:20.887 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs/ufs.ko 2023-07-19T20:24:20.887 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs 2023-07-19T20:24:20.888 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs/xfs.ko 2023-07-19T20:24:20.888 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel 2023-07-19T20:24:20.888 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu 2023-07-19T20:24:20.888 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu/rcutorture.ko 2023-07-19T20:24:20.888 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/torture.ko 2023-07-19T20:24:20.888 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace 2023-07-19T20:24:20.888 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-19T20:24:20.888 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib 2023-07-19T20:24:20.889 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/asn1_encoder.ko 2023-07-19T20:24:20.889 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc-itu-t.ko 2023-07-19T20:24:20.889 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc8.ko 2023-07-19T20:24:20.889 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto 2023-07-19T20:24:20.889 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libarc4.ko 2023-07-19T20:24:20.889 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libdes.ko 2023-07-19T20:24:20.889 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/libcrc32c.ko 2023-07-19T20:24:20.890 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lru_cache.ko 2023-07-19T20:24:20.890 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4 2023-07-19T20:24:20.890 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4_compress.ko 2023-07-19T20:24:20.890 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4hc_compress.ko 2023-07-19T20:24:20.890 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math 2023-07-19T20:24:20.890 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math/cordic.ko 2023-07-19T20:24:20.890 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6 2023-07-19T20:24:20.890 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6/raid6_pq.ko 2023-07-19T20:24:20.891 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon 2023-07-19T20:24:20.891 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-19T20:24:20.891 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_bm.ko 2023-07-19T20:24:20.891 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_fsm.ko 2023-07-19T20:24:20.891 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_kmp.ko 2023-07-19T20:24:20.891 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd 2023-07-19T20:24:20.891 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd/zstd_compress.ko 2023-07-19T20:24:20.891 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm 2023-07-19T20:24:20.892 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm/hwpoison-inject.ko 2023-07-19T20:24:20.892 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net 2023-07-19T20:24:20.892 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan 2023-07-19T20:24:20.892 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/6lowpan.ko 2023-07-19T20:24:20.892 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_dest.ko 2023-07-19T20:24:20.892 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_fragment.ko 2023-07-19T20:24:20.892 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_hop.ko 2023-07-19T20:24:20.893 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-19T20:24:20.893 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_mobility.ko 2023-07-19T20:24:20.893 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_routing.ko 2023-07-19T20:24:20.893 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_udp.ko 2023-07-19T20:24:20.893 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802 2023-07-19T20:24:20.893 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/garp.ko 2023-07-19T20:24:20.893 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/mrp.ko 2023-07-19T20:24:20.893 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/p8022.ko 2023-07-19T20:24:20.894 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/psnap.ko 2023-07-19T20:24:20.894 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/stp.ko 2023-07-19T20:24:20.894 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q 2023-07-19T20:24:20.894 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q/8021q.ko 2023-07-19T20:24:20.894 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p 2023-07-19T20:24:20.894 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet.ko 2023-07-19T20:24:20.894 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_fd.ko 2023-07-19T20:24:20.894 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_rdma.ko 2023-07-19T20:24:20.895 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_virtio.ko 2023-07-19T20:24:20.895 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv 2023-07-19T20:24:20.895 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv/batman-adv.ko 2023-07-19T20:24:20.895 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge 2023-07-19T20:24:20.895 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/br_netfilter.ko 2023-07-19T20:24:20.895 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/bridge.ko 2023-07-19T20:24:20.895 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter 2023-07-19T20:24:20.895 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-19T20:24:20.896 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-19T20:24:20.896 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-19T20:24:20.896 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-19T20:24:20.896 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-19T20:24:20.896 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-19T20:24:20.896 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-19T20:24:20.896 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-19T20:24:20.896 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-19T20:24:20.897 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-19T20:24:20.897 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-19T20:24:20.897 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-19T20:24:20.897 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-19T20:24:20.897 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-19T20:24:20.897 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-19T20:24:20.897 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-19T20:24:20.897 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-19T20:24:20.898 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-19T20:24:20.898 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-19T20:24:20.898 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-19T20:24:20.898 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtables.ko 2023-07-19T20:24:20.898 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-19T20:24:20.898 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-19T20:24:20.898 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-19T20:24:20.898 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph 2023-07-19T20:24:20.899 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph/libceph.ko 2023-07-19T20:24:20.899 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core 2023-07-19T20:24:20.899 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/failover.ko 2023-07-19T20:24:20.899 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/pktgen.ko 2023-07-19T20:24:20.899 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp 2023-07-19T20:24:20.899 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp.ko 2023-07-19T20:24:20.899 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_diag.ko 2023-07-19T20:24:20.900 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv4.ko 2023-07-19T20:24:20.900 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv6.ko 2023-07-19T20:24:20.900 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver 2023-07-19T20:24:20.900 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver/dns_resolver.ko 2023-07-19T20:24:20.900 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa 2023-07-19T20:24:20.900 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/dsa_core.ko 2023-07-19T20:24:20.900 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_brcm.ko 2023-07-19T20:24:20.901 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_dsa.ko 2023-07-19T20:24:20.901 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_none.ko 2023-07-19T20:24:20.901 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_trailer.ko 2023-07-19T20:24:20.901 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154 2023-07-19T20:24:20.901 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan 2023-07-19T20:24:20.901 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-19T20:24:20.901 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154.ko 2023-07-19T20:24:20.901 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-19T20:24:20.902 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4 2023-07-19T20:24:20.902 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ah4.ko 2023-07-19T20:24:20.902 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/esp4.ko 2023-07-19T20:24:20.902 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/fou.ko 2023-07-19T20:24:20.902 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/gre.ko 2023-07-19T20:24:20.902 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/inet_diag.ko 2023-07-19T20:24:20.902 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_gre.ko 2023-07-19T20:24:20.902 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_tunnel.ko 2023-07-19T20:24:20.903 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_vti.ko 2023-07-19T20:24:20.903 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipcomp.ko 2023-07-19T20:24:20.903 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipip.ko 2023-07-19T20:24:20.903 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter 2023-07-19T20:24:20.903 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-19T20:24:20.903 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-19T20:24:20.903 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-19T20:24:20.903 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-19T20:24:20.904 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-19T20:24:20.904 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-19T20:24:20.904 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-19T20:24:20.904 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-19T20:24:20.904 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-19T20:24:20.904 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-19T20:24:20.904 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-19T20:24:20.905 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-19T20:24:20.905 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-19T20:24:20.905 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-19T20:24:20.905 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-19T20:24:20.905 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-19T20:24:20.905 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-19T20:24:20.905 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-19T20:24:20.905 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-19T20:24:20.906 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-19T20:24:20.906 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-19T20:24:20.906 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_bic.ko 2023-07-19T20:24:20.906 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_dctcp.ko 2023-07-19T20:24:20.906 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_diag.ko 2023-07-19T20:24:20.906 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_highspeed.ko 2023-07-19T20:24:20.906 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_htcp.ko 2023-07-19T20:24:20.906 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_hybla.ko 2023-07-19T20:24:20.907 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_illinois.ko 2023-07-19T20:24:20.907 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_lp.ko 2023-07-19T20:24:20.907 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_scalable.ko 2023-07-19T20:24:20.907 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_vegas.ko 2023-07-19T20:24:20.907 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_veno.ko 2023-07-19T20:24:20.907 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_westwood.ko 2023-07-19T20:24:20.907 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_yeah.ko 2023-07-19T20:24:20.908 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tunnel4.ko 2023-07-19T20:24:20.908 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_diag.ko 2023-07-19T20:24:20.908 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_tunnel.ko 2023-07-19T20:24:20.908 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-19T20:24:20.908 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6 2023-07-19T20:24:20.908 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ah6.ko 2023-07-19T20:24:20.908 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/esp6.ko 2023-07-19T20:24:20.908 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/fou6.ko 2023-07-19T20:24:20.909 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_tunnel.ko 2023-07-19T20:24:20.909 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-19T20:24:20.909 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_vti.ko 2023-07-19T20:24:20.909 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ipcomp6.ko 2023-07-19T20:24:20.909 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter 2023-07-19T20:24:20.909 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-19T20:24:20.909 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-19T20:24:20.909 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-19T20:24:20.910 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-19T20:24:20.910 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-19T20:24:20.910 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-19T20:24:20.910 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-19T20:24:20.910 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-19T20:24:20.910 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-19T20:24:20.910 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-19T20:24:20.910 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-19T20:24:20.911 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-19T20:24:20.911 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-19T20:24:20.911 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-19T20:24:20.911 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-19T20:24:20.911 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-19T20:24:20.911 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-19T20:24:20.911 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-19T20:24:20.911 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-19T20:24:20.912 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-19T20:24:20.912 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-19T20:24:20.912 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-19T20:24:20.912 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-19T20:24:20.912 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-19T20:24:20.912 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/sit.ko 2023-07-19T20:24:20.912 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/tunnel6.ko 2023-07-19T20:24:20.913 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-19T20:24:20.913 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key 2023-07-19T20:24:20.913 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key/af_key.ko 2023-07-19T20:24:20.913 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp 2023-07-19T20:24:20.913 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_core.ko 2023-07-19T20:24:20.913 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-19T20:24:20.913 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_eth.ko 2023-07-19T20:24:20.913 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip.ko 2023-07-19T20:24:20.914 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip6.ko 2023-07-19T20:24:20.914 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_netlink.ko 2023-07-19T20:24:20.914 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ppp.ko 2023-07-19T20:24:20.914 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc 2023-07-19T20:24:20.914 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc/llc.ko 2023-07-19T20:24:20.914 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154 2023-07-19T20:24:20.914 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154/mac802154.ko 2023-07-19T20:24:20.915 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls 2023-07-19T20:24:20.915 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls/mpls_gso.ko 2023-07-19T20:24:20.915 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter 2023-07-19T20:24:20.915 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset 2023-07-19T20:24:20.915 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set.ko 2023-07-19T20:24:20.915 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-19T20:24:20.915 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-19T20:24:20.915 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-19T20:24:20.916 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-19T20:24:20.916 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-19T20:24:20.916 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-19T20:24:20.916 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-19T20:24:20.916 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-19T20:24:20.916 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-19T20:24:20.916 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-19T20:24:20.917 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-19T20:24:20.917 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-19T20:24:20.917 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-19T20:24:20.917 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-19T20:24:20.917 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-19T20:24:20.917 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs 2023-07-19T20:24:20.917 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-19T20:24:20.917 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-19T20:24:20.918 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-19T20:24:20.918 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-19T20:24:20.918 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-19T20:24:20.918 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-19T20:24:20.918 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-19T20:24:20.918 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-19T20:24:20.918 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-19T20:24:20.918 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-19T20:24:20.919 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-19T20:24:20.919 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-19T20:24:20.919 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-19T20:24:20.919 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-19T20:24:20.919 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conncount.ko 2023-07-19T20:24:20.919 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack.ko 2023-07-19T20:24:20.919 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-19T20:24:20.920 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-19T20:24:20.920 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-19T20:24:20.920 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-19T20:24:20.920 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-19T20:24:20.920 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-19T20:24:20.920 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-19T20:24:20.920 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-19T20:24:20.920 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-19T20:24:20.921 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-19T20:24:20.921 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-19T20:24:20.921 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-19T20:24:20.921 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-19T20:24:20.921 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table.ko 2023-07-19T20:24:20.921 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-19T20:24:20.921 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_log_syslog.ko 2023-07-19T20:24:20.922 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat.ko 2023-07-19T20:24:20.922 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-19T20:24:20.922 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-19T20:24:20.922 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_irc.ko 2023-07-19T20:24:20.922 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_sip.ko 2023-07-19T20:24:20.922 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-19T20:24:20.922 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-19T20:24:20.922 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_tables.ko 2023-07-19T20:24:20.923 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink.ko 2023-07-19T20:24:20.923 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-19T20:24:20.923 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_log.ko 2023-07-19T20:24:20.923 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-19T20:24:20.923 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-19T20:24:20.923 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_chain_nat.ko 2023-07-19T20:24:20.923 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_compat.ko 2023-07-19T20:24:20.923 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_ct.ko 2023-07-19T20:24:20.924 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-19T20:24:20.924 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fib.ko 2023-07-19T20:24:20.924 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-19T20:24:20.924 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_hash.ko 2023-07-19T20:24:20.924 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_limit.ko 2023-07-19T20:24:20.924 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_log.ko 2023-07-19T20:24:20.924 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_masq.ko 2023-07-19T20:24:20.925 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_nat.ko 2023-07-19T20:24:20.925 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_numgen.ko 2023-07-19T20:24:20.925 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_queue.ko 2023-07-19T20:24:20.925 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_quota.ko 2023-07-19T20:24:20.925 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_redir.ko 2023-07-19T20:24:20.925 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject.ko 2023-07-19T20:24:20.925 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject_inet.ko 2023-07-19T20:24:20.925 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_socket.ko 2023-07-19T20:24:20.926 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_tunnel.ko 2023-07-19T20:24:20.926 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_AUDIT.ko 2023-07-19T20:24:20.926 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-19T20:24:20.926 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-19T20:24:20.926 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-19T20:24:20.926 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CT.ko 2023-07-19T20:24:20.926 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_DSCP.ko 2023-07-19T20:24:20.926 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HL.ko 2023-07-19T20:24:20.927 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HMARK.ko 2023-07-19T20:24:20.927 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-19T20:24:20.927 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LED.ko 2023-07-19T20:24:20.927 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LOG.ko 2023-07-19T20:24:20.927 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-19T20:24:20.927 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NETMAP.ko 2023-07-19T20:24:20.927 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFLOG.ko 2023-07-19T20:24:20.927 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-19T20:24:20.928 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_RATEEST.ko 2023-07-19T20:24:20.928 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-19T20:24:20.928 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_SECMARK.ko 2023-07-19T20:24:20.928 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-19T20:24:20.928 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-19T20:24:20.928 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TEE.ko 2023-07-19T20:24:20.928 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TPROXY.ko 2023-07-19T20:24:20.929 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TRACE.ko 2023-07-19T20:24:20.929 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_addrtype.ko 2023-07-19T20:24:20.929 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_bpf.ko 2023-07-19T20:24:20.929 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cgroup.ko 2023-07-19T20:24:20.929 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cluster.ko 2023-07-19T20:24:20.929 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_comment.ko 2023-07-19T20:24:20.929 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connbytes.ko 2023-07-19T20:24:20.929 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlabel.ko 2023-07-19T20:24:20.930 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlimit.ko 2023-07-19T20:24:20.930 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connmark.ko 2023-07-19T20:24:20.930 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_conntrack.ko 2023-07-19T20:24:20.930 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cpu.ko 2023-07-19T20:24:20.930 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dccp.ko 2023-07-19T20:24:20.930 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_devgroup.ko 2023-07-19T20:24:20.930 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dscp.ko 2023-07-19T20:24:20.930 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ecn.ko 2023-07-19T20:24:20.931 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_esp.ko 2023-07-19T20:24:20.931 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hashlimit.ko 2023-07-19T20:24:20.931 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_helper.ko 2023-07-19T20:24:20.931 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hl.ko 2023-07-19T20:24:20.931 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipcomp.ko 2023-07-19T20:24:20.931 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_iprange.ko 2023-07-19T20:24:20.931 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipvs.ko 2023-07-19T20:24:20.932 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_l2tp.ko 2023-07-19T20:24:20.932 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_length.ko 2023-07-19T20:24:20.932 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_limit.ko 2023-07-19T20:24:20.932 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mac.ko 2023-07-19T20:24:20.932 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mark.ko 2023-07-19T20:24:20.932 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_multiport.ko 2023-07-19T20:24:20.932 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nat.ko 2023-07-19T20:24:20.932 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nfacct.ko 2023-07-19T20:24:20.933 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_osf.ko 2023-07-19T20:24:20.933 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_owner.ko 2023-07-19T20:24:20.933 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_physdev.ko 2023-07-19T20:24:20.933 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_pkttype.ko 2023-07-19T20:24:20.933 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_policy.ko 2023-07-19T20:24:20.933 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_quota.ko 2023-07-19T20:24:20.933 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_rateest.ko 2023-07-19T20:24:20.933 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_realm.ko 2023-07-19T20:24:20.934 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_recent.ko 2023-07-19T20:24:20.934 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_sctp.ko 2023-07-19T20:24:20.934 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_set.ko 2023-07-19T20:24:20.934 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_socket.ko 2023-07-19T20:24:20.934 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_state.ko 2023-07-19T20:24:20.934 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_statistic.ko 2023-07-19T20:24:20.934 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_string.ko 2023-07-19T20:24:20.934 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_tcpmss.ko 2023-07-19T20:24:20.935 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_time.ko 2023-07-19T20:24:20.935 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_u32.ko 2023-07-19T20:24:20.935 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink 2023-07-19T20:24:20.935 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink/netlink_diag.ko 2023-07-19T20:24:20.935 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh 2023-07-19T20:24:20.935 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh/nsh.ko 2023-07-19T20:24:20.935 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch 2023-07-19T20:24:20.936 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/openvswitch.ko 2023-07-19T20:24:20.936 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-geneve.ko 2023-07-19T20:24:20.936 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-gre.ko 2023-07-19T20:24:20.936 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-vxlan.ko 2023-07-19T20:24:20.936 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet 2023-07-19T20:24:20.936 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet/af_packet_diag.ko 2023-07-19T20:24:20.936 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds 2023-07-19T20:24:20.937 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds.ko 2023-07-19T20:24:20.937 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_rdma.ko 2023-07-19T20:24:20.937 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_tcp.ko 2023-07-19T20:24:20.937 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched 2023-07-19T20:24:20.937 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_csum.ko 2023-07-19T20:24:20.937 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_gact.ko 2023-07-19T20:24:20.937 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_ipt.ko 2023-07-19T20:24:20.937 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_mirred.ko 2023-07-19T20:24:20.938 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_nat.ko 2023-07-19T20:24:20.938 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_pedit.ko 2023-07-19T20:24:20.938 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_police.ko 2023-07-19T20:24:20.938 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_simple.ko 2023-07-19T20:24:20.938 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_skbedit.ko 2023-07-19T20:24:20.938 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_vlan.ko 2023-07-19T20:24:20.938 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_basic.ko 2023-07-19T20:24:20.938 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_bpf.ko 2023-07-19T20:24:20.939 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_flow.ko 2023-07-19T20:24:20.939 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_fw.ko 2023-07-19T20:24:20.939 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_route.ko 2023-07-19T20:24:20.939 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_u32.ko 2023-07-19T20:24:20.939 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_cmp.ko 2023-07-19T20:24:20.939 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_ipset.ko 2023-07-19T20:24:20.939 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_meta.ko 2023-07-19T20:24:20.940 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_nbyte.ko 2023-07-19T20:24:20.940 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_text.ko 2023-07-19T20:24:20.940 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_u32.ko 2023-07-19T20:24:20.940 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_choke.ko 2023-07-19T20:24:20.940 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_codel.ko 2023-07-19T20:24:20.940 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_drr.ko 2023-07-19T20:24:20.940 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_fq.ko 2023-07-19T20:24:20.940 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_gred.ko 2023-07-19T20:24:20.941 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hfsc.ko 2023-07-19T20:24:20.941 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hhf.ko 2023-07-19T20:24:20.941 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_htb.ko 2023-07-19T20:24:20.941 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_ingress.ko 2023-07-19T20:24:20.941 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio.ko 2023-07-19T20:24:20.941 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio_lib.ko 2023-07-19T20:24:20.941 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_multiq.ko 2023-07-19T20:24:20.941 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_netem.ko 2023-07-19T20:24:20.942 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_pie.ko 2023-07-19T20:24:20.942 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_plug.ko 2023-07-19T20:24:20.942 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_prio.ko 2023-07-19T20:24:20.942 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_qfq.ko 2023-07-19T20:24:20.942 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_red.ko 2023-07-19T20:24:20.942 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfb.ko 2023-07-19T20:24:20.942 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfq.ko 2023-07-19T20:24:20.943 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_tbf.ko 2023-07-19T20:24:20.943 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_teql.ko 2023-07-19T20:24:20.943 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp 2023-07-19T20:24:20.943 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp.ko 2023-07-19T20:24:20.943 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp_diag.ko 2023-07-19T20:24:20.943 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc 2023-07-19T20:24:20.943 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss 2023-07-19T20:24:20.943 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-19T20:24:20.944 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-19T20:24:20.944 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/sunrpc.ko 2023-07-19T20:24:20.944 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma 2023-07-19T20:24:20.944 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-19T20:24:20.944 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc 2023-07-19T20:24:20.944 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/diag.ko 2023-07-19T20:24:20.944 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/tipc.ko 2023-07-19T20:24:20.944 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix 2023-07-19T20:24:20.945 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix/unix_diag.ko 2023-07-19T20:24:20.945 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock 2023-07-19T20:24:20.945 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-19T20:24:20.945 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-19T20:24:20.945 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock.ko 2023-07-19T20:24:20.945 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-19T20:24:20.945 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-19T20:24:20.946 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm 2023-07-19T20:24:20.946 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-19T20:24:20.946 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security 2023-07-19T20:24:20.946 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys 2023-07-19T20:24:20.946 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys 2023-07-19T20:24:20.946 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-19T20:24:20.946 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys 2023-07-19T20:24:20.946 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys/trusted.ko 2023-07-19T20:24:20.947 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt 2023-07-19T20:24:20.947 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib 2023-07-19T20:24:20.947 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib/irqbypass.ko 2023-07-19T20:24:20.947 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias 2023-07-19T20:24:20.947 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias.bin 2023-07-19T20:24:20.947 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin 2023-07-19T20:24:20.947 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.bin 2023-07-19T20:24:20.947 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.modinfo 2023-07-19T20:24:20.948 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep 2023-07-19T20:24:20.948 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep.bin 2023-07-19T20:24:20.948 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.devname 2023-07-19T20:24:20.948 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.order 2023-07-19T20:24:20.948 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.softdep 2023-07-19T20:24:20.948 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols 2023-07-19T20:24:20.948 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols.bin 2023-07-19T20:24:20.949 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-ga440c79eee02 2023-07-19T20:24:20.949 DEBUG:teuthology.orchestra.run.smithi130:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-19T20:24:20.977 INFO:teuthology.orchestra.run.smithi130.stdout:postinstall scriptlet (using /bin/sh): 2023-07-19T20:24:20.978 INFO:teuthology.orchestra.run.smithi130.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 -a -r /boot/System.map-6.5.0-rc1-ga440c79eee02 ]; then 2023-07-19T20:24:20.978 INFO:teuthology.orchestra.run.smithi130.stdout:cp /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm 2023-07-19T20:24:20.978 INFO:teuthology.orchestra.run.smithi130.stdout:cp /boot/System.map-6.5.0-rc1-ga440c79eee02 /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-19T20:24:20.978 INFO:teuthology.orchestra.run.smithi130.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-19T20:24:20.979 INFO:teuthology.orchestra.run.smithi130.stdout:/sbin/installkernel 6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-19T20:24:20.979 INFO:teuthology.orchestra.run.smithi130.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-19T20:24:20.979 INFO:teuthology.orchestra.run.smithi130.stdout:fi 2023-07-19T20:24:20.979 INFO:teuthology.orchestra.run.smithi130.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-19T20:24:20.979 INFO:teuthology.orchestra.run.smithi130.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-19T20:24:20.979 INFO:teuthology.orchestra.run.smithi130.stdout:new-kernel-pkg --remove 6.5.0-rc1-ga440c79eee02 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-ga440c79eee02.img 2023-07-19T20:24:20.979 INFO:teuthology.orchestra.run.smithi130.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-19T20:24:20.979 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-install remove 6.5.0-rc1-ga440c79eee02 2023-07-19T20:24:20.980 INFO:teuthology.orchestra.run.smithi130.stdout:fi 2023-07-19T20:24:20.980 INFO:teuthology.orchestra.run.smithi130.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-19T20:24:20.980 INFO:teuthology.orchestra.run.smithi130.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-19T20:24:20.980 INFO:teuthology.orchestra.run.smithi130.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-ga440c79eee02 2023-07-19T20:24:20.980 INFO:teuthology.orchestra.run.smithi130.stdout:fi 2023-07-19T20:24:20.981 DEBUG:teuthology.orchestra.run.smithi130:> sudo rpm -qi grub2-tools 2023-07-19T20:24:21.064 INFO:teuthology.orchestra.run.smithi130.stdout:Name : grub2-tools 2023-07-19T20:24:21.064 INFO:teuthology.orchestra.run.smithi130.stdout:Epoch : 1 2023-07-19T20:24:21.065 INFO:teuthology.orchestra.run.smithi130.stdout:Version : 2.02 2023-07-19T20:24:21.065 INFO:teuthology.orchestra.run.smithi130.stdout:Release : 129.el8 2023-07-19T20:24:21.065 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: x86_64 2023-07-19T20:24:21.065 INFO:teuthology.orchestra.run.smithi130.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-19T20:24:21.065 INFO:teuthology.orchestra.run.smithi130.stdout:Group : System Environment/Base 2023-07-19T20:24:21.065 INFO:teuthology.orchestra.run.smithi130.stdout:Size : 9265586 2023-07-19T20:24:21.065 INFO:teuthology.orchestra.run.smithi130.stdout:License : GPLv3+ 2023-07-19T20:24:21.066 INFO:teuthology.orchestra.run.smithi130.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-19T20:24:21.066 INFO:teuthology.orchestra.run.smithi130.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-19T20:24:21.066 INFO:teuthology.orchestra.run.smithi130.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-19T20:24:21.066 INFO:teuthology.orchestra.run.smithi130.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-19T20:24:21.066 INFO:teuthology.orchestra.run.smithi130.stdout:Relocations : (not relocatable) 2023-07-19T20:24:21.066 INFO:teuthology.orchestra.run.smithi130.stdout:Packager : CentOS BuildSystem 2023-07-19T20:24:21.066 INFO:teuthology.orchestra.run.smithi130.stdout:Vendor : CentOS 2023-07-19T20:24:21.066 INFO:teuthology.orchestra.run.smithi130.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-19T20:24:21.067 INFO:teuthology.orchestra.run.smithi130.stdout:Summary : Support tools for GRUB. 2023-07-19T20:24:21.067 INFO:teuthology.orchestra.run.smithi130.stdout:Description : 2023-07-19T20:24:21.067 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:24:21.067 INFO:teuthology.orchestra.run.smithi130.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-19T20:24:21.067 INFO:teuthology.orchestra.run.smithi130.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-19T20:24:21.067 INFO:teuthology.orchestra.run.smithi130.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-19T20:24:21.068 INFO:teuthology.orchestra.run.smithi130.stdout:hardware devices. 2023-07-19T20:24:21.068 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:24:21.068 INFO:teuthology.orchestra.run.smithi130.stdout:This subpackage provides tools for support of all platforms. 2023-07-19T20:24:21.068 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-19T20:24:21.068 INFO:teuthology.task.kernel:Updating grub on smithi130 to boot 6.5.0-rc1-ga440c79eee02 2023-07-19T20:24:21.069 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-19T20:24:25.336 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2023-07-19T20:24:27.455 INFO:teuthology.orchestra.run.smithi130.stderr:done 2023-07-19T20:24:27.456 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2023-07-19T20:24:27.505 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.2n05qs77nF 2023-07-19T20:24:27.505 DEBUG:teuthology.orchestra.run.smithi130:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2n05qs77nF 2023-07-19T20:24:27.540 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.2n05qs77nF 2023-07-19T20:24:27.707 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.2n05qs77nF is 6KB 2023-07-19T20:24:27.749 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.2n05qs77nF 2023-07-19T20:24:27.770 DEBUG:teuthology.orchestra.run.smithi130:> sudo /bin/ls /boot/loader/entries || true 2023-07-19T20:24:27.850 INFO:teuthology.orchestra.run.smithi130.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-19T20:24:27.851 INFO:teuthology.orchestra.run.smithi130.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-19T20:24:27.851 INFO:teuthology.orchestra.run.smithi130.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-19T20:24:27.851 INFO:teuthology.orchestra.run.smithi130.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc1-ga440c79eee02.conf 2023-07-19T20:24:27.852 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc1-ga440c79eee02 2023-07-19T20:24:28.019 DEBUG:teuthology.orchestra.run.smithi130:> sudo shutdown -r now 2023-07-19T20:24:58.025 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-19T20:24:58.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-07-19T20:24:58.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:25:16.400 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-07-19T20:25:25.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-07-19T20:25:25.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:25:28.464 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-07-19T20:25:40.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-07-19T20:25:40.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:26:12.251 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-07-19T20:26:12.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-07-19T20:26:12.648 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc1-ga440c79eee02"... 2023-07-19T20:26:12.649 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2023-07-19T20:26:12.693 INFO:teuthology.orchestra.run.smithi130.stdout:6.5.0-rc1-ga440c79eee02 2023-07-19T20:26:12.694 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-ga440c79eee02 vs 6.5.0-rc1-ga440c79eee02 2023-07-19T20:26:12.694 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-19T20:26:12.694 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-19T20:26:13.695 DEBUG:teuthology.parallel:result is None 2023-07-19T20:26:13.696 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-19T20:26:13.703 INFO:teuthology.task.internal:Creating test directory... 2023-07-19T20:26:13.703 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-19T20:26:13.708 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-19T20:26:13.712 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-19T20:26:13.762 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-19T20:26:13.770 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-19T20:26:13.783 INFO:teuthology.task.internal:Creating archive directory... 2023-07-19T20:26:13.784 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-19T20:26:13.786 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-19T20:26:13.789 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-19T20:26:14.133 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-19T20:26:14.146 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-19T20:26:14.146 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-19T20:26:14.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-19T20:26:14.167 DEBUG:teuthology.orchestra.run.smithi124:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-19T20:26:14.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-19T20:26:14.189 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-19T20:26:14.215 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-19T20:26:14.232 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-19T20:26:14.262 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-19T20:26:14.279 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-19T20:26:14.281 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-19T20:26:14.299 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-19T20:26:14.355 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-19T20:26:14.415 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-19T20:26:14.418 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-19T20:26:14.428 INFO:teuthology.task.internal:Configuring sudo... 2023-07-19T20:26:14.428 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-19T20:26:14.430 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-19T20:26:14.433 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-19T20:26:14.505 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-19T20:26:14.516 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-19T20:26:14.517 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-19T20:26:14.520 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-19T20:26:14.522 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-19T20:26:14.567 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-19T20:26:14.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-19T20:26:14.677 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-19T20:26:14.764 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-19T20:26:14.807 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:26:14.807 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-19T20:26:14.874 DEBUG:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-19T20:26:14.928 DEBUG:teuthology.orchestra.run.smithi124:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-19T20:26:14.991 DEBUG:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-19T20:26:15.045 DEBUG:teuthology.orchestra.run.smithi124:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-19T20:26:15.089 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:26:15.090 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-19T20:26:15.162 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-19T20:26:15.242 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-19T20:26:15.314 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-19T20:26:15.391 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-19T20:26:15.461 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:26:15.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-19T20:26:15.530 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2023-07-19T20:26:15.532 DEBUG:teuthology.orchestra.run.smithi124:> sudo service rsyslog restart 2023-07-19T20:26:15.535 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2023-07-19T20:26:15.607 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-19T20:26:15.609 INFO:teuthology.orchestra.run.smithi124.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-19T20:26:15.704 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-19T20:26:16.118 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-19T20:26:16.127 INFO:teuthology.task.internal:Starting timer... 2023-07-19T20:26:16.127 INFO:teuthology.run_tasks:Running task pcp... 2023-07-19T20:26:16.169 INFO:teuthology.run_tasks:Running task selinux... 2023-07-19T20:26:16.179 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-19T20:26:16.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2023-07-19T20:26:16.234 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2023-07-19T20:26:16.235 DEBUG:teuthology.orchestra.run.smithi124:> sudo service auditd rotate 2023-07-19T20:26:16.289 INFO:teuthology.orchestra.run.smithi124.stdout:Rotating logs: 2023-07-19T20:26:16.290 DEBUG:teuthology.orchestra.run.smithi130:> sudo service auditd rotate 2023-07-19T20:26:16.415 INFO:teuthology.orchestra.run.smithi130.stdout:Rotating logs: 2023-07-19T20:26:16.418 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-19T20:26:16.418 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2023-07-19T20:26:16.468 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2023-07-19T20:26:16.469 DEBUG:teuthology.orchestra.run.smithi124:> /usr/sbin/getenforce 2023-07-19T20:26:16.497 INFO:teuthology.orchestra.run.smithi124.stdout:Permissive 2023-07-19T20:26:16.497 DEBUG:teuthology.orchestra.run.smithi130:> /usr/sbin/getenforce 2023-07-19T20:26:16.554 INFO:teuthology.orchestra.run.smithi130.stdout:Permissive 2023-07-19T20:26:16.554 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi117.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi124.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi130.front.sepia.ceph.com': 'permissive'} 2023-07-19T20:26:16.555 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-19T20:26:16.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-19T20:26:16.583 DEBUG:teuthology.orchestra.run.smithi124:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-19T20:26:16.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-19T20:26:16.612 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-19T20:26:16.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-19T20:26:16.682 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-19T20:26:16.683 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2023-07-19T20:26:16.710 DEBUG:teuthology.orchestra.run.smithi124:> sudo /usr/sbin/setenforce permissive 2023-07-19T20:26:16.738 DEBUG:teuthology.orchestra.run.smithi130:> sudo /usr/sbin/setenforce permissive 2023-07-19T20:26:16.808 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-19T20:26:16.821 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-19T20:26:16.828 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-19T20:26:16.997 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-19T20:26:17.023 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-19T20:26:17.024 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi117.front.sepia.ceph.com,smithi124.front.sepia.ceph.com,smithi130.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-19T20:36:42.141 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi117.front.sepia.ceph.com'), Remote(name='ubuntu@smithi124.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com')] 2023-07-19T20:36:42.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-07-19T20:36:42.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:36:42.213 DEBUG:teuthology.orchestra.run.smithi117:> true 2023-07-19T20:36:42.292 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-07-19T20:36:42.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-07-19T20:36:42.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:36:42.366 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-07-19T20:36:42.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-07-19T20:36:42.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-07-19T20:36:42.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:36:42.527 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-07-19T20:36:42.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-07-19T20:36:42.643 INFO:teuthology.run_tasks:Running task clock... 2023-07-19T20:36:42.661 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-19T20:36:42.662 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-19T20:36:42.663 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-19T20:36:42.665 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-19T20:36:42.666 DEBUG:teuthology.orchestra.run.smithi124:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-19T20:36:42.668 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-19T20:36:42.668 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-19T20:36:42.701 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-19T20:36:42.702 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-19T20:36:42.716 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-19T20:36:42.718 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-19T20:36:42.758 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-19T20:36:42.788 INFO:teuthology.orchestra.run.smithi124.stderr:sudo: ntpd: command not found 2023-07-19T20:36:42.790 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-19T20:36:42.791 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2023-07-19T20:36:42.800 INFO:teuthology.orchestra.run.smithi124.stdout:506 Cannot talk to daemon 2023-07-19T20:36:42.803 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2023-07-19T20:36:42.814 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-19T20:36:42.819 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-19T20:36:42.827 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-19T20:36:42.832 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-19T20:36:42.878 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: ntpd: command not found 2023-07-19T20:36:42.896 INFO:teuthology.orchestra.run.smithi124.stderr:bash: ntpq: command not found 2023-07-19T20:36:42.900 INFO:teuthology.orchestra.run.smithi124.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-19T20:36:42.900 INFO:teuthology.orchestra.run.smithi124.stdout:=============================================================================== 2023-07-19T20:36:42.903 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-19T20:36:42.903 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-19T20:36:42.903 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-19T20:36:42.904 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-19T20:36:42.905 INFO:teuthology.orchestra.run.smithi117.stderr:bash: ntpq: command not found 2023-07-19T20:36:42.907 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-19T20:36:42.907 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2023-07-19T20:36:42.908 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-19T20:36:42.908 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-19T20:36:42.908 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-19T20:36:42.908 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-19T20:36:42.909 INFO:teuthology.orchestra.run.smithi130.stdout:506 Cannot talk to daemon 2023-07-19T20:36:42.938 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-19T20:36:42.970 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-19T20:36:43.054 INFO:teuthology.orchestra.run.smithi130.stderr:bash: ntpq: command not found 2023-07-19T20:36:43.062 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-19T20:36:43.062 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2023-07-19T20:36:43.062 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-19T20:36:43.062 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-19T20:36:43.062 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-19T20:36:43.063 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-19T20:36:43.063 INFO:teuthology.run_tasks:Running task install... 2023-07-19T20:36:43.072 DEBUG:teuthology.task.install:project ceph 2023-07-19T20:36:43.073 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '796ba272b844628dfe71207e1e29131fa2eea4cd'}} 2023-07-19T20:36:43.073 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '796ba272b844628dfe71207e1e29131fa2eea4cd'} 2023-07-19T20:36:43.073 INFO:teuthology.task.install:Using flavor: default 2023-07-19T20:36:43.080 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-19T20:36:43.081 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-19T20:36:43.081 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '796ba272b844628dfe71207e1e29131fa2eea4cd', 'tag': None, 'wait_for_package': False} 2023-07-19T20:36:43.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=796ba272b844628dfe71207e1e29131fa2eea4cd 2023-07-19T20:36:43.086 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '796ba272b844628dfe71207e1e29131fa2eea4cd', 'tag': None, 'wait_for_package': False} 2023-07-19T20:36:43.086 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=796ba272b844628dfe71207e1e29131fa2eea4cd 2023-07-19T20:36:43.088 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '796ba272b844628dfe71207e1e29131fa2eea4cd', 'tag': None, 'wait_for_package': False} 2023-07-19T20:36:43.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=796ba272b844628dfe71207e1e29131fa2eea4cd 2023-07-19T20:36:43.445 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-07-06-0738-reef/796ba272b844628dfe71207e1e29131fa2eea4cd/centos/8/flavors/default/ 2023-07-19T20:36:43.445 INFO:teuthology.task.install.rpm:Package version is 18.1.2-35.g796ba272 2023-07-19T20:36:43.455 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-07-06-0738-reef/796ba272b844628dfe71207e1e29131fa2eea4cd/centos/8/flavors/default/ 2023-07-19T20:36:43.455 INFO:teuthology.task.install.rpm:Package version is 18.1.2-35.g796ba272 2023-07-19T20:36:43.457 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-07-06-0738-reef/796ba272b844628dfe71207e1e29131fa2eea4cd/centos/8/flavors/default/ 2023-07-19T20:36:43.457 INFO:teuthology.task.install.rpm:Package version is 18.1.2-35.g796ba272 2023-07-19T20:36:43.738 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-07-06-0738-reef/796ba272b844628dfe71207e1e29131fa2eea4cd/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-07-06-0738-reef/796ba272b844628dfe71207e1e29131fa2eea4cd/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-07-06-0738-reef/796ba272b844628dfe71207e1e29131fa2eea4cd/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-19T20:36:43.739 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:36:43.739 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-19T20:36:43.811 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-19T20:36:43.812 DEBUG:teuthology.orchestra.run.smithi130:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/796ba272b844628dfe71207e1e29131fa2eea4cd/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-19T20:36:43.924 DEBUG:teuthology.orchestra.run.smithi130:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-19T20:36:44.020 DEBUG:teuthology.orchestra.run.smithi130:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-19T20:36:44.089 INFO:teuthology.orchestra.run.smithi130.stdout:check_obsoletes = 1 2023-07-19T20:36:44.095 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum clean all 2023-07-19T20:36:44.291 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-07-06-0738-reef/796ba272b844628dfe71207e1e29131fa2eea4cd/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-07-06-0738-reef/796ba272b844628dfe71207e1e29131fa2eea4cd/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-07-06-0738-reef/796ba272b844628dfe71207e1e29131fa2eea4cd/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-19T20:36:44.291 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:36:44.292 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-19T20:36:44.295 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-07-06-0738-reef/796ba272b844628dfe71207e1e29131fa2eea4cd/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-07-06-0738-reef/796ba272b844628dfe71207e1e29131fa2eea4cd/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-07-06-0738-reef/796ba272b844628dfe71207e1e29131fa2eea4cd/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-19T20:36:44.295 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:36:44.299 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-19T20:36:44.336 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-19T20:36:44.337 DEBUG:teuthology.orchestra.run.smithi124:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/796ba272b844628dfe71207e1e29131fa2eea4cd/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-19T20:36:44.338 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-19T20:36:44.345 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/796ba272b844628dfe71207e1e29131fa2eea4cd/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-19T20:36:44.410 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-19T20:36:44.411 DEBUG:teuthology.orchestra.run.smithi124:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-19T20:36:44.448 INFO:teuthology.orchestra.run.smithi130.stdout:73 files removed 2023-07-19T20:36:44.483 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-19T20:36:44.493 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-19T20:36:44.500 DEBUG:teuthology.orchestra.run.smithi124:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-19T20:36:44.562 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2023-07-19T20:36:44.563 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2023-07-19T20:36:44.575 INFO:teuthology.orchestra.run.smithi124.stdout:check_obsoletes = 1 2023-07-19T20:36:44.575 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum clean all 2023-07-19T20:36:44.835 INFO:teuthology.orchestra.run.smithi117.stdout:73 files removed 2023-07-19T20:36:44.863 INFO:teuthology.orchestra.run.smithi124.stdout:73 files removed 2023-07-19T20:36:44.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-19T20:36:44.894 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-19T20:36:45.801 INFO:teuthology.orchestra.run.smithi130.stdout:ceph packages for x86_64 103 kB/s | 80 kB 00:00 2023-07-19T20:36:45.968 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 110 kB/s | 80 kB 00:00 2023-07-19T20:36:46.033 INFO:teuthology.orchestra.run.smithi124.stdout:ceph packages for x86_64 105 kB/s | 80 kB 00:00 2023-07-19T20:36:46.476 INFO:teuthology.orchestra.run.smithi130.stdout:ceph noarch packages 15 kB/s | 9.4 kB 00:00 2023-07-19T20:36:46.676 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 14 kB/s | 9.4 kB 00:00 2023-07-19T20:36:46.728 INFO:teuthology.orchestra.run.smithi124.stdout:ceph noarch packages 14 kB/s | 9.4 kB 00:00 2023-07-19T20:36:47.144 INFO:teuthology.orchestra.run.smithi130.stdout:ceph source packages 2.3 kB/s | 1.5 kB 00:00 2023-07-19T20:36:47.293 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 2.5 kB/s | 1.5 kB 00:00 2023-07-19T20:36:47.367 INFO:teuthology.orchestra.run.smithi124.stdout:ceph source packages 2.4 kB/s | 1.5 kB 00:00 2023-07-19T20:36:51.304 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 8 - AppStream 7.8 MB/s | 31 MB 00:03 2023-07-19T20:36:59.975 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 8 - BaseOS 14 MB/s | 41 MB 00:03 2023-07-19T20:37:06.592 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 8 - Extras 40 kB/s | 18 kB 00:00 2023-07-19T20:37:07.418 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 8 - Extras common packages 10 kB/s | 6.6 kB 00:00 2023-07-19T20:37:12.675 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - AppStream 1.2 MB/s | 31 MB 00:25 2023-07-19T20:37:16.738 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 8 - AppStream 1.0 MB/s | 31 MB 00:29 2023-07-19T20:37:21.235 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 8 - PowerTools 470 kB/s | 6.3 MB 00:13 2023-07-19T20:37:21.667 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - BaseOS 14 MB/s | 41 MB 00:02 2023-07-19T20:37:22.854 INFO:teuthology.orchestra.run.smithi124.stdout:Copr repo for python3-asyncssh owned by ceph 9.1 kB/s | 3.5 kB 00:00 2023-07-19T20:37:25.279 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 8 - BaseOS 14 MB/s | 41 MB 00:02 2023-07-19T20:37:25.363 INFO:teuthology.orchestra.run.smithi124.stdout:Extra Packages for Enterprise Linux 6.6 MB/s | 16 MB 00:02 2023-07-19T20:37:28.725 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - Extras 26 kB/s | 18 kB 00:00 2023-07-19T20:37:29.161 INFO:teuthology.orchestra.run.smithi124.stdout:lab-extras 530 kB/s | 24 kB 00:00 2023-07-19T20:37:29.551 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - Extras common packages 10 kB/s | 6.6 kB 00:00 2023-07-19T20:37:31.712 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 8 - Extras 38 kB/s | 18 kB 00:00 2023-07-19T20:37:32.479 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 8 - Extras common packages 11 kB/s | 6.6 kB 00:00 2023-07-19T20:37:32.991 INFO:teuthology.orchestra.run.smithi124.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-19T20:37:32.992 INFO:teuthology.orchestra.run.smithi124.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-19T20:37:33.004 INFO:teuthology.orchestra.run.smithi124.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-19T20:37:33.005 INFO:teuthology.orchestra.run.smithi124.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-19T20:37:33.005 INFO:teuthology.orchestra.run.smithi124.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-19T20:37:33.006 INFO:teuthology.orchestra.run.smithi124.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-19T20:37:33.007 INFO:teuthology.orchestra.run.smithi124.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-19T20:37:33.009 INFO:teuthology.orchestra.run.smithi124.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-19T20:37:33.012 INFO:teuthology.orchestra.run.smithi124.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-19T20:37:33.013 INFO:teuthology.orchestra.run.smithi124.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-19T20:37:33.194 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-07-19T20:37:33.206 INFO:teuthology.orchestra.run.smithi124.stdout:==================================================================================================== 2023-07-19T20:37:33.207 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2023-07-19T20:37:33.207 INFO:teuthology.orchestra.run.smithi124.stdout:==================================================================================================== 2023-07-19T20:37:33.207 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-07-19T20:37:33.207 INFO:teuthology.orchestra.run.smithi124.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-19T20:37:33.207 INFO:teuthology.orchestra.run.smithi124.stdout: ceph x86_64 2:18.1.2-35.g796ba272.el8 ceph 6.4 k 2023-07-19T20:37:33.208 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-base x86_64 2:18.1.2-35.g796ba272.el8 ceph 5.4 M 2023-07-19T20:37:33.208 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-fuse x86_64 2:18.1.2-35.g796ba272.el8 ceph 847 k 2023-07-19T20:37:33.208 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-immutable-object-cache x86_64 2:18.1.2-35.g796ba272.el8 ceph 165 k 2023-07-19T20:37:33.208 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr x86_64 2:18.1.2-35.g796ba272.el8 ceph 1.5 M 2023-07-19T20:37:33.208 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-cephadm noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 127 k 2023-07-19T20:37:33.208 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-dashboard noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 1.7 M 2023-07-19T20:37:33.209 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-diskprediction-local noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 7.4 M 2023-07-19T20:37:33.209 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-rook noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 47 k 2023-07-19T20:37:33.209 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-radosgw x86_64 2:18.1.2-35.g796ba272.el8 ceph 13 M 2023-07-19T20:37:33.209 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-test x86_64 2:18.1.2-35.g796ba272.el8 ceph 47 M 2023-07-19T20:37:33.209 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-volume noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 264 k 2023-07-19T20:37:33.209 INFO:teuthology.orchestra.run.smithi124.stdout: cephadm noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 162 k 2023-07-19T20:37:33.209 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-mirror x86_64 2:18.1.2-35.g796ba272.el8 ceph 257 k 2023-07-19T20:37:33.209 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-top noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 18 k 2023-07-19T20:37:33.210 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-19T20:37:33.210 INFO:teuthology.orchestra.run.smithi124.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-19T20:37:33.210 INFO:teuthology.orchestra.run.smithi124.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-19T20:37:33.210 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs-devel x86_64 2:18.1.2-35.g796ba272.el8 ceph 30 k 2023-07-19T20:37:33.210 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs2 x86_64 2:18.1.2-35.g796ba272.el8 ceph 769 k 2023-07-19T20:37:33.210 INFO:teuthology.orchestra.run.smithi124.stdout: librados-devel x86_64 2:18.1.2-35.g796ba272.el8 ceph 139 k 2023-07-19T20:37:33.210 INFO:teuthology.orchestra.run.smithi124.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-19T20:37:33.211 INFO:teuthology.orchestra.run.smithi124.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-19T20:37:33.211 INFO:teuthology.orchestra.run.smithi124.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-19T20:37:33.211 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-19T20:37:33.211 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-19T20:37:33.212 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-19T20:37:33.212 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cephfs x86_64 2:18.1.2-35.g796ba272.el8 ceph 190 k 2023-07-19T20:37:33.212 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rados x86_64 2:18.1.2-35.g796ba272.el8 ceph 371 k 2023-07-19T20:37:33.212 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rbd x86_64 2:18.1.2-35.g796ba272.el8 ceph 365 k 2023-07-19T20:37:33.212 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rgw x86_64 2:18.1.2-35.g796ba272.el8 ceph 107 k 2023-07-19T20:37:33.212 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-fuse x86_64 2:18.1.2-35.g796ba272.el8 ceph 94 k 2023-07-19T20:37:33.212 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-mirror x86_64 2:18.1.2-35.g796ba272.el8 ceph 3.4 M 2023-07-19T20:37:33.212 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-nbd x86_64 2:18.1.2-35.g796ba272.el8 ceph 179 k 2023-07-19T20:37:33.213 INFO:teuthology.orchestra.run.smithi124.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-19T20:37:33.213 INFO:teuthology.orchestra.run.smithi124.stdout:Upgrading: 2023-07-19T20:37:33.213 INFO:teuthology.orchestra.run.smithi124.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-19T20:37:33.213 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-19T20:37:33.213 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-19T20:37:33.213 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-19T20:37:33.213 INFO:teuthology.orchestra.run.smithi124.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-19T20:37:33.214 INFO:teuthology.orchestra.run.smithi124.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-19T20:37:33.214 INFO:teuthology.orchestra.run.smithi124.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-19T20:37:33.214 INFO:teuthology.orchestra.run.smithi124.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-19T20:37:33.214 INFO:teuthology.orchestra.run.smithi124.stdout: librados2 x86_64 2:18.1.2-35.g796ba272.el8 ceph 3.7 M 2023-07-19T20:37:33.214 INFO:teuthology.orchestra.run.smithi124.stdout: librbd1 x86_64 2:18.1.2-35.g796ba272.el8 ceph 3.6 M 2023-07-19T20:37:33.214 INFO:teuthology.orchestra.run.smithi124.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-19T20:37:33.215 INFO:teuthology.orchestra.run.smithi124.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-19T20:37:33.215 INFO:teuthology.orchestra.run.smithi124.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-19T20:37:33.215 INFO:teuthology.orchestra.run.smithi124.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-19T20:37:33.216 INFO:teuthology.orchestra.run.smithi124.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-19T20:37:33.216 INFO:teuthology.orchestra.run.smithi124.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-19T20:37:33.216 INFO:teuthology.orchestra.run.smithi124.stdout:Installing dependencies: 2023-07-19T20:37:33.216 INFO:teuthology.orchestra.run.smithi124.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-19T20:37:33.217 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-common x86_64 2:18.1.2-35.g796ba272.el8 ceph 22 M 2023-07-19T20:37:33.217 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-grafana-dashboards noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 23 k 2023-07-19T20:37:33.217 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mds x86_64 2:18.1.2-35.g796ba272.el8 ceph 2.3 M 2023-07-19T20:37:33.217 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-modules-core noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 240 k 2023-07-19T20:37:33.217 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mon x86_64 2:18.1.2-35.g796ba272.el8 ceph 4.6 M 2023-07-19T20:37:33.217 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-osd x86_64 2:18.1.2-35.g796ba272.el8 ceph 18 M 2023-07-19T20:37:33.218 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-prometheus-alerts noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 15 k 2023-07-19T20:37:33.218 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-selinux x86_64 2:18.1.2-35.g796ba272.el8 ceph 24 k 2023-07-19T20:37:33.218 INFO:teuthology.orchestra.run.smithi124.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-19T20:37:33.218 INFO:teuthology.orchestra.run.smithi124.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-19T20:37:33.218 INFO:teuthology.orchestra.run.smithi124.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-19T20:37:33.218 INFO:teuthology.orchestra.run.smithi124.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-19T20:37:33.218 INFO:teuthology.orchestra.run.smithi124.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-19T20:37:33.218 INFO:teuthology.orchestra.run.smithi124.stdout: libcephsqlite x86_64 2:18.1.2-35.g796ba272.el8 ceph 138 k 2023-07-19T20:37:33.219 INFO:teuthology.orchestra.run.smithi124.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-19T20:37:33.219 INFO:teuthology.orchestra.run.smithi124.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-19T20:37:33.219 INFO:teuthology.orchestra.run.smithi124.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-19T20:37:33.219 INFO:teuthology.orchestra.run.smithi124.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-19T20:37:33.219 INFO:teuthology.orchestra.run.smithi124.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-19T20:37:33.219 INFO:teuthology.orchestra.run.smithi124.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-19T20:37:33.219 INFO:teuthology.orchestra.run.smithi124.stdout: libradosstriper1 x86_64 2:18.1.2-35.g796ba272.el8 ceph 475 k 2023-07-19T20:37:33.219 INFO:teuthology.orchestra.run.smithi124.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-19T20:37:33.220 INFO:teuthology.orchestra.run.smithi124.stdout: librgw2 x86_64 2:18.1.2-35.g796ba272.el8 ceph 6.5 M 2023-07-19T20:37:33.220 INFO:teuthology.orchestra.run.smithi124.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-19T20:37:33.220 INFO:teuthology.orchestra.run.smithi124.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-19T20:37:33.220 INFO:teuthology.orchestra.run.smithi124.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-19T20:37:33.220 INFO:teuthology.orchestra.run.smithi124.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-19T20:37:33.220 INFO:teuthology.orchestra.run.smithi124.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-19T20:37:33.220 INFO:teuthology.orchestra.run.smithi124.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-19T20:37:33.221 INFO:teuthology.orchestra.run.smithi124.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-19T20:37:33.221 INFO:teuthology.orchestra.run.smithi124.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-19T20:37:33.221 INFO:teuthology.orchestra.run.smithi124.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-19T20:37:33.221 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-19T20:37:33.221 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-19T20:37:33.221 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-19T20:37:33.221 INFO:teuthology.orchestra.run.smithi124.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-19T20:37:33.222 INFO:teuthology.orchestra.run.smithi124.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-19T20:37:33.222 INFO:teuthology.orchestra.run.smithi124.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-19T20:37:33.222 INFO:teuthology.orchestra.run.smithi124.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-19T20:37:33.222 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-19T20:37:33.222 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-argparse x86_64 2:18.1.2-35.g796ba272.el8 ceph 45 k 2023-07-19T20:37:33.222 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-common x86_64 2:18.1.2-35.g796ba272.el8 ceph 119 k 2023-07-19T20:37:33.222 INFO:teuthology.orchestra.run.smithi124.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-19T20:37:33.222 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-19T20:37:33.223 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-19T20:37:33.223 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-19T20:37:33.223 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-19T20:37:33.223 INFO:teuthology.orchestra.run.smithi124.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-19T20:37:33.223 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-19T20:37:33.224 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-19T20:37:33.224 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-19T20:37:33.224 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-19T20:37:33.224 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-19T20:37:33.224 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-19T20:37:33.224 INFO:teuthology.orchestra.run.smithi124.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-19T20:37:33.225 INFO:teuthology.orchestra.run.smithi124.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-19T20:37:33.225 INFO:teuthology.orchestra.run.smithi124.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-19T20:37:33.225 INFO:teuthology.orchestra.run.smithi124.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-19T20:37:33.225 INFO:teuthology.orchestra.run.smithi124.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-19T20:37:33.225 INFO:teuthology.orchestra.run.smithi124.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-19T20:37:33.225 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-19T20:37:33.225 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-19T20:37:33.226 INFO:teuthology.orchestra.run.smithi124.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-19T20:37:33.226 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-19T20:37:33.226 INFO:teuthology.orchestra.run.smithi124.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-19T20:37:33.226 INFO:teuthology.orchestra.run.smithi124.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-19T20:37:33.226 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-19T20:37:33.226 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-19T20:37:33.227 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-19T20:37:33.227 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-19T20:37:33.227 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-19T20:37:33.227 INFO:teuthology.orchestra.run.smithi124.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-19T20:37:33.227 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-19T20:37:33.227 INFO:teuthology.orchestra.run.smithi124.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-19T20:37:33.227 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-19T20:37:33.228 INFO:teuthology.orchestra.run.smithi124.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-19T20:37:33.228 INFO:teuthology.orchestra.run.smithi124.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-19T20:37:33.228 INFO:teuthology.orchestra.run.smithi124.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-19T20:37:33.228 INFO:teuthology.orchestra.run.smithi124.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-19T20:37:33.228 INFO:teuthology.orchestra.run.smithi124.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-19T20:37:33.228 INFO:teuthology.orchestra.run.smithi124.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-19T20:37:33.228 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-19T20:37:33.229 INFO:teuthology.orchestra.run.smithi124.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-19T20:37:33.229 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-19T20:37:33.229 INFO:teuthology.orchestra.run.smithi124.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-19T20:37:33.229 INFO:teuthology.orchestra.run.smithi124.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-19T20:37:33.229 INFO:teuthology.orchestra.run.smithi124.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-19T20:37:33.229 INFO:teuthology.orchestra.run.smithi124.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-19T20:37:33.229 INFO:teuthology.orchestra.run.smithi124.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-19T20:37:33.230 INFO:teuthology.orchestra.run.smithi124.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-19T20:37:33.230 INFO:teuthology.orchestra.run.smithi124.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-19T20:37:33.230 INFO:teuthology.orchestra.run.smithi124.stdout:Enabling module streams: 2023-07-19T20:37:33.230 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql 10 2023-07-19T20:37:33.230 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:37:33.230 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-07-19T20:37:33.231 INFO:teuthology.orchestra.run.smithi124.stdout:==================================================================================================== 2023-07-19T20:37:33.231 INFO:teuthology.orchestra.run.smithi124.stdout:Install 128 Packages 2023-07-19T20:37:33.231 INFO:teuthology.orchestra.run.smithi124.stdout:Upgrade 16 Packages 2023-07-19T20:37:33.231 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:37:33.232 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 210 M 2023-07-19T20:37:33.232 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-07-19T20:37:33.822 INFO:teuthology.orchestra.run.smithi124.stdout:(1/144): ceph-18.1.2-35.g796ba272.el8.x86_64.rp 31 kB/s | 6.4 kB 00:00 2023-07-19T20:37:34.171 INFO:teuthology.orchestra.run.smithi124.stdout:(2/144): ceph-fuse-18.1.2-35.g796ba272.el8.x86_ 2.4 MB/s | 847 kB 00:00 2023-07-19T20:37:34.263 INFO:teuthology.orchestra.run.smithi124.stdout:(3/144): ceph-immutable-object-cache-18.1.2-35. 1.8 MB/s | 165 kB 00:00 2023-07-19T20:37:34.739 INFO:teuthology.orchestra.run.smithi124.stdout:(4/144): ceph-mds-18.1.2-35.g796ba272.el8.x86_6 4.8 MB/s | 2.3 MB 00:00 2023-07-19T20:37:34.863 INFO:teuthology.orchestra.run.smithi124.stdout:(5/144): ceph-base-18.1.2-35.g796ba272.el8.x86_ 4.3 MB/s | 5.4 MB 00:01 2023-07-19T20:37:35.097 INFO:teuthology.orchestra.run.smithi124.stdout:(6/144): ceph-mgr-18.1.2-35.g796ba272.el8.x86_6 4.3 MB/s | 1.5 MB 00:00 2023-07-19T20:37:35.531 INFO:teuthology.orchestra.run.smithi124.stdout:(7/144): ceph-mon-18.1.2-35.g796ba272.el8.x86_6 6.9 MB/s | 4.6 MB 00:00 2023-07-19T20:37:35.962 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 8 - PowerTools 1.9 MB/s | 6.3 MB 00:03 2023-07-19T20:37:36.493 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - PowerTools 947 kB/s | 6.3 MB 00:06 2023-07-19T20:37:36.964 INFO:teuthology.orchestra.run.smithi124.stdout:(8/144): ceph-common-18.1.2-35.g796ba272.el8.x8 6.4 MB/s | 22 MB 00:03 2023-07-19T20:37:37.056 INFO:teuthology.orchestra.run.smithi124.stdout:(9/144): ceph-selinux-18.1.2-35.g796ba272.el8.x 266 kB/s | 24 kB 00:00 2023-07-19T20:37:37.206 INFO:teuthology.orchestra.run.smithi124.stdout:(10/144): ceph-radosgw-18.1.2-35.g796ba272.el8. 7.8 MB/s | 13 MB 00:01 2023-07-19T20:37:37.315 INFO:teuthology.orchestra.run.smithi124.stdout:(11/144): cephfs-mirror-18.1.2-35.g796ba272.el8 2.3 MB/s | 257 kB 00:00 2023-07-19T20:37:37.415 INFO:teuthology.orchestra.run.smithi124.stdout:(12/144): libcephfs-devel-18.1.2-35.g796ba272.e 304 kB/s | 30 kB 00:00 2023-07-19T20:37:37.455 INFO:teuthology.orchestra.run.smithi117.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-07-19T20:37:37.540 INFO:teuthology.orchestra.run.smithi124.stdout:(13/144): libcephfs2-18.1.2-35.g796ba272.el8.x8 6.0 MB/s | 769 kB 00:00 2023-07-19T20:37:37.732 INFO:teuthology.orchestra.run.smithi124.stdout:(14/144): ceph-osd-18.1.2-35.g796ba272.el8.x86_ 6.7 MB/s | 18 MB 00:02 2023-07-19T20:37:37.757 INFO:teuthology.orchestra.run.smithi124.stdout:(15/144): libcephsqlite-18.1.2-35.g796ba272.el8 634 kB/s | 138 kB 00:00 2023-07-19T20:37:37.833 INFO:teuthology.orchestra.run.smithi124.stdout:(16/144): librados-devel-18.1.2-35.g796ba272.el 1.4 MB/s | 139 kB 00:00 2023-07-19T20:37:37.866 INFO:teuthology.orchestra.run.smithi124.stdout:(17/144): libradosstriper1-18.1.2-35.g796ba272. 4.3 MB/s | 475 kB 00:00 2023-07-19T20:37:37.975 INFO:teuthology.orchestra.run.smithi124.stdout:(18/144): python3-ceph-argparse-18.1.2-35.g796b 412 kB/s | 45 kB 00:00 2023-07-19T20:37:38.111 INFO:teuthology.orchestra.run.smithi130.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-07-19T20:37:38.122 INFO:teuthology.orchestra.run.smithi124.stdout:(19/144): python3-ceph-common-18.1.2-35.g796ba2 807 kB/s | 119 kB 00:00 2023-07-19T20:37:38.242 INFO:teuthology.orchestra.run.smithi124.stdout:(20/144): python3-cephfs-18.1.2-35.g796ba272.el 1.6 MB/s | 190 kB 00:00 2023-07-19T20:37:38.375 INFO:teuthology.orchestra.run.smithi124.stdout:(21/144): python3-rados-18.1.2-35.g796ba272.el8 2.7 MB/s | 371 kB 00:00 2023-07-19T20:37:38.609 INFO:teuthology.orchestra.run.smithi124.stdout:(22/144): python3-rbd-18.1.2-35.g796ba272.el8.x 1.5 MB/s | 365 kB 00:00 2023-07-19T20:37:38.701 INFO:teuthology.orchestra.run.smithi124.stdout:(23/144): python3-rgw-18.1.2-35.g796ba272.el8.x 1.1 MB/s | 107 kB 00:00 2023-07-19T20:37:38.901 INFO:teuthology.orchestra.run.smithi124.stdout:(24/144): librgw2-18.1.2-35.g796ba272.el8.x86_6 6.1 MB/s | 6.5 MB 00:01 2023-07-19T20:37:38.985 INFO:teuthology.orchestra.run.smithi124.stdout:(25/144): rbd-fuse-18.1.2-35.g796ba272.el8.x86_ 332 kB/s | 94 kB 00:00 2023-07-19T20:37:39.144 INFO:teuthology.orchestra.run.smithi124.stdout:(26/144): rbd-nbd-18.1.2-35.g796ba272.el8.x86_6 1.1 MB/s | 179 kB 00:00 2023-07-19T20:37:39.252 INFO:teuthology.orchestra.run.smithi124.stdout:(27/144): ceph-grafana-dashboards-18.1.2-35.g79 213 kB/s | 23 kB 00:00 2023-07-19T20:37:39.378 INFO:teuthology.orchestra.run.smithi124.stdout:(28/144): ceph-mgr-cephadm-18.1.2-35.g796ba272. 1.0 MB/s | 127 kB 00:00 2023-07-19T20:37:39.803 INFO:teuthology.orchestra.run.smithi124.stdout:(29/144): ceph-mgr-dashboard-18.1.2-35.g796ba27 4.0 MB/s | 1.7 MB 00:00 2023-07-19T20:37:39.928 INFO:teuthology.orchestra.run.smithi124.stdout:(30/144): rbd-mirror-18.1.2-35.g796ba272.el8.x8 3.4 MB/s | 3.4 MB 00:01 2023-07-19T20:37:40.020 INFO:teuthology.orchestra.run.smithi124.stdout:(31/144): ceph-mgr-modules-core-18.1.2-35.g796b 2.6 MB/s | 240 kB 00:00 2023-07-19T20:37:40.087 INFO:teuthology.orchestra.run.smithi124.stdout:(32/144): ceph-mgr-rook-18.1.2-35.g796ba272.el8 711 kB/s | 47 kB 00:00 2023-07-19T20:37:40.187 INFO:teuthology.orchestra.run.smithi124.stdout:(33/144): ceph-prometheus-alerts-18.1.2-35.g796 145 kB/s | 15 kB 00:00 2023-07-19T20:37:40.346 INFO:teuthology.orchestra.run.smithi124.stdout:(34/144): ceph-volume-18.1.2-35.g796ba272.el8.n 1.6 MB/s | 264 kB 00:00 2023-07-19T20:37:40.429 INFO:teuthology.orchestra.run.smithi124.stdout:(35/144): cephadm-18.1.2-35.g796ba272.el8.noarc 1.9 MB/s | 162 kB 00:00 2023-07-19T20:37:40.505 INFO:teuthology.orchestra.run.smithi124.stdout:(36/144): cephfs-top-18.1.2-35.g796ba272.el8.no 240 kB/s | 18 kB 00:00 2023-07-19T20:37:41.013 INFO:teuthology.orchestra.run.smithi124.stdout:(37/144): automake-1.16.1-7.el8.noarch.rpm 1.4 MB/s | 713 kB 00:00 2023-07-19T20:37:41.122 INFO:teuthology.orchestra.run.smithi124.stdout:(38/144): bison-3.0.4-10.el8.x86_64.rpm 6.2 MB/s | 688 kB 00:00 2023-07-19T20:37:41.231 INFO:teuthology.orchestra.run.smithi124.stdout:(39/144): ceph-mgr-diskprediction-local-18.1.2- 5.2 MB/s | 7.4 MB 00:01 2023-07-19T20:37:41.256 INFO:teuthology.orchestra.run.smithi124.stdout:(40/144): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2023-07-19T20:37:41.356 INFO:teuthology.orchestra.run.smithi124.stdout:(41/144): libpq-13.5-1.el8.x86_64.rpm 1.9 MB/s | 198 kB 00:00 2023-07-19T20:37:41.448 INFO:teuthology.orchestra.run.smithi124.stdout:(42/144): librdkafka-0.11.4-3.el8.x86_64.rpm 3.8 MB/s | 354 kB 00:00 2023-07-19T20:37:41.549 INFO:teuthology.orchestra.run.smithi124.stdout:(43/144): libtool-2.4.6-25.el8.x86_64.rpm 6.9 MB/s | 709 kB 00:00 2023-07-19T20:37:41.574 INFO:teuthology.orchestra.run.smithi124.stdout:(44/144): jq-1.6-7.el8.x86_64.rpm 591 kB/s | 202 kB 00:00 2023-07-19T20:37:41.641 INFO:teuthology.orchestra.run.smithi124.stdout:(45/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2023-07-19T20:37:41.666 INFO:teuthology.orchestra.run.smithi124.stdout:(46/144): oniguruma-6.8.2-2.el8.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2023-07-19T20:37:42.000 INFO:teuthology.orchestra.run.smithi124.stdout:(47/144): openblas-0.3.15-4.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2023-07-19T20:37:42.734 INFO:teuthology.orchestra.run.smithi124.stdout:(48/144): openblas-threads-0.3.15-4.el8.x86_64. 4.6 MB/s | 4.9 MB 00:01 2023-07-19T20:37:42.883 INFO:teuthology.orchestra.run.smithi124.stdout:(49/144): postgresql-10.23-1.module_el8+300+2c5 1.8 MB/s | 1.6 MB 00:00 2023-07-19T20:37:43.046 INFO:teuthology.orchestra.run.smithi124.stdout:(50/144): postgresql-contrib-10.23-1.module_el8 2.8 MB/s | 903 kB 00:00 2023-07-19T20:37:43.325 INFO:teuthology.orchestra.run.smithi124.stdout:(51/144): postgresql-server-10.23-1.module_el8+ 12 MB/s | 5.1 MB 00:00 2023-07-19T20:37:43.776 INFO:teuthology.orchestra.run.smithi124.stdout:(52/144): ceph-test-18.1.2-35.g796ba272.el8.x86 6.9 MB/s | 47 MB 00:06 2023-07-19T20:37:43.809 INFO:teuthology.orchestra.run.smithi124.stdout:(53/144): python3-jinja2-2.10.1-3.el8.noarch.rp 1.1 MB/s | 538 kB 00:00 2023-07-19T20:37:43.926 INFO:teuthology.orchestra.run.smithi124.stdout:(54/144): python3-babel-2.5.1-7.el8.noarch.rpm 5.4 MB/s | 4.8 MB 00:00 2023-07-19T20:37:43.943 INFO:teuthology.orchestra.run.smithi124.stdout:(55/144): python3-jsonpointer-1.10-11.el8.noarc 149 kB/s | 20 kB 00:00 2023-07-19T20:37:44.010 INFO:teuthology.orchestra.run.smithi124.stdout:(56/144): python3-mako-1.0.6-14.el8.noarch.rpm 1.8 MB/s | 157 kB 00:00 2023-07-19T20:37:44.027 INFO:teuthology.orchestra.run.smithi124.stdout:(57/144): python3-markupsafe-0.23-19.el8.x86_64 464 kB/s | 39 kB 00:00 2023-07-19T20:37:44.060 INFO:teuthology.orchestra.run.smithi124.stdout:(58/144): python3-jsonpatch-1.21-2.el8.noarch.r 93 kB/s | 27 kB 00:00 2023-07-19T20:37:44.127 INFO:teuthology.orchestra.run.smithi124.stdout:(59/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-07-19T20:37:44.219 INFO:teuthology.orchestra.run.smithi124.stdout:(60/144): python3-prettytable-0.7.2-14.el8.noar 277 kB/s | 44 kB 00:00 2023-07-19T20:37:44.244 INFO:teuthology.orchestra.run.smithi124.stdout:(61/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 887 kB/s | 103 kB 00:00 2023-07-19T20:37:44.407 INFO:teuthology.orchestra.run.smithi124.stdout:(62/144): python3-pyasn1-modules-0.3.7-6.el8.no 678 kB/s | 110 kB 00:00 2023-07-19T20:37:44.454 INFO:teuthology.orchestra.run.smithi124.stdout:(63/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 540 kB/s | 126 kB 00:00 2023-07-19T20:37:44.520 INFO:teuthology.orchestra.run.smithi124.stdout:(64/144): python3-numpy-1.14.3-10.el8.x86_64.rp 7.3 MB/s | 3.7 MB 00:00 2023-07-19T20:37:44.538 INFO:teuthology.orchestra.run.smithi124.stdout:(65/144): python3-pytz-2017.2-9.el8.noarch.rpm 416 kB/s | 54 kB 00:00 2023-07-19T20:37:44.621 INFO:teuthology.orchestra.run.smithi124.stdout:(66/144): python3-werkzeug-0.12.2-4.el8.noarch. 4.5 MB/s | 457 kB 00:00 2023-07-19T20:37:44.646 INFO:teuthology.orchestra.run.smithi124.stdout:(67/144): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2023-07-19T20:37:44.738 INFO:teuthology.orchestra.run.smithi124.stdout:(68/144): uuid-1.6.2-43.el8.x86_64.rpm 547 kB/s | 64 kB 00:00 2023-07-19T20:37:44.763 INFO:teuthology.orchestra.run.smithi124.stdout:(69/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 604 kB/s | 71 kB 00:00 2023-07-19T20:37:45.280 INFO:teuthology.orchestra.run.smithi124.stdout:(70/144): elfutils-libelf-devel-0.189-2.el8.x86 113 kB/s | 61 kB 00:00 2023-07-19T20:37:45.330 INFO:teuthology.orchestra.run.smithi124.stdout:(71/144): fuse-2.9.7-17.el8.x86_64.rpm 146 kB/s | 83 kB 00:00 2023-07-19T20:37:45.543 INFO:teuthology.orchestra.run.smithi124.stdout:(72/144): python3-scipy-1.0.0-21.module_el8.5.0 13 MB/s | 14 MB 00:01 2023-07-19T20:37:45.564 INFO:teuthology.orchestra.run.smithi124.stdout:(73/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 169 kB/s | 48 kB 00:00 2023-07-19T20:37:45.740 INFO:teuthology.orchestra.run.smithi124.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 221 kB/s | 39 kB 00:00 2023-07-19T20:37:45.857 INFO:teuthology.orchestra.run.smithi124.stdout:(75/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.0 MB/s | 561 kB 00:00 2023-07-19T20:37:45.890 INFO:teuthology.orchestra.run.smithi124.stdout:(76/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 54 kB/s | 19 kB 00:00 2023-07-19T20:37:46.024 INFO:teuthology.orchestra.run.smithi124.stdout:(77/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.0 MB/s | 172 kB 00:00 2023-07-19T20:37:46.166 INFO:teuthology.orchestra.run.smithi124.stdout:(78/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 170 kB/s | 47 kB 00:00 2023-07-19T20:37:46.308 INFO:teuthology.orchestra.run.smithi124.stdout:(79/144): libselinux-devel-2.9-8.el8.x86_64.rpm 706 kB/s | 200 kB 00:00 2023-07-19T20:37:46.371 INFO:teuthology.orchestra.run.smithi124.stdout:(80/144): libgfortran-8.5.0-20.el8.x86_64.rpm 1.0 MB/s | 645 kB 00:00 2023-07-19T20:37:46.409 INFO:teuthology.orchestra.run.smithi124.stdout:(81/144): libsepol-devel-2.9-3.el8.x86_64.rpm 359 kB/s | 87 kB 00:00 2023-07-19T20:37:46.442 INFO:teuthology.orchestra.run.smithi124.stdout:(82/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 743 kB/s | 99 kB 00:00 2023-07-19T20:37:46.500 INFO:teuthology.orchestra.run.smithi124.stdout:(83/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 140 kB/s | 18 kB 00:00 2023-07-19T20:37:46.559 INFO:teuthology.orchestra.run.smithi124.stdout:(84/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 291 kB/s | 44 kB 00:00 2023-07-19T20:37:46.809 INFO:teuthology.orchestra.run.smithi124.stdout:(85/144): pcre2-devel-10.32-3.el8.x86_64.rpm 1.9 MB/s | 605 kB 00:00 2023-07-19T20:37:46.836 INFO:teuthology.orchestra.run.smithi124.stdout:(86/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 832 kB/s | 229 kB 00:00 2023-07-19T20:37:46.968 INFO:teuthology.orchestra.run.smithi124.stdout:(87/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 6.0 MB/s | 3.2 MB 00:00 2023-07-19T20:37:46.993 INFO:teuthology.orchestra.run.smithi124.stdout:(88/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2023-07-19T20:37:47.144 INFO:teuthology.orchestra.run.smithi124.stdout:(89/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 806 kB/s | 249 kB 00:00 2023-07-19T20:37:47.202 INFO:teuthology.orchestra.run.smithi124.stdout:(90/144): python3-jwt-1.6.1-2.el8.noarch.rpm 204 kB/s | 43 kB 00:00 2023-07-19T20:37:47.244 INFO:teuthology.orchestra.run.smithi124.stdout:(91/144): python3-cryptography-3.2.1-6.el8.x86_ 2.3 MB/s | 641 kB 00:00 2023-07-19T20:37:47.269 INFO:teuthology.orchestra.run.smithi124.stdout:(92/144): python3-oauthlib-2.1.0-1.el8.noarch.r 1.2 MB/s | 155 kB 00:00 2023-07-19T20:37:47.370 INFO:teuthology.orchestra.run.smithi124.stdout:(93/144): python3-pycparser-2.14-14.el8.noarch. 652 kB/s | 109 kB 00:00 2023-07-19T20:37:47.386 INFO:teuthology.orchestra.run.smithi124.stdout:(94/144): python3-requests-oauthlib-1.0.0-1.el8 300 kB/s | 43 kB 00:00 2023-07-19T20:37:47.412 INFO:teuthology.orchestra.run.smithi124.stdout:(95/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 523 kB/s | 74 kB 00:00 2023-07-19T20:37:47.512 INFO:teuthology.orchestra.run.smithi124.stdout:(96/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 408 kB/s | 58 kB 00:00 2023-07-19T20:37:48.221 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 1.5 MB/s | 16 MB 00:10 2023-07-19T20:37:51.962 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 438 kB/s | 24 kB 00:00 2023-07-19T20:37:55.834 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-19T20:37:55.835 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-19T20:37:55.848 INFO:teuthology.orchestra.run.smithi117.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-19T20:37:55.849 INFO:teuthology.orchestra.run.smithi117.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-19T20:37:55.849 INFO:teuthology.orchestra.run.smithi117.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-19T20:37:55.850 INFO:teuthology.orchestra.run.smithi117.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-19T20:37:55.851 INFO:teuthology.orchestra.run.smithi117.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-19T20:37:55.853 INFO:teuthology.orchestra.run.smithi117.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-19T20:37:55.856 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-19T20:37:55.857 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-19T20:37:56.036 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2023-07-19T20:37:56.049 INFO:teuthology.orchestra.run.smithi117.stdout:==================================================================================================== 2023-07-19T20:37:56.050 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2023-07-19T20:37:56.050 INFO:teuthology.orchestra.run.smithi117.stdout:==================================================================================================== 2023-07-19T20:37:56.050 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2023-07-19T20:37:56.050 INFO:teuthology.orchestra.run.smithi117.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-19T20:37:56.050 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:18.1.2-35.g796ba272.el8 ceph 6.4 k 2023-07-19T20:37:56.051 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:18.1.2-35.g796ba272.el8 ceph 5.4 M 2023-07-19T20:37:56.051 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:18.1.2-35.g796ba272.el8 ceph 847 k 2023-07-19T20:37:56.051 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:18.1.2-35.g796ba272.el8 ceph 165 k 2023-07-19T20:37:56.051 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:18.1.2-35.g796ba272.el8 ceph 1.5 M 2023-07-19T20:37:56.051 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 127 k 2023-07-19T20:37:56.051 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 1.7 M 2023-07-19T20:37:56.051 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 7.4 M 2023-07-19T20:37:56.051 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 47 k 2023-07-19T20:37:56.052 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:18.1.2-35.g796ba272.el8 ceph 13 M 2023-07-19T20:37:56.052 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:18.1.2-35.g796ba272.el8 ceph 47 M 2023-07-19T20:37:56.052 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 264 k 2023-07-19T20:37:56.052 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 162 k 2023-07-19T20:37:56.052 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror x86_64 2:18.1.2-35.g796ba272.el8 ceph 257 k 2023-07-19T20:37:56.052 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 18 k 2023-07-19T20:37:56.052 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-19T20:37:56.053 INFO:teuthology.orchestra.run.smithi117.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-19T20:37:56.053 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-19T20:37:56.053 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:18.1.2-35.g796ba272.el8 ceph 30 k 2023-07-19T20:37:56.053 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:18.1.2-35.g796ba272.el8 ceph 769 k 2023-07-19T20:37:56.053 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:18.1.2-35.g796ba272.el8 ceph 139 k 2023-07-19T20:37:56.053 INFO:teuthology.orchestra.run.smithi117.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-19T20:37:56.053 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-19T20:37:56.053 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-19T20:37:56.054 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-19T20:37:56.054 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-19T20:37:56.054 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-19T20:37:56.054 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:18.1.2-35.g796ba272.el8 ceph 190 k 2023-07-19T20:37:56.054 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:18.1.2-35.g796ba272.el8 ceph 371 k 2023-07-19T20:37:56.054 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:18.1.2-35.g796ba272.el8 ceph 365 k 2023-07-19T20:37:56.054 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:18.1.2-35.g796ba272.el8 ceph 107 k 2023-07-19T20:37:56.055 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:18.1.2-35.g796ba272.el8 ceph 94 k 2023-07-19T20:37:56.055 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:18.1.2-35.g796ba272.el8 ceph 3.4 M 2023-07-19T20:37:56.055 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:18.1.2-35.g796ba272.el8 ceph 179 k 2023-07-19T20:37:56.055 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-19T20:37:56.055 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2023-07-19T20:37:56.055 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-19T20:37:56.055 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-19T20:37:56.055 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-19T20:37:56.056 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-19T20:37:56.056 INFO:teuthology.orchestra.run.smithi117.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-19T20:37:56.056 INFO:teuthology.orchestra.run.smithi117.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-19T20:37:56.056 INFO:teuthology.orchestra.run.smithi117.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-19T20:37:56.056 INFO:teuthology.orchestra.run.smithi117.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-19T20:37:56.056 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:18.1.2-35.g796ba272.el8 ceph 3.7 M 2023-07-19T20:37:56.057 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:18.1.2-35.g796ba272.el8 ceph 3.6 M 2023-07-19T20:37:56.057 INFO:teuthology.orchestra.run.smithi117.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-19T20:37:56.057 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-19T20:37:56.057 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-19T20:37:56.057 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-19T20:37:56.057 INFO:teuthology.orchestra.run.smithi117.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-19T20:37:56.057 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-19T20:37:56.058 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2023-07-19T20:37:56.058 INFO:teuthology.orchestra.run.smithi117.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-19T20:37:56.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:18.1.2-35.g796ba272.el8 ceph 22 M 2023-07-19T20:37:56.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 23 k 2023-07-19T20:37:56.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:18.1.2-35.g796ba272.el8 ceph 2.3 M 2023-07-19T20:37:56.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 240 k 2023-07-19T20:37:56.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:18.1.2-35.g796ba272.el8 ceph 4.6 M 2023-07-19T20:37:56.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:18.1.2-35.g796ba272.el8 ceph 18 M 2023-07-19T20:37:56.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 15 k 2023-07-19T20:37:56.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:18.1.2-35.g796ba272.el8 ceph 24 k 2023-07-19T20:37:56.059 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-19T20:37:56.059 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-19T20:37:56.059 INFO:teuthology.orchestra.run.smithi117.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-19T20:37:56.060 INFO:teuthology.orchestra.run.smithi117.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-19T20:37:56.060 INFO:teuthology.orchestra.run.smithi117.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-19T20:37:56.060 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:18.1.2-35.g796ba272.el8 ceph 138 k 2023-07-19T20:37:56.060 INFO:teuthology.orchestra.run.smithi117.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-19T20:37:56.060 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-19T20:37:56.060 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-19T20:37:56.060 INFO:teuthology.orchestra.run.smithi117.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-19T20:37:56.061 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-19T20:37:56.061 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-19T20:37:56.061 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:18.1.2-35.g796ba272.el8 ceph 475 k 2023-07-19T20:37:56.061 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-19T20:37:56.061 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:18.1.2-35.g796ba272.el8 ceph 6.5 M 2023-07-19T20:37:56.061 INFO:teuthology.orchestra.run.smithi117.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-19T20:37:56.061 INFO:teuthology.orchestra.run.smithi117.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-19T20:37:56.061 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-19T20:37:56.062 INFO:teuthology.orchestra.run.smithi117.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-19T20:37:56.062 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-19T20:37:56.062 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-19T20:37:56.062 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-19T20:37:56.062 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-19T20:37:56.062 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-19T20:37:56.062 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-19T20:37:56.063 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-19T20:37:56.063 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-19T20:37:56.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-19T20:37:56.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-19T20:37:56.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-19T20:37:56.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-19T20:37:56.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-19T20:37:56.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:18.1.2-35.g796ba272.el8 ceph 45 k 2023-07-19T20:37:56.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:18.1.2-35.g796ba272.el8 ceph 119 k 2023-07-19T20:37:56.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-19T20:37:56.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-19T20:37:56.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-19T20:37:56.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-19T20:37:56.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-19T20:37:56.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-19T20:37:56.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-19T20:37:56.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-19T20:37:56.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-19T20:37:56.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-19T20:37:56.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-19T20:37:56.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-19T20:37:56.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-19T20:37:56.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-19T20:37:56.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-19T20:37:56.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-19T20:37:56.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-19T20:37:56.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-19T20:37:56.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-19T20:37:56.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-19T20:37:56.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-19T20:37:56.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-19T20:37:56.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-19T20:37:56.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-19T20:37:56.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-19T20:37:56.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-19T20:37:56.068 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-19T20:37:56.068 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-19T20:37:56.068 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-19T20:37:56.068 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-19T20:37:56.068 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-19T20:37:56.068 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-19T20:37:56.068 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-19T20:37:56.069 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-19T20:37:56.069 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-19T20:37:56.069 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-19T20:37:56.069 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-19T20:37:56.069 INFO:teuthology.orchestra.run.smithi117.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-19T20:37:56.070 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-19T20:37:56.070 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-19T20:37:56.070 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-19T20:37:56.070 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-19T20:37:56.070 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-19T20:37:56.070 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-19T20:37:56.070 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-19T20:37:56.070 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-19T20:37:56.071 INFO:teuthology.orchestra.run.smithi117.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-19T20:37:56.071 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-19T20:37:56.071 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-19T20:37:56.071 INFO:teuthology.orchestra.run.smithi117.stdout:Enabling module streams: 2023-07-19T20:37:56.071 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql 10 2023-07-19T20:37:56.071 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:37:56.071 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2023-07-19T20:37:56.071 INFO:teuthology.orchestra.run.smithi117.stdout:==================================================================================================== 2023-07-19T20:37:56.072 INFO:teuthology.orchestra.run.smithi117.stdout:Install 128 Packages 2023-07-19T20:37:56.072 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 16 Packages 2023-07-19T20:37:56.072 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:37:56.073 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 210 M 2023-07-19T20:37:56.073 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2023-07-19T20:37:56.788 INFO:teuthology.orchestra.run.smithi117.stdout:(1/144): ceph-18.1.2-35.g796ba272.el8.x86_64.rp 25 kB/s | 6.4 kB 00:00 2023-07-19T20:37:57.379 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 836 kB/s | 16 MB 00:19 2023-07-19T20:37:57.473 INFO:teuthology.orchestra.run.smithi117.stdout:(2/144): ceph-fuse-18.1.2-35.g796ba272.el8.x86_ 1.2 MB/s | 847 kB 00:00 2023-07-19T20:37:57.615 INFO:teuthology.orchestra.run.smithi117.stdout:(3/144): ceph-immutable-object-cache-18.1.2-35. 1.1 MB/s | 165 kB 00:00 2023-07-19T20:37:58.697 INFO:teuthology.orchestra.run.smithi117.stdout:(4/144): ceph-mds-18.1.2-35.g796ba272.el8.x86_6 2.1 MB/s | 2.3 MB 00:01 2023-07-19T20:37:59.205 INFO:teuthology.orchestra.run.smithi117.stdout:(5/144): ceph-mgr-18.1.2-35.g796ba272.el8.x86_6 3.0 MB/s | 1.5 MB 00:00 2023-07-19T20:37:59.572 INFO:teuthology.orchestra.run.smithi117.stdout:(6/144): ceph-base-18.1.2-35.g796ba272.el8.x86_ 1.8 MB/s | 5.4 MB 00:03 2023-07-19T20:38:00.089 INFO:teuthology.orchestra.run.smithi117.stdout:(7/144): ceph-mon-18.1.2-35.g796ba272.el8.x86_6 5.2 MB/s | 4.6 MB 00:00 2023-07-19T20:38:01.066 INFO:teuthology.orchestra.run.smithi117.stdout:(8/144): ceph-common-18.1.2-35.g796ba272.el8.x8 4.8 MB/s | 22 MB 00:04 2023-07-19T20:38:01.156 INFO:teuthology.orchestra.run.smithi117.stdout:(9/144): ceph-selinux-18.1.2-35.g796ba272.el8.x 266 kB/s | 24 kB 00:00 2023-07-19T20:38:01.768 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 402 kB/s | 24 kB 00:00 2023-07-19T20:38:02.273 INFO:teuthology.orchestra.run.smithi117.stdout:(10/144): ceph-radosgw-18.1.2-35.g796ba272.el8. 6.0 MB/s | 13 MB 00:02 2023-07-19T20:38:02.365 INFO:teuthology.orchestra.run.smithi117.stdout:(11/144): cephfs-mirror-18.1.2-35.g796ba272.el8 2.8 MB/s | 257 kB 00:00 2023-07-19T20:38:02.480 INFO:teuthology.orchestra.run.smithi117.stdout:(12/144): libcephfs-devel-18.1.2-35.g796ba272.e 282 kB/s | 30 kB 00:00 2023-07-19T20:38:02.657 INFO:teuthology.orchestra.run.smithi117.stdout:(13/144): libcephfs2-18.1.2-35.g796ba272.el8.x8 4.1 MB/s | 769 kB 00:00 2023-07-19T20:38:02.759 INFO:teuthology.orchestra.run.smithi117.stdout:(14/144): libcephsqlite-18.1.2-35.g796ba272.el8 1.3 MB/s | 138 kB 00:00 2023-07-19T20:38:02.841 INFO:teuthology.orchestra.run.smithi117.stdout:(15/144): librados-devel-18.1.2-35.g796ba272.el 1.6 MB/s | 139 kB 00:00 2023-07-19T20:38:03.010 INFO:teuthology.orchestra.run.smithi117.stdout:(16/144): libradosstriper1-18.1.2-35.g796ba272. 2.8 MB/s | 475 kB 00:00 2023-07-19T20:38:04.685 INFO:teuthology.orchestra.run.smithi117.stdout:(17/144): librgw2-18.1.2-35.g796ba272.el8.x86_6 3.9 MB/s | 6.5 MB 00:01 2023-07-19T20:38:04.777 INFO:teuthology.orchestra.run.smithi117.stdout:(18/144): python3-ceph-argparse-18.1.2-35.g796b 488 kB/s | 45 kB 00:00 2023-07-19T20:38:04.889 INFO:teuthology.orchestra.run.smithi117.stdout:(19/144): python3-ceph-common-18.1.2-35.g796ba2 1.1 MB/s | 119 kB 00:00 2023-07-19T20:38:05.061 INFO:teuthology.orchestra.run.smithi117.stdout:(20/144): python3-cephfs-18.1.2-35.g796ba272.el 1.1 MB/s | 190 kB 00:00 2023-07-19T20:38:05.304 INFO:teuthology.orchestra.run.smithi117.stdout:(21/144): python3-rados-18.1.2-35.g796ba272.el8 1.5 MB/s | 371 kB 00:00 2023-07-19T20:38:05.624 INFO:teuthology.orchestra.run.smithi117.stdout:(22/144): python3-rbd-18.1.2-35.g796ba272.el8.x 1.1 MB/s | 365 kB 00:00 2023-07-19T20:38:05.722 INFO:teuthology.orchestra.run.smithi117.stdout:(23/144): python3-rgw-18.1.2-35.g796ba272.el8.x 1.1 MB/s | 107 kB 00:00 2023-07-19T20:38:05.810 INFO:teuthology.orchestra.run.smithi130.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-19T20:38:05.811 INFO:teuthology.orchestra.run.smithi130.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-19T20:38:05.825 INFO:teuthology.orchestra.run.smithi130.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-19T20:38:05.825 INFO:teuthology.orchestra.run.smithi130.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-19T20:38:05.825 INFO:teuthology.orchestra.run.smithi130.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-19T20:38:05.826 INFO:teuthology.orchestra.run.smithi130.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-19T20:38:05.827 INFO:teuthology.orchestra.run.smithi130.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-19T20:38:05.830 INFO:teuthology.orchestra.run.smithi130.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-19T20:38:05.832 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-19T20:38:05.833 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-19T20:38:05.880 INFO:teuthology.orchestra.run.smithi117.stdout:(24/144): rbd-fuse-18.1.2-35.g796ba272.el8.x86_ 595 kB/s | 94 kB 00:00 2023-07-19T20:38:06.019 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-07-19T20:38:06.034 INFO:teuthology.orchestra.run.smithi130.stdout:==================================================================================================== 2023-07-19T20:38:06.034 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-07-19T20:38:06.034 INFO:teuthology.orchestra.run.smithi130.stdout:==================================================================================================== 2023-07-19T20:38:06.034 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-07-19T20:38:06.034 INFO:teuthology.orchestra.run.smithi130.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-19T20:38:06.035 INFO:teuthology.orchestra.run.smithi130.stdout: ceph x86_64 2:18.1.2-35.g796ba272.el8 ceph 6.4 k 2023-07-19T20:38:06.035 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base x86_64 2:18.1.2-35.g796ba272.el8 ceph 5.4 M 2023-07-19T20:38:06.035 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse x86_64 2:18.1.2-35.g796ba272.el8 ceph 847 k 2023-07-19T20:38:06.035 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache x86_64 2:18.1.2-35.g796ba272.el8 ceph 165 k 2023-07-19T20:38:06.035 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr x86_64 2:18.1.2-35.g796ba272.el8 ceph 1.5 M 2023-07-19T20:38:06.035 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 127 k 2023-07-19T20:38:06.036 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 1.7 M 2023-07-19T20:38:06.036 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 7.4 M 2023-07-19T20:38:06.036 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 47 k 2023-07-19T20:38:06.036 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw x86_64 2:18.1.2-35.g796ba272.el8 ceph 13 M 2023-07-19T20:38:06.036 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test x86_64 2:18.1.2-35.g796ba272.el8 ceph 47 M 2023-07-19T20:38:06.036 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 264 k 2023-07-19T20:38:06.037 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 162 k 2023-07-19T20:38:06.037 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror x86_64 2:18.1.2-35.g796ba272.el8 ceph 257 k 2023-07-19T20:38:06.037 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 18 k 2023-07-19T20:38:06.037 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-19T20:38:06.037 INFO:teuthology.orchestra.run.smithi130.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-19T20:38:06.038 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-19T20:38:06.038 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel x86_64 2:18.1.2-35.g796ba272.el8 ceph 30 k 2023-07-19T20:38:06.038 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2 x86_64 2:18.1.2-35.g796ba272.el8 ceph 769 k 2023-07-19T20:38:06.038 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel x86_64 2:18.1.2-35.g796ba272.el8 ceph 139 k 2023-07-19T20:38:06.038 INFO:teuthology.orchestra.run.smithi130.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-19T20:38:06.038 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-19T20:38:06.038 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-19T20:38:06.039 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-19T20:38:06.039 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-19T20:38:06.039 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-19T20:38:06.039 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs x86_64 2:18.1.2-35.g796ba272.el8 ceph 190 k 2023-07-19T20:38:06.039 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados x86_64 2:18.1.2-35.g796ba272.el8 ceph 371 k 2023-07-19T20:38:06.039 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd x86_64 2:18.1.2-35.g796ba272.el8 ceph 365 k 2023-07-19T20:38:06.039 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw x86_64 2:18.1.2-35.g796ba272.el8 ceph 107 k 2023-07-19T20:38:06.040 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse x86_64 2:18.1.2-35.g796ba272.el8 ceph 94 k 2023-07-19T20:38:06.040 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror x86_64 2:18.1.2-35.g796ba272.el8 ceph 3.4 M 2023-07-19T20:38:06.040 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd x86_64 2:18.1.2-35.g796ba272.el8 ceph 179 k 2023-07-19T20:38:06.040 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-19T20:38:06.040 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2023-07-19T20:38:06.040 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-19T20:38:06.041 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-19T20:38:06.041 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-19T20:38:06.041 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-19T20:38:06.041 INFO:teuthology.orchestra.run.smithi130.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-19T20:38:06.041 INFO:teuthology.orchestra.run.smithi130.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-19T20:38:06.041 INFO:teuthology.orchestra.run.smithi130.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-19T20:38:06.041 INFO:teuthology.orchestra.run.smithi130.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-19T20:38:06.041 INFO:teuthology.orchestra.run.smithi130.stdout: librados2 x86_64 2:18.1.2-35.g796ba272.el8 ceph 3.7 M 2023-07-19T20:38:06.042 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1 x86_64 2:18.1.2-35.g796ba272.el8 ceph 3.6 M 2023-07-19T20:38:06.042 INFO:teuthology.orchestra.run.smithi130.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-19T20:38:06.042 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-19T20:38:06.042 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-19T20:38:06.042 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-19T20:38:06.042 INFO:teuthology.orchestra.run.smithi130.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-19T20:38:06.042 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-19T20:38:06.043 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-07-19T20:38:06.043 INFO:teuthology.orchestra.run.smithi130.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-19T20:38:06.043 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common x86_64 2:18.1.2-35.g796ba272.el8 ceph 22 M 2023-07-19T20:38:06.043 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 23 k 2023-07-19T20:38:06.043 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds x86_64 2:18.1.2-35.g796ba272.el8 ceph 2.3 M 2023-07-19T20:38:06.043 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 240 k 2023-07-19T20:38:06.043 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon x86_64 2:18.1.2-35.g796ba272.el8 ceph 4.6 M 2023-07-19T20:38:06.044 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd x86_64 2:18.1.2-35.g796ba272.el8 ceph 18 M 2023-07-19T20:38:06.044 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts noarch 2:18.1.2-35.g796ba272.el8 ceph-noarch 15 k 2023-07-19T20:38:06.044 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux x86_64 2:18.1.2-35.g796ba272.el8 ceph 24 k 2023-07-19T20:38:06.044 INFO:teuthology.orchestra.run.smithi130.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-19T20:38:06.044 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-19T20:38:06.044 INFO:teuthology.orchestra.run.smithi130.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-19T20:38:06.045 INFO:teuthology.orchestra.run.smithi130.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-19T20:38:06.045 INFO:teuthology.orchestra.run.smithi130.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-19T20:38:06.045 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite x86_64 2:18.1.2-35.g796ba272.el8 ceph 138 k 2023-07-19T20:38:06.045 INFO:teuthology.orchestra.run.smithi130.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-19T20:38:06.045 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-19T20:38:06.045 INFO:teuthology.orchestra.run.smithi130.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-19T20:38:06.045 INFO:teuthology.orchestra.run.smithi130.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-19T20:38:06.045 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-19T20:38:06.046 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-19T20:38:06.046 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 x86_64 2:18.1.2-35.g796ba272.el8 ceph 475 k 2023-07-19T20:38:06.046 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-19T20:38:06.046 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2 x86_64 2:18.1.2-35.g796ba272.el8 ceph 6.5 M 2023-07-19T20:38:06.046 INFO:teuthology.orchestra.run.smithi130.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-19T20:38:06.046 INFO:teuthology.orchestra.run.smithi130.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-19T20:38:06.046 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-19T20:38:06.047 INFO:teuthology.orchestra.run.smithi130.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-19T20:38:06.047 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-19T20:38:06.047 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-19T20:38:06.047 INFO:teuthology.orchestra.run.smithi130.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-19T20:38:06.047 INFO:teuthology.orchestra.run.smithi130.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-19T20:38:06.047 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-19T20:38:06.047 INFO:teuthology.orchestra.run.smithi130.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-19T20:38:06.048 INFO:teuthology.orchestra.run.smithi130.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-19T20:38:06.048 INFO:teuthology.orchestra.run.smithi130.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-19T20:38:06.048 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-19T20:38:06.048 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-19T20:38:06.048 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-19T20:38:06.049 INFO:teuthology.orchestra.run.smithi130.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-19T20:38:06.049 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-19T20:38:06.049 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse x86_64 2:18.1.2-35.g796ba272.el8 ceph 45 k 2023-07-19T20:38:06.049 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common x86_64 2:18.1.2-35.g796ba272.el8 ceph 119 k 2023-07-19T20:38:06.049 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-19T20:38:06.049 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-19T20:38:06.049 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-19T20:38:06.049 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-19T20:38:06.050 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-19T20:38:06.050 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-19T20:38:06.050 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-19T20:38:06.050 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-19T20:38:06.050 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-19T20:38:06.050 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-19T20:38:06.050 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-19T20:38:06.051 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-19T20:38:06.051 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-19T20:38:06.051 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-19T20:38:06.051 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-19T20:38:06.051 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-19T20:38:06.052 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-19T20:38:06.052 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-19T20:38:06.052 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-19T20:38:06.052 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-19T20:38:06.052 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-19T20:38:06.053 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-19T20:38:06.053 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-19T20:38:06.053 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-19T20:38:06.053 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-19T20:38:06.053 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-19T20:38:06.053 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-19T20:38:06.053 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-19T20:38:06.054 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-19T20:38:06.054 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-19T20:38:06.054 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-19T20:38:06.054 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-19T20:38:06.054 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-19T20:38:06.054 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-19T20:38:06.054 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-19T20:38:06.055 INFO:teuthology.orchestra.run.smithi130.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-19T20:38:06.055 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-19T20:38:06.055 INFO:teuthology.orchestra.run.smithi130.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-19T20:38:06.055 INFO:teuthology.orchestra.run.smithi130.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-19T20:38:06.055 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-19T20:38:06.055 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-19T20:38:06.055 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-19T20:38:06.055 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-19T20:38:06.056 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-19T20:38:06.056 INFO:teuthology.orchestra.run.smithi130.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-19T20:38:06.056 INFO:teuthology.orchestra.run.smithi130.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-19T20:38:06.056 INFO:teuthology.orchestra.run.smithi130.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-19T20:38:06.056 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-19T20:38:06.056 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-19T20:38:06.057 INFO:teuthology.orchestra.run.smithi130.stdout:Enabling module streams: 2023-07-19T20:38:06.057 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql 10 2023-07-19T20:38:06.057 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:38:06.058 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-07-19T20:38:06.058 INFO:teuthology.orchestra.run.smithi130.stdout:==================================================================================================== 2023-07-19T20:38:06.058 INFO:teuthology.orchestra.run.smithi130.stdout:Install 128 Packages 2023-07-19T20:38:06.058 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 16 Packages 2023-07-19T20:38:06.058 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:38:06.059 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 210 M 2023-07-19T20:38:06.059 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-07-19T20:38:07.220 INFO:teuthology.orchestra.run.smithi130.stdout:(1/144): ceph-18.1.2-35.g796ba272.el8.x86_64.rp 11 kB/s | 6.4 kB 00:00 2023-07-19T20:38:08.328 INFO:teuthology.orchestra.run.smithi117.stdout:(25/144): ceph-test-18.1.2-35.g796ba272.el8.x86 6.5 MB/s | 47 MB 00:07 2023-07-19T20:38:08.812 INFO:teuthology.orchestra.run.smithi117.stdout:(26/144): rbd-nbd-18.1.2-35.g796ba272.el8.x86_6 371 kB/s | 179 kB 00:00 2023-07-19T20:38:08.987 INFO:teuthology.orchestra.run.smithi117.stdout:(27/144): ceph-grafana-dashboards-18.1.2-35.g79 132 kB/s | 23 kB 00:00 2023-07-19T20:38:09.412 INFO:teuthology.orchestra.run.smithi117.stdout:(28/144): ceph-mgr-cephadm-18.1.2-35.g796ba272. 299 kB/s | 127 kB 00:00 2023-07-19T20:38:11.686 INFO:teuthology.orchestra.run.smithi130.stdout:(2/144): ceph-fuse-18.1.2-35.g796ba272.el8.x86_ 190 kB/s | 847 kB 00:04 2023-07-19T20:38:12.061 INFO:teuthology.orchestra.run.smithi130.stdout:(3/144): ceph-immutable-object-cache-18.1.2-35. 441 kB/s | 165 kB 00:00 2023-07-19T20:38:13.145 INFO:teuthology.orchestra.run.smithi117.stdout:(29/144): rbd-mirror-18.1.2-35.g796ba272.el8.x8 486 kB/s | 3.4 MB 00:07 2023-07-19T20:38:13.270 INFO:teuthology.orchestra.run.smithi117.stdout:(30/144): ceph-mgr-dashboard-18.1.2-35.g796ba27 450 kB/s | 1.7 MB 00:03 2023-07-19T20:38:13.638 INFO:teuthology.orchestra.run.smithi117.stdout:(31/144): ceph-mgr-modules-core-18.1.2-35.g796b 655 kB/s | 240 kB 00:00 2023-07-19T20:38:13.738 INFO:teuthology.orchestra.run.smithi117.stdout:(32/144): ceph-mgr-rook-18.1.2-35.g796ba272.el8 475 kB/s | 47 kB 00:00 2023-07-19T20:38:13.829 INFO:teuthology.orchestra.run.smithi117.stdout:(33/144): ceph-prometheus-alerts-18.1.2-35.g796 158 kB/s | 15 kB 00:00 2023-07-19T20:38:14.263 INFO:teuthology.orchestra.run.smithi117.stdout:(34/144): ceph-volume-18.1.2-35.g796ba272.el8.n 609 kB/s | 264 kB 00:00 2023-07-19T20:38:14.580 INFO:teuthology.orchestra.run.smithi117.stdout:(35/144): cephadm-18.1.2-35.g796ba272.el8.noarc 512 kB/s | 162 kB 00:00 2023-07-19T20:38:14.680 INFO:teuthology.orchestra.run.smithi117.stdout:(36/144): cephfs-top-18.1.2-35.g796ba272.el8.no 179 kB/s | 18 kB 00:00 2023-07-19T20:38:14.853 INFO:teuthology.orchestra.run.smithi130.stdout:(4/144): ceph-base-18.1.2-35.g796ba272.el8.x86_ 670 kB/s | 5.4 MB 00:08 2023-07-19T20:38:15.289 INFO:teuthology.orchestra.run.smithi130.stdout:(5/144): ceph-mds-18.1.2-35.g796ba272.el8.x86_6 723 kB/s | 2.3 MB 00:03 2023-07-19T20:38:15.581 INFO:teuthology.orchestra.run.smithi117.stdout:(37/144): automake-1.16.1-7.el8.noarch.rpm 793 kB/s | 713 kB 00:00 2023-07-19T20:38:15.740 INFO:teuthology.orchestra.run.smithi117.stdout:(38/144): bison-3.0.4-10.el8.x86_64.rpm 4.3 MB/s | 688 kB 00:00 2023-07-19T20:38:15.839 INFO:teuthology.orchestra.run.smithi117.stdout:(39/144): flex-2.6.1-9.el8.x86_64.rpm 3.1 MB/s | 320 kB 00:00 2023-07-19T20:38:15.924 INFO:teuthology.orchestra.run.smithi117.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 2.4 MB/s | 202 kB 00:00 2023-07-19T20:38:16.037 INFO:teuthology.orchestra.run.smithi117.stdout:(41/144): libpq-13.5-1.el8.x86_64.rpm 1.7 MB/s | 198 kB 00:00 2023-07-19T20:38:16.123 INFO:teuthology.orchestra.run.smithi117.stdout:(42/144): librdkafka-0.11.4-3.el8.x86_64.rpm 3.9 MB/s | 354 kB 00:00 2023-07-19T20:38:16.195 INFO:teuthology.orchestra.run.smithi130.stdout:(6/144): ceph-mgr-18.1.2-35.g796ba272.el8.x86_6 1.2 MB/s | 1.5 MB 00:01 2023-07-19T20:38:16.282 INFO:teuthology.orchestra.run.smithi117.stdout:(43/144): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2023-07-19T20:38:16.366 INFO:teuthology.orchestra.run.smithi117.stdout:(44/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.0 MB/s | 259 kB 00:00 2023-07-19T20:38:16.458 INFO:teuthology.orchestra.run.smithi117.stdout:(45/144): oniguruma-6.8.2-2.el8.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2023-07-19T20:38:17.375 INFO:teuthology.orchestra.run.smithi117.stdout:(46/144): openblas-0.3.15-4.el8.x86_64.rpm 5.2 MB/s | 4.7 MB 00:00 2023-07-19T20:38:19.491 INFO:teuthology.orchestra.run.smithi117.stdout:(47/144): openblas-threads-0.3.15-4.el8.x86_64. 2.3 MB/s | 4.9 MB 00:02 2023-07-19T20:38:20.269 INFO:teuthology.orchestra.run.smithi130.stdout:(7/144): ceph-mon-18.1.2-35.g796ba272.el8.x86_6 948 kB/s | 4.6 MB 00:04 2023-07-19T20:38:20.348 INFO:teuthology.orchestra.run.smithi117.stdout:(48/144): postgresql-10.23-1.module_el8+300+2c5 1.9 MB/s | 1.6 MB 00:00 2023-07-19T20:38:20.775 INFO:teuthology.orchestra.run.smithi117.stdout:(49/144): postgresql-contrib-10.23-1.module_el8 2.0 MB/s | 903 kB 00:00 2023-07-19T20:38:21.400 INFO:teuthology.orchestra.run.smithi117.stdout:(50/144): ceph-osd-18.1.2-35.g796ba272.el8.x86_ 830 kB/s | 18 MB 00:21 2023-07-19T20:38:22.175 INFO:teuthology.orchestra.run.smithi117.stdout:(51/144): python3-babel-2.5.1-7.el8.noarch.rpm 6.2 MB/s | 4.8 MB 00:00 2023-07-19T20:38:22.259 INFO:teuthology.orchestra.run.smithi117.stdout:(52/144): ceph-mgr-diskprediction-local-18.1.2- 833 kB/s | 7.4 MB 00:09 2023-07-19T20:38:22.284 INFO:teuthology.orchestra.run.smithi117.stdout:(53/144): python3-jinja2-2.10.1-3.el8.noarch.rp 4.8 MB/s | 538 kB 00:00 2023-07-19T20:38:22.384 INFO:teuthology.orchestra.run.smithi117.stdout:(54/144): python3-jsonpointer-1.10-11.el8.noarc 200 kB/s | 20 kB 00:00 2023-07-19T20:38:22.477 INFO:teuthology.orchestra.run.smithi117.stdout:(55/144): python3-mako-1.0.6-14.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2023-07-19T20:38:22.501 INFO:teuthology.orchestra.run.smithi117.stdout:(56/144): python3-jsonpatch-1.21-2.el8.noarch.r 110 kB/s | 27 kB 00:00 2023-07-19T20:38:22.568 INFO:teuthology.orchestra.run.smithi117.stdout:(57/144): python3-markupsafe-0.23-19.el8.x86_64 422 kB/s | 39 kB 00:00 2023-07-19T20:38:22.660 INFO:teuthology.orchestra.run.smithi117.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.4 MB/s | 225 kB 00:00 2023-07-19T20:38:22.752 INFO:teuthology.orchestra.run.smithi117.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 479 kB/s | 44 kB 00:00 2023-07-19T20:38:22.854 INFO:teuthology.orchestra.run.smithi117.stdout:(60/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2023-07-19T20:38:22.937 INFO:teuthology.orchestra.run.smithi117.stdout:(61/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.5 MB/s | 126 kB 00:00 2023-07-19T20:38:23.070 INFO:teuthology.orchestra.run.smithi117.stdout:(62/144): python3-numpy-1.14.3-10.el8.x86_64.rp 6.6 MB/s | 3.7 MB 00:00 2023-07-19T20:38:23.095 INFO:teuthology.orchestra.run.smithi117.stdout:(63/144): python3-pyasn1-modules-0.3.7-6.el8.no 694 kB/s | 110 kB 00:00 2023-07-19T20:38:23.170 INFO:teuthology.orchestra.run.smithi117.stdout:(64/144): python3-pytz-2017.2-9.el8.noarch.rpm 540 kB/s | 54 kB 00:00 2023-07-19T20:38:23.421 INFO:teuthology.orchestra.run.smithi117.stdout:(65/144): postgresql-server-10.23-1.module_el8+ 1.9 MB/s | 5.1 MB 00:02 2023-07-19T20:38:23.663 INFO:teuthology.orchestra.run.smithi117.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 1.3 MB/s | 323 kB 00:00 2023-07-19T20:38:23.689 INFO:teuthology.orchestra.run.smithi117.stdout:(67/144): python3-werkzeug-0.12.2-4.el8.noarch. 884 kB/s | 457 kB 00:00 2023-07-19T20:38:24.263 INFO:teuthology.orchestra.run.smithi117.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 123 kB/s | 71 kB 00:00 2023-07-19T20:38:24.288 INFO:teuthology.orchestra.run.smithi117.stdout:(69/144): uuid-1.6.2-43.el8.x86_64.rpm 102 kB/s | 64 kB 00:00 2023-07-19T20:38:24.764 INFO:teuthology.orchestra.run.smithi117.stdout:(70/144): fuse-2.9.7-17.el8.x86_64.rpm 175 kB/s | 83 kB 00:00 2023-07-19T20:38:24.931 INFO:teuthology.orchestra.run.smithi117.stdout:(71/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 288 kB/s | 48 kB 00:00 2023-07-19T20:38:25.299 INFO:teuthology.orchestra.run.smithi117.stdout:(72/144): python3-scipy-1.0.0-21.module_el8.5.0 6.2 MB/s | 14 MB 00:02 2023-07-19T20:38:25.639 INFO:teuthology.orchestra.run.smithi117.stdout:(73/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 791 kB/s | 561 kB 00:00 2023-07-19T20:38:25.657 INFO:teuthology.orchestra.run.smithi117.stdout:(74/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 52 kB/s | 19 kB 00:00 2023-07-19T20:38:25.790 INFO:teuthology.orchestra.run.smithi117.stdout:(75/144): libcom_err-devel-1.45.6-5.el8.x86_64. 258 kB/s | 39 kB 00:00 2023-07-19T20:38:25.807 INFO:teuthology.orchestra.run.smithi117.stdout:(76/144): elfutils-libelf-devel-0.189-2.el8.x86 40 kB/s | 61 kB 00:01 2023-07-19T20:38:25.957 INFO:teuthology.orchestra.run.smithi117.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 313 kB/s | 47 kB 00:00 2023-07-19T20:38:26.140 INFO:teuthology.orchestra.run.smithi117.stdout:(78/144): libquadmath-8.5.0-20.el8.x86_64.rpm 492 kB/s | 172 kB 00:00 2023-07-19T20:38:26.166 INFO:teuthology.orchestra.run.smithi117.stdout:(79/144): libselinux-devel-2.9-8.el8.x86_64.rpm 960 kB/s | 200 kB 00:00 2023-07-19T20:38:26.462 INFO:teuthology.orchestra.run.smithi117.stdout:(80/144): libsepol-devel-2.9-3.el8.x86_64.rpm 271 kB/s | 87 kB 00:00 2023-07-19T20:38:26.483 INFO:teuthology.orchestra.run.smithi117.stdout:(81/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 313 kB/s | 99 kB 00:00 2023-07-19T20:38:26.517 INFO:teuthology.orchestra.run.smithi117.stdout:(82/144): libgfortran-8.5.0-20.el8.x86_64.rpm 750 kB/s | 645 kB 00:00 2023-07-19T20:38:26.567 INFO:teuthology.orchestra.run.smithi117.stdout:(83/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 172 kB/s | 18 kB 00:00 2023-07-19T20:38:26.602 INFO:teuthology.orchestra.run.smithi117.stdout:(84/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 374 kB/s | 44 kB 00:00 2023-07-19T20:38:26.843 INFO:teuthology.orchestra.run.smithi117.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 948 kB/s | 229 kB 00:00 2023-07-19T20:38:26.918 INFO:teuthology.orchestra.run.smithi117.stdout:(86/144): pcre2-devel-10.32-3.el8.x86_64.rpm 1.7 MB/s | 605 kB 00:00 2023-07-19T20:38:26.976 INFO:teuthology.orchestra.run.smithi117.stdout:(87/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 6.9 MB/s | 3.2 MB 00:00 2023-07-19T20:38:27.060 INFO:teuthology.orchestra.run.smithi117.stdout:(88/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2023-07-19T20:38:27.085 INFO:teuthology.orchestra.run.smithi117.stdout:(89/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 249 kB 00:00 2023-07-19T20:38:27.119 INFO:teuthology.orchestra.run.smithi117.stdout:(90/144): python3-cryptography-3.2.1-6.el8.x86_ 4.4 MB/s | 641 kB 00:00 2023-07-19T20:38:27.236 INFO:teuthology.orchestra.run.smithi117.stdout:(91/144): python3-jwt-1.6.1-2.el8.noarch.rpm 284 kB/s | 43 kB 00:00 2023-07-19T20:38:27.261 INFO:teuthology.orchestra.run.smithi117.stdout:(92/144): python3-pycparser-2.14-14.el8.noarch. 769 kB/s | 109 kB 00:00 2023-07-19T20:38:27.286 INFO:teuthology.orchestra.run.smithi117.stdout:(93/144): python3-oauthlib-2.1.0-1.el8.noarch.r 773 kB/s | 155 kB 00:00 2023-07-19T20:38:27.353 INFO:teuthology.orchestra.run.smithi117.stdout:(94/144): python3-requests-oauthlib-1.0.0-1.el8 364 kB/s | 43 kB 00:00 2023-07-19T20:38:27.370 INFO:teuthology.orchestra.run.smithi117.stdout:(95/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 685 kB/s | 74 kB 00:00 2023-07-19T20:38:27.429 INFO:teuthology.orchestra.run.smithi117.stdout:(96/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 408 kB/s | 58 kB 00:00 2023-07-19T20:38:32.393 INFO:teuthology.orchestra.run.smithi130.stdout:(8/144): ceph-osd-18.1.2-35.g796ba272.el8.x86_6 1.1 MB/s | 18 MB 00:16 2023-07-19T20:38:32.459 INFO:teuthology.orchestra.run.smithi130.stdout:(9/144): ceph-selinux-18.1.2-35.g796ba272.el8.x 368 kB/s | 24 kB 00:00 2023-07-19T20:38:32.819 INFO:teuthology.orchestra.run.smithi130.stdout:(10/144): ceph-radosgw-18.1.2-35.g796ba272.el8. 1.0 MB/s | 13 MB 00:12 2023-07-19T20:38:33.110 INFO:teuthology.orchestra.run.smithi130.stdout:(11/144): cephfs-mirror-18.1.2-35.g796ba272.el8 883 kB/s | 257 kB 00:00 2023-07-19T20:38:33.194 INFO:teuthology.orchestra.run.smithi130.stdout:(12/144): libcephfs-devel-18.1.2-35.g796ba272.e 366 kB/s | 30 kB 00:00 2023-07-19T20:38:33.986 INFO:teuthology.orchestra.run.smithi130.stdout:(13/144): libcephfs2-18.1.2-35.g796ba272.el8.x8 972 kB/s | 769 kB 00:00 2023-07-19T20:38:34.170 INFO:teuthology.orchestra.run.smithi130.stdout:(14/144): libcephsqlite-18.1.2-35.g796ba272.el8 751 kB/s | 138 kB 00:00 2023-07-19T20:38:34.311 INFO:teuthology.orchestra.run.smithi130.stdout:(15/144): librados-devel-18.1.2-35.g796ba272.el 984 kB/s | 139 kB 00:00 2023-07-19T20:38:34.712 INFO:teuthology.orchestra.run.smithi130.stdout:(16/144): libradosstriper1-18.1.2-35.g796ba272. 1.2 MB/s | 475 kB 00:00 2023-07-19T20:38:35.362 INFO:teuthology.orchestra.run.smithi130.stdout:(17/144): ceph-common-18.1.2-35.g796ba272.el8.x 768 kB/s | 22 MB 00:28 2023-07-19T20:38:35.529 INFO:teuthology.orchestra.run.smithi130.stdout:(18/144): python3-ceph-argparse-18.1.2-35.g796b 268 kB/s | 45 kB 00:00 2023-07-19T20:38:35.681 INFO:teuthology.orchestra.run.smithi130.stdout:(19/144): python3-ceph-common-18.1.2-35.g796ba2 791 kB/s | 119 kB 00:00 2023-07-19T20:38:35.896 INFO:teuthology.orchestra.run.smithi130.stdout:(20/144): python3-cephfs-18.1.2-35.g796ba272.el 879 kB/s | 190 kB 00:00 2023-07-19T20:38:36.313 INFO:teuthology.orchestra.run.smithi130.stdout:(21/144): python3-rados-18.1.2-35.g796ba272.el8 890 kB/s | 371 kB 00:00 2023-07-19T20:38:36.680 INFO:teuthology.orchestra.run.smithi130.stdout:(22/144): python3-rbd-18.1.2-35.g796ba272.el8.x 997 kB/s | 365 kB 00:00 2023-07-19T20:38:36.839 INFO:teuthology.orchestra.run.smithi130.stdout:(23/144): python3-rgw-18.1.2-35.g796ba272.el8.x 674 kB/s | 107 kB 00:00 2023-07-19T20:38:37.014 INFO:teuthology.orchestra.run.smithi130.stdout:(24/144): rbd-fuse-18.1.2-35.g796ba272.el8.x86_ 539 kB/s | 94 kB 00:00 2023-07-19T20:38:39.372 INFO:teuthology.orchestra.run.smithi130.stdout:(25/144): librgw2-18.1.2-35.g796ba272.el8.x86_6 1.4 MB/s | 6.5 MB 00:04 2023-07-19T20:38:39.498 INFO:teuthology.orchestra.run.smithi130.stdout:(26/144): rbd-nbd-18.1.2-35.g796ba272.el8.x86_6 1.4 MB/s | 179 kB 00:00 2023-07-19T20:38:39.566 INFO:teuthology.orchestra.run.smithi130.stdout:(27/144): ceph-grafana-dashboards-18.1.2-35.g79 347 kB/s | 23 kB 00:00 2023-07-19T20:38:39.674 INFO:teuthology.orchestra.run.smithi130.stdout:(28/144): rbd-mirror-18.1.2-35.g796ba272.el8.x8 1.3 MB/s | 3.4 MB 00:02 2023-07-19T20:38:39.725 INFO:teuthology.orchestra.run.smithi130.stdout:(29/144): ceph-mgr-cephadm-18.1.2-35.g796ba272. 848 kB/s | 127 kB 00:00 2023-07-19T20:38:40.507 INFO:teuthology.orchestra.run.smithi130.stdout:(30/144): ceph-mgr-dashboard-18.1.2-35.g796ba27 2.0 MB/s | 1.7 MB 00:00 2023-07-19T20:38:40.691 INFO:teuthology.orchestra.run.smithi130.stdout:(31/144): ceph-mgr-modules-core-18.1.2-35.g796b 1.3 MB/s | 240 kB 00:00 2023-07-19T20:38:40.749 INFO:teuthology.orchestra.run.smithi130.stdout:(32/144): ceph-mgr-rook-18.1.2-35.g796ba272.el8 819 kB/s | 47 kB 00:00 2023-07-19T20:38:40.817 INFO:teuthology.orchestra.run.smithi130.stdout:(33/144): ceph-prometheus-alerts-18.1.2-35.g796 218 kB/s | 15 kB 00:00 2023-07-19T20:38:41.008 INFO:teuthology.orchestra.run.smithi130.stdout:(34/144): ceph-volume-18.1.2-35.g796ba272.el8.n 1.3 MB/s | 264 kB 00:00 2023-07-19T20:38:41.150 INFO:teuthology.orchestra.run.smithi130.stdout:(35/144): cephadm-18.1.2-35.g796ba272.el8.noarc 1.1 MB/s | 162 kB 00:00 2023-07-19T20:38:41.243 INFO:teuthology.orchestra.run.smithi130.stdout:(36/144): cephfs-top-18.1.2-35.g796ba272.el8.no 197 kB/s | 18 kB 00:00 2023-07-19T20:38:41.717 INFO:teuthology.orchestra.run.smithi130.stdout:(37/144): automake-1.16.1-7.el8.noarch.rpm 1.5 MB/s | 713 kB 00:00 2023-07-19T20:38:41.814 INFO:teuthology.orchestra.run.smithi130.stdout:(38/144): bison-3.0.4-10.el8.x86_64.rpm 7.4 MB/s | 688 kB 00:00 2023-07-19T20:38:41.903 INFO:teuthology.orchestra.run.smithi130.stdout:(39/144): flex-2.6.1-9.el8.x86_64.rpm 3.4 MB/s | 320 kB 00:00 2023-07-19T20:38:41.985 INFO:teuthology.orchestra.run.smithi130.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 2.4 MB/s | 202 kB 00:00 2023-07-19T20:38:42.060 INFO:teuthology.orchestra.run.smithi130.stdout:(41/144): libpq-13.5-1.el8.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2023-07-19T20:38:42.162 INFO:teuthology.orchestra.run.smithi130.stdout:(42/144): librdkafka-0.11.4-3.el8.x86_64.rpm 3.5 MB/s | 354 kB 00:00 2023-07-19T20:38:42.271 INFO:teuthology.orchestra.run.smithi130.stdout:(43/144): libtool-2.4.6-25.el8.x86_64.rpm 6.4 MB/s | 709 kB 00:00 2023-07-19T20:38:42.362 INFO:teuthology.orchestra.run.smithi130.stdout:(44/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2023-07-19T20:38:42.457 INFO:teuthology.orchestra.run.smithi130.stdout:(45/144): oniguruma-6.8.2-2.el8.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2023-07-19T20:38:42.845 INFO:teuthology.orchestra.run.smithi130.stdout:(46/144): openblas-0.3.15-4.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-07-19T20:38:42.954 INFO:teuthology.orchestra.run.smithi130.stdout:(47/144): ceph-mgr-diskprediction-local-18.1.2- 2.3 MB/s | 7.4 MB 00:03 2023-07-19T20:38:43.530 INFO:teuthology.orchestra.run.smithi130.stdout:(48/144): openblas-threads-0.3.15-4.el8.x86_64. 7.1 MB/s | 4.9 MB 00:00 2023-07-19T20:38:43.880 INFO:teuthology.orchestra.run.smithi130.stdout:(49/144): postgresql-contrib-10.23-1.module_el8 2.5 MB/s | 903 kB 00:00 2023-07-19T20:38:44.764 INFO:teuthology.orchestra.run.smithi130.stdout:(50/144): postgresql-server-10.23-1.module_el8+ 5.8 MB/s | 5.1 MB 00:00 2023-07-19T20:38:45.189 INFO:teuthology.orchestra.run.smithi130.stdout:(51/144): postgresql-10.23-1.module_el8+300+2c5 716 kB/s | 1.6 MB 00:02 2023-07-19T20:38:45.872 INFO:teuthology.orchestra.run.smithi130.stdout:(52/144): python3-babel-2.5.1-7.el8.noarch.rpm 4.3 MB/s | 4.8 MB 00:01 2023-07-19T20:38:45.972 INFO:teuthology.orchestra.run.smithi130.stdout:(53/144): python3-jsonpatch-1.21-2.el8.noarch.r 267 kB/s | 27 kB 00:00 2023-07-19T20:38:46.064 INFO:teuthology.orchestra.run.smithi130.stdout:(54/144): python3-jsonpointer-1.10-11.el8.noarc 218 kB/s | 20 kB 00:00 2023-07-19T20:38:46.156 INFO:teuthology.orchestra.run.smithi130.stdout:(55/144): python3-mako-1.0.6-14.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2023-07-19T20:38:46.256 INFO:teuthology.orchestra.run.smithi130.stdout:(56/144): python3-markupsafe-0.23-19.el8.x86_64 388 kB/s | 39 kB 00:00 2023-07-19T20:38:46.365 INFO:teuthology.orchestra.run.smithi130.stdout:(57/144): python3-jinja2-2.10.1-3.el8.noarch.rp 457 kB/s | 538 kB 00:01 2023-07-19T20:38:46.941 INFO:teuthology.orchestra.run.smithi130.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 392 kB/s | 225 kB 00:00 2023-07-19T20:38:47.074 INFO:teuthology.orchestra.run.smithi130.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 329 kB/s | 44 kB 00:00 2023-07-19T20:38:47.374 INFO:teuthology.orchestra.run.smithi130.stdout:(60/144): python3-numpy-1.14.3-10.el8.x86_64.rp 3.3 MB/s | 3.7 MB 00:01 2023-07-19T20:38:47.392 INFO:teuthology.orchestra.run.smithi130.stdout:(61/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 327 kB/s | 103 kB 00:00 2023-07-19T20:38:47.458 INFO:teuthology.orchestra.run.smithi130.stdout:(62/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.5 MB/s | 126 kB 00:00 2023-07-19T20:38:47.525 INFO:teuthology.orchestra.run.smithi130.stdout:(63/144): python3-pytz-2017.2-9.el8.noarch.rpm 814 kB/s | 54 kB 00:00 2023-07-19T20:38:47.676 INFO:teuthology.orchestra.run.smithi130.stdout:(64/144): python3-pyasn1-modules-0.3.7-6.el8.no 388 kB/s | 110 kB 00:00 2023-07-19T20:38:48.501 INFO:teuthology.orchestra.run.smithi130.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 555 kB/s | 457 kB 00:00 2023-07-19T20:38:49.034 INFO:teuthology.orchestra.run.smithi130.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 606 kB/s | 323 kB 00:00 2023-07-19T20:38:49.179 INFO:teuthology.orchestra.run.smithi130.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 452 kB/s | 64 kB 00:00 2023-07-19T20:38:49.360 INFO:teuthology.orchestra.run.smithi130.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 385 kB/s | 71 kB 00:00 2023-07-19T20:38:49.835 INFO:teuthology.orchestra.run.smithi130.stdout:(69/144): elfutils-libelf-devel-0.189-2.el8.x86 129 kB/s | 61 kB 00:00 2023-07-19T20:38:50.102 INFO:teuthology.orchestra.run.smithi130.stdout:(70/144): fuse-2.9.7-17.el8.x86_64.rpm 311 kB/s | 83 kB 00:00 2023-07-19T20:38:50.269 INFO:teuthology.orchestra.run.smithi130.stdout:(71/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 288 kB/s | 48 kB 00:00 2023-07-19T20:38:50.779 INFO:teuthology.orchestra.run.smithi130.stdout:(72/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.1 MB/s | 561 kB 00:00 2023-07-19T20:38:50.953 INFO:teuthology.orchestra.run.smithi130.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 107 kB/s | 19 kB 00:00 2023-07-19T20:38:51.070 INFO:teuthology.orchestra.run.smithi130.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 332 kB/s | 39 kB 00:00 2023-07-19T20:38:51.379 INFO:teuthology.orchestra.run.smithi130.stdout:(75/144): libgfortran-8.5.0-20.el8.x86_64.rpm 2.0 MB/s | 645 kB 00:00 2023-07-19T20:38:51.513 INFO:teuthology.orchestra.run.smithi130.stdout:(76/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2023-07-19T20:38:52.106 INFO:teuthology.orchestra.run.smithi130.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 332 kB/s | 47 kB 00:00 2023-07-19T20:38:52.107 INFO:teuthology.orchestra.run.smithi130.stdout:(78/144): libselinux-devel-2.9-8.el8.x86_64.rpm 1.3 MB/s | 200 kB 00:00 2023-07-19T20:38:52.107 INFO:teuthology.orchestra.run.smithi130.stdout:(79/144): libsepol-devel-2.9-3.el8.x86_64.rpm 697 kB/s | 87 kB 00:00 2023-07-19T20:38:52.107 INFO:teuthology.orchestra.run.smithi130.stdout:(80/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 663 kB/s | 99 kB 00:00 2023-07-19T20:38:52.198 INFO:teuthology.orchestra.run.smithi130.stdout:(81/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 155 kB/s | 18 kB 00:00 2023-07-19T20:38:52.332 INFO:teuthology.orchestra.run.smithi130.stdout:(82/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 329 kB/s | 44 kB 00:00 2023-07-19T20:38:52.807 INFO:teuthology.orchestra.run.smithi130.stdout:(83/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 6.7 MB/s | 3.2 MB 00:00 2023-07-19T20:38:52.949 INFO:teuthology.orchestra.run.smithi130.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 4.2 MB/s | 605 kB 00:00 2023-07-19T20:38:53.090 INFO:teuthology.orchestra.run.smithi130.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2023-07-19T20:38:53.217 INFO:teuthology.orchestra.run.smithi130.stdout:(86/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-07-19T20:38:53.342 INFO:teuthology.orchestra.run.smithi130.stdout:(87/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2023-07-19T20:38:53.483 INFO:teuthology.orchestra.run.smithi130.stdout:(88/144): python3-cryptography-3.2.1-6.el8.x86_ 4.4 MB/s | 641 kB 00:00 2023-07-19T20:38:53.609 INFO:teuthology.orchestra.run.smithi130.stdout:(89/144): python3-jwt-1.6.1-2.el8.noarch.rpm 341 kB/s | 43 kB 00:00 2023-07-19T20:38:53.734 INFO:teuthology.orchestra.run.smithi130.stdout:(90/144): python3-oauthlib-2.1.0-1.el8.noarch.r 1.2 MB/s | 155 kB 00:00 2023-07-19T20:38:53.875 INFO:teuthology.orchestra.run.smithi130.stdout:(91/144): python3-pycparser-2.14-14.el8.noarch. 770 kB/s | 109 kB 00:00 2023-07-19T20:38:54.000 INFO:teuthology.orchestra.run.smithi130.stdout:(92/144): python3-requests-oauthlib-1.0.0-1.el8 342 kB/s | 43 kB 00:00 2023-07-19T20:38:54.151 INFO:teuthology.orchestra.run.smithi130.stdout:(93/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 497 kB/s | 74 kB 00:00 2023-07-19T20:38:54.295 INFO:teuthology.orchestra.run.smithi130.stdout:(94/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 410 kB/s | 58 kB 00:00 2023-07-19T20:38:54.726 INFO:teuthology.orchestra.run.smithi130.stdout:(95/144): gperftools-libs-2.7-9.el8.x86_64.rpm 707 kB/s | 306 kB 00:00 2023-07-19T20:38:54.810 INFO:teuthology.orchestra.run.smithi130.stdout:(96/144): liboath-2.6.2-3.el8.x86_64.rpm 709 kB/s | 59 kB 00:00 2023-07-19T20:38:54.894 INFO:teuthology.orchestra.run.smithi130.stdout:(97/144): libunwind-1.3.1-3.el8.x86_64.rpm 900 kB/s | 75 kB 00:00 2023-07-19T20:38:55.080 INFO:teuthology.orchestra.run.smithi130.stdout:(98/144): python3-scipy-1.0.0-21.module_el8.5.0 1.8 MB/s | 14 MB 00:07 2023-07-19T20:38:55.111 INFO:teuthology.orchestra.run.smithi130.stdout:(99/144): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-07-19T20:38:55.211 INFO:teuthology.orchestra.run.smithi130.stdout:(100/144): python3-beautifulsoup4-4.6.3-2.el8.1 1.8 MB/s | 185 kB 00:00 2023-07-19T20:38:55.312 INFO:teuthology.orchestra.run.smithi130.stdout:(101/144): python3-cachetools-3.1.1-4.el8.noarc 330 kB/s | 33 kB 00:00 2023-07-19T20:38:55.378 INFO:teuthology.orchestra.run.smithi130.stdout:(102/144): python3-bcrypt-3.1.6-2.el8.1.x86_64. 145 kB/s | 44 kB 00:00 2023-07-19T20:38:55.412 INFO:teuthology.orchestra.run.smithi130.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 163 kB/s | 16 kB 00:00 2023-07-19T20:38:55.504 INFO:teuthology.orchestra.run.smithi130.stdout:(104/144): python3-cherrypy-18.4.0-1.el8.noarch 4.1 MB/s | 384 kB 00:00 2023-07-19T20:38:55.596 INFO:teuthology.orchestra.run.smithi130.stdout:(105/144): python3-cheroot-8.5.2-1.el8.noarch.r 795 kB/s | 173 kB 00:00 2023-07-19T20:38:55.621 INFO:teuthology.orchestra.run.smithi130.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 696 kB/s | 81 kB 00:00 2023-07-19T20:38:55.713 INFO:teuthology.orchestra.run.smithi130.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-07-19T20:38:55.740 INFO:teuthology.orchestra.run.smithi130.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 150 kB/s | 18 kB 00:00 2023-07-19T20:38:55.839 INFO:teuthology.orchestra.run.smithi130.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 486 kB/s | 49 kB 00:00 2023-07-19T20:38:55.922 INFO:teuthology.orchestra.run.smithi130.stdout:(110/144): python3-more-itertools-7.2.0-3.el8.n 710 kB/s | 59 kB 00:00 2023-07-19T20:38:56.014 INFO:teuthology.orchestra.run.smithi130.stdout:(111/144): python3-kubernetes-11.0.0-6.el8.noar 3.9 MB/s | 1.2 MB 00:00 2023-07-19T20:38:56.039 INFO:teuthology.orchestra.run.smithi130.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 516 kB/s | 60 kB 00:00 2023-07-19T20:38:56.090 INFO:teuthology.orchestra.run.smithi130.stdout:(113/144): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-07-19T20:38:56.107 INFO:teuthology.orchestra.run.smithi130.stdout:(114/144): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-07-19T20:38:56.174 INFO:teuthology.orchestra.run.smithi130.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 403 kB/s | 34 kB 00:00 2023-07-19T20:38:56.199 INFO:teuthology.orchestra.run.smithi130.stdout:(116/144): python3-routes-2.4.1-12.el8.noarch.r 2.1 MB/s | 196 kB 00:00 2023-07-19T20:38:56.241 INFO:teuthology.orchestra.run.smithi130.stdout:(117/144): python3-rsa-4.8-1.el8.noarch.rpm 920 kB/s | 61 kB 00:00 2023-07-19T20:38:56.266 INFO:teuthology.orchestra.run.smithi130.stdout:(118/144): python3-simplegeneric-0.8.1-17.el8.n 280 kB/s | 19 kB 00:00 2023-07-19T20:38:56.317 INFO:teuthology.orchestra.run.smithi130.stdout:(119/144): python3-singledispatch-3.4.0.3-18.el 318 kB/s | 24 kB 00:00 2023-07-19T20:38:56.333 INFO:teuthology.orchestra.run.smithi130.stdout:(120/144): python3-tempora-1.14.1-5.el8.noarch. 437 kB/s | 29 kB 00:00 2023-07-19T20:38:56.384 INFO:teuthology.orchestra.run.smithi130.stdout:(121/144): python3-trustme-0.6.0-4.el8.noarch.r 413 kB/s | 27 kB 00:00 2023-07-19T20:38:56.417 INFO:teuthology.orchestra.run.smithi130.stdout:(122/144): python3-waitress-1.4.3-1.el8.noarch. 3.0 MB/s | 255 kB 00:00 2023-07-19T20:38:56.459 INFO:teuthology.orchestra.run.smithi130.stdout:(123/144): python3-webob-1.8.5-1.el8.1.noarch.r 3.3 MB/s | 251 kB 00:00 2023-07-19T20:38:56.494 INFO:teuthology.orchestra.run.smithi130.stdout:(124/144): python3-websocket-client-0.56.0-5.el 814 kB/s | 61 kB 00:00 2023-07-19T20:38:56.565 INFO:teuthology.orchestra.run.smithi130.stdout:(125/144): python3-webtest-2.0.33-1.el8.noarch. 833 kB/s | 85 kB 00:00 2023-07-19T20:38:56.596 INFO:teuthology.orchestra.run.smithi130.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 224 kB/s | 23 kB 00:00 2023-07-19T20:38:56.854 INFO:teuthology.orchestra.run.smithi130.stdout:(127/144): thrift-0.13.0-2.el8.x86_64.rpm 5.9 MB/s | 1.7 MB 00:00 2023-07-19T20:38:59.688 INFO:teuthology.orchestra.run.smithi130.stdout:(128/144): librados2-18.1.2-35.g796ba272.el8.x8 1.2 MB/s | 3.7 MB 00:03 2023-07-19T20:38:59.864 INFO:teuthology.orchestra.run.smithi130.stdout:(129/144): librbd1-18.1.2-35.g796ba272.el8.x86_ 1.2 MB/s | 3.6 MB 00:03 2023-07-19T20:39:00.300 INFO:teuthology.orchestra.run.smithi130.stdout:(130/144): NetworkManager-initscripts-updown-1. 236 kB/s | 143 kB 00:00 2023-07-19T20:39:00.388 INFO:teuthology.orchestra.run.smithi130.stdout:(131/144): elfutils-debuginfod-client-0.189-2.e 144 kB/s | 76 kB 00:00 2023-07-19T20:39:00.572 INFO:teuthology.orchestra.run.smithi130.stdout:(132/144): elfutils-libelf-0.189-2.el8.x86_64.r 843 kB/s | 232 kB 00:00 2023-07-19T20:39:00.819 INFO:teuthology.orchestra.run.smithi130.stdout:(133/144): elfutils-libs-0.189-2.el8.x86_64.rpm 708 kB/s | 302 kB 00:00 2023-07-19T20:39:00.922 INFO:teuthology.orchestra.run.smithi130.stdout:(134/144): iproute-6.2.0-2.el8.x86_64.rpm 2.5 MB/s | 880 kB 00:00 2023-07-19T20:39:00.998 INFO:teuthology.orchestra.run.smithi130.stdout:(135/144): libblkid-2.32.1-42.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2023-07-19T20:39:01.090 INFO:teuthology.orchestra.run.smithi130.stdout:(136/144): libfdisk-2.32.1-42.el8.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2023-07-19T20:39:01.190 INFO:teuthology.orchestra.run.smithi130.stdout:(137/144): libmount-2.32.1-42.el8.x86_64.rpm 1.2 MB/s | 236 kB 00:00 2023-07-19T20:39:01.232 INFO:teuthology.orchestra.run.smithi130.stdout:(138/144): libsmartcols-2.32.1-42.el8.x86_64.rp 1.2 MB/s | 179 kB 00:00 2023-07-19T20:39:01.349 INFO:teuthology.orchestra.run.smithi130.stdout:(139/144): libuuid-2.32.1-42.el8.x86_64.rpm 621 kB/s | 98 kB 00:00 2023-07-19T20:39:01.524 INFO:teuthology.orchestra.run.smithi130.stdout:(140/144): util-linux-user-2.32.1-42.el8.x86_64 585 kB/s | 102 kB 00:00 2023-07-19T20:39:01.635 INFO:teuthology.orchestra.run.smithi130.stdout:(141/144): util-linux-2.32.1-42.el8.x86_64.rpm 6.5 MB/s | 2.6 MB 00:00 2023-07-19T20:39:01.733 INFO:teuthology.orchestra.run.smithi130.stdout:(142/144): xfsdump-3.1.8-6.el8.x86_64.rpm 1.6 MB/s | 334 kB 00:00 2023-07-19T20:39:01.808 INFO:teuthology.orchestra.run.smithi130.stdout:(143/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.2 MB/s | 1.1 MB 00:00 2023-07-19T20:39:28.405 INFO:teuthology.orchestra.run.smithi130.stdout:(144/144): ceph-test-18.1.2-35.g796ba272.el8.x8 854 kB/s | 47 MB 00:55 2023-07-19T20:39:28.409 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-07-19T20:39:28.410 INFO:teuthology.orchestra.run.smithi130.stdout:Total 2.5 MB/s | 210 MB 01:22 2023-07-19T20:39:30.231 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-07-19T20:39:30.641 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-07-19T20:39:30.642 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-07-19T20:39:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-07-19T20:39:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-07-19T20:39:37.447 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-07-19T20:39:37.669 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-19T20:39:37.867 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-19T20:39:38.029 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-19T20:39:38.129 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-19T20:39:38.271 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-19T20:39:38.346 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-19T20:39:38.512 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-19T20:39:38.726 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-19T20:39:38.949 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-19T20:39:39.096 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-19T20:39:39.555 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-19T20:39:39.829 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librados2-2:18.1.2-35.g796ba272.el8.x86_64 8/160 2023-07-19T20:39:40.284 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:18.1.2-35.g796ba272.el8.x86_64 8/160 2023-07-19T20:39:40.495 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librbd1-2:18.1.2-35.g796ba272.el8.x86_64 9/160 2023-07-19T20:39:40.634 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:18.1.2-35.g796ba272.el8.x86_64 9/160 2023-07-19T20:39:40.822 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs2-2:18.1.2-35.g796ba272.el8.x86_64 10/160 2023-07-19T20:39:40.949 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs2-2:18.1.2-35.g796ba272.el8.x86_64 10/160 2023-07-19T20:39:41.180 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rados-2:18.1.2-35.g796ba272.el8.x86_64 11/160 2023-07-19T20:39:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-19T20:39:41.551 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-19T20:39:41.787 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-19T20:39:41.885 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-19T20:39:42.086 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-19T20:39:42.254 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-19T20:39:42.698 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-19T20:39:42.901 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-19T20:39:43.103 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephsqlite-2:18.1.2-35.g796ba272.el8.x86_64 18/160 2023-07-19T20:39:43.224 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephsqlite-2:18.1.2-35.g796ba272.el8.x86_64 18/160 2023-07-19T20:39:43.378 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libradosstriper1-2:18.1.2-35.g796ba272.el8.x86_6 19/160 2023-07-19T20:39:43.521 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libradosstriper1-2:18.1.2-35.g796ba272.el8.x86_6 19/160 2023-07-19T20:39:43.708 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-19T20:39:43.862 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-19T20:39:43.994 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-19T20:39:44.162 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-19T20:39:44.345 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-19T20:39:45.023 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-19T20:39:45.203 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-19T20:39:45.885 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-19T20:39:46.036 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-19T20:39:46.862 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-19T20:39:47.236 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-19T20:39:47.419 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-19T20:39:47.575 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-19T20:39:47.764 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-19T20:39:47.968 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-common-2:18.1.2-35.g796ba272.el8.x8 30/160 2023-07-19T20:39:48.123 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-argparse-2:18.1.2-35.g796ba272.el8. 31/160 2023-07-19T20:39:48.420 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cephfs-2:18.1.2-35.g796ba272.el8.x86_64 32/160 2023-07-19T20:39:49.481 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-19T20:39:49.832 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-19T20:39:50.129 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-19T20:39:50.302 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-19T20:39:52.387 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-19T20:39:52.677 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-19T20:39:52.868 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-19T20:39:53.065 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-19T20:39:53.243 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rbd-2:18.1.2-35.g796ba272.el8.x86_64 40/160 2023-07-19T20:39:53.446 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librados-devel-2:18.1.2-35.g796ba272.el8.x86_64 41/160 2023-07-19T20:39:53.616 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-19T20:39:53.802 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-19T20:39:54.018 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-19T20:39:54.102 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-19T20:39:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-19T20:39:54.361 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-19T20:39:54.515 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-19T20:39:54.735 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-19T20:39:55.285 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-19T20:39:55.578 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-19T20:39:55.605 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-19T20:39:55.792 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-19T20:39:56.083 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-19T20:39:56.300 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-19T20:39:56.448 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-19T20:39:56.606 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-19T20:39:56.798 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-19T20:39:56.992 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-19T20:39:57.224 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-19T20:39:57.388 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-19T20:39:57.550 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-19T20:39:57.716 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-19T20:39:57.802 INFO:teuthology.orchestra.run.smithi124.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-19T20:39:57.802 INFO:teuthology.orchestra.run.smithi124.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-19T20:39:57.803 INFO:teuthology.orchestra.run.smithi124.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-19T20:39:57.900 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-19T20:39:58.062 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-19T20:39:58.080 INFO:teuthology.orchestra.run.smithi124.stdout:(97/144): liboath-2.6.2-3.el8.x86_64.rpm 460 B/s | 59 kB 02:10 2023-07-19T20:39:58.106 INFO:teuthology.orchestra.run.smithi124.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 588 B/s | 75 kB 02:10 2023-07-19T20:39:58.198 INFO:teuthology.orchestra.run.smithi124.stdout:(99/144): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:10 2023-07-19T20:39:58.239 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-19T20:39:58.333 INFO:teuthology.orchestra.run.smithi124.stdout:(100/144): python3-beautifulsoup4-4.6.3-2.el8.1 1.4 MB/s | 185 kB 00:00 2023-07-19T20:39:58.398 INFO:teuthology.orchestra.run.smithi124.stdout:(101/144): python3-cachetools-3.1.1-4.el8.noarc 494 kB/s | 33 kB 00:00 2023-07-19T20:39:58.473 INFO:teuthology.orchestra.run.smithi124.stdout:(102/144): python3-certifi-2018.10.15-7.el8.noa 218 kB/s | 16 kB 00:00 2023-07-19T20:39:58.513 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-19T20:39:58.615 INFO:teuthology.orchestra.run.smithi124.stdout:(103/144): python3-cheroot-8.5.2-1.el8.noarch.r 1.2 MB/s | 173 kB 00:00 2023-07-19T20:39:58.757 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-19T20:39:58.808 INFO:teuthology.orchestra.run.smithi124.stdout:(104/144): python3-cherrypy-18.4.0-1.el8.noarch 2.0 MB/s | 384 kB 00:00 2023-07-19T20:39:58.891 INFO:teuthology.orchestra.run.smithi124.stdout:(105/144): python3-google-auth-1.1.1-10.el8.noa 976 kB/s | 81 kB 00:00 2023-07-19T20:39:58.974 INFO:teuthology.orchestra.run.smithi124.stdout:(106/144): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-07-19T20:39:58.991 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-19T20:39:59.103 INFO:teuthology.orchestra.run.smithi124.stdout:(107/144): python3-jaraco-functools-2.0-4.el8.n 137 kB/s | 18 kB 00:00 2023-07-19T20:39:59.337 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-19T20:39:59.541 INFO:teuthology.orchestra.run.smithi124.stdout:(108/144): python3-kubernetes-11.0.0-6.el8.noar 2.7 MB/s | 1.2 MB 00:00 2023-07-19T20:39:59.587 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-19T20:39:59.634 INFO:teuthology.orchestra.run.smithi124.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 532 kB/s | 49 kB 00:00 2023-07-19T20:39:59.726 INFO:teuthology.orchestra.run.smithi124.stdout:(110/144): python3-more-itertools-7.2.0-3.el8.n 641 kB/s | 59 kB 00:00 2023-07-19T20:39:59.818 INFO:teuthology.orchestra.run.smithi124.stdout:(111/144): python3-natsort-7.1.1-2.el8.noarch.r 659 kB/s | 60 kB 00:00 2023-07-19T20:39:59.832 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-19T20:39:59.968 INFO:teuthology.orchestra.run.smithi124.stdout:(112/144): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-07-19T20:40:00.051 INFO:teuthology.orchestra.run.smithi124.stdout:(113/144): python3-portend-2.6-1.el8.noarch.rpm 187 kB/s | 16 kB 00:00 2023-07-19T20:40:00.144 INFO:teuthology.orchestra.run.smithi124.stdout:(114/144): python3-repoze-lru-0.7-6.el8.noarch. 367 kB/s | 34 kB 00:00 2023-07-19T20:40:00.243 INFO:teuthology.orchestra.run.smithi124.stdout:(115/144): python3-routes-2.4.1-12.el8.noarch.r 1.9 MB/s | 196 kB 00:00 2023-07-19T20:40:00.352 INFO:teuthology.orchestra.run.smithi124.stdout:(116/144): python3-rsa-4.8-1.el8.noarch.rpm 568 kB/s | 61 kB 00:00 2023-07-19T20:40:00.460 INFO:teuthology.orchestra.run.smithi124.stdout:(117/144): python3-simplegeneric-0.8.1-17.el8.n 173 kB/s | 19 kB 00:00 2023-07-19T20:40:00.577 INFO:teuthology.orchestra.run.smithi124.stdout:(118/144): python3-singledispatch-3.4.0.3-18.el 204 kB/s | 24 kB 00:00 2023-07-19T20:40:00.667 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-19T20:40:00.694 INFO:teuthology.orchestra.run.smithi124.stdout:(119/144): python3-tempora-1.14.1-5.el8.noarch. 251 kB/s | 29 kB 00:00 2023-07-19T20:40:00.820 INFO:teuthology.orchestra.run.smithi124.stdout:(120/144): python3-trustme-0.6.0-4.el8.noarch.r 220 kB/s | 27 kB 00:00 2023-07-19T20:40:00.900 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librgw2-2:18.1.2-35.g796ba272.el8.x86_64 70/160 2023-07-19T20:40:00.911 INFO:teuthology.orchestra.run.smithi124.stdout:(121/144): python3-waitress-1.4.3-1.el8.noarch. 2.7 MB/s | 255 kB 00:00 2023-07-19T20:40:01.012 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librgw2-2:18.1.2-35.g796ba272.el8.x86_64 70/160 2023-07-19T20:40:01.236 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rgw-2:18.1.2-35.g796ba272.el8.x86_64 71/160 2023-07-19T20:40:01.461 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-19T20:40:01.787 INFO:teuthology.orchestra.run.smithi124.stdout:(122/144): python3-webob-1.8.5-1.el8.1.noarch.r 287 kB/s | 251 kB 00:00 2023-07-19T20:40:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-19T20:40:01.905 INFO:teuthology.orchestra.run.smithi124.stdout:(123/144): python3-websocket-client-0.56.0-5.el 524 kB/s | 61 kB 00:00 2023-07-19T20:40:02.118 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-19T20:40:02.341 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-19T20:40:02.387 INFO:teuthology.orchestra.run.smithi124.stdout:(124/144): python3-webtest-2.0.33-1.el8.noarch. 177 kB/s | 85 kB 00:00 2023-07-19T20:40:02.504 INFO:teuthology.orchestra.run.smithi124.stdout:(125/144): python3-zc-lockfile-2.0-2.el8.noarch 197 kB/s | 23 kB 00:00 2023-07-19T20:40:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-19T20:40:02.802 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-19T20:40:03.995 INFO:teuthology.orchestra.run.smithi124.stdout:(126/144): thrift-0.13.0-2.el8.x86_64.rpm 1.2 MB/s | 1.7 MB 00:01 2023-07-19T20:40:04.062 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-19T20:40:04.426 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-19T20:40:04.618 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-19T20:40:04.836 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-19T20:40:05.124 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-19T20:40:05.353 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-19T20:40:05.571 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-19T20:40:05.764 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-19T20:40:06.107 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-19T20:40:06.314 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-19T20:40:06.460 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-19T20:40:06.628 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-19T20:40:06.987 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-19T20:40:07.205 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-19T20:40:07.341 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-19T20:40:07.550 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-19T20:40:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-19T20:40:07.979 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-19T20:40:08.197 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-19T20:40:08.383 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-19T20:40:08.506 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-19T20:40:08.751 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-19T20:40:08.891 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-19T20:40:09.954 INFO:teuthology.orchestra.run.smithi124.stdout:(127/144): librados2-18.1.2-35.g796ba272.el8.x8 629 kB/s | 3.7 MB 00:05 2023-07-19T20:40:11.726 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 100/160 2023-07-19T20:40:11.983 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 100/160 2023-07-19T20:40:12.665 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 100/160 2023-07-19T20:40:12.945 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-base-2:18.1.2-35.g796ba272.el8.x86_64 101/160 2023-07-19T20:40:13.154 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-base-2:18.1.2-35.g796ba272.el8.x86_64 101/160 2023-07-19T20:40:13.170 INFO:teuthology.orchestra.run.smithi124.stdout:(128/144): librbd1-18.1.2-35.g796ba272.el8.x86_ 1.1 MB/s | 3.6 MB 00:03 2023-07-19T20:40:13.340 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-selinux-2:18.1.2-35.g796ba272.el8.x86_64 102/160 2023-07-19T20:40:13.754 INFO:teuthology.orchestra.run.smithi124.stdout:(129/144): NetworkManager-initscripts-updown-1. 246 kB/s | 143 kB 00:00 2023-07-19T20:40:13.912 INFO:teuthology.orchestra.run.smithi124.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 479 kB/s | 76 kB 00:00 2023-07-19T20:40:14.211 INFO:teuthology.orchestra.run.smithi124.stdout:(131/144): elfutils-libelf-0.189-2.el8.x86_64.r 776 kB/s | 232 kB 00:00 2023-07-19T20:40:14.430 INFO:teuthology.orchestra.run.smithi124.stdout:(132/144): elfutils-libs-0.189-2.el8.x86_64.rpm 1.4 MB/s | 302 kB 00:00 2023-07-19T20:40:14.713 INFO:teuthology.orchestra.run.smithi124.stdout:(133/144): iproute-6.2.0-2.el8.x86_64.rpm 3.0 MB/s | 880 kB 00:00 2023-07-19T20:40:14.855 INFO:teuthology.orchestra.run.smithi124.stdout:(134/144): libblkid-2.32.1-42.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-07-19T20:40:15.034 INFO:teuthology.orchestra.run.smithi124.stdout:(135/144): libfdisk-2.32.1-42.el8.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2023-07-19T20:40:15.180 INFO:teuthology.orchestra.run.smithi124.stdout:(136/144): libmount-2.32.1-42.el8.x86_64.rpm 1.6 MB/s | 236 kB 00:00 2023-07-19T20:40:15.323 INFO:teuthology.orchestra.run.smithi124.stdout:(137/144): libsmartcols-2.32.1-42.el8.x86_64.rp 1.2 MB/s | 179 kB 00:00 2023-07-19T20:40:15.464 INFO:teuthology.orchestra.run.smithi124.stdout:(138/144): libuuid-2.32.1-42.el8.x86_64.rpm 695 kB/s | 98 kB 00:00 2023-07-19T20:40:15.881 INFO:teuthology.orchestra.run.smithi124.stdout:(139/144): util-linux-2.32.1-42.el8.x86_64.rpm 6.2 MB/s | 2.6 MB 00:00 2023-07-19T20:40:16.157 INFO:teuthology.orchestra.run.smithi124.stdout:(140/144): util-linux-user-2.32.1-42.el8.x86_64 372 kB/s | 102 kB 00:00 2023-07-19T20:40:16.415 INFO:teuthology.orchestra.run.smithi124.stdout:(141/144): xfsdump-3.1.8-6.el8.x86_64.rpm 1.3 MB/s | 334 kB 00:00 2023-07-19T20:40:16.582 INFO:teuthology.orchestra.run.smithi124.stdout:(142/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.5 MB/s | 1.1 MB 00:00 2023-07-19T20:40:33.905 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-selinux-2:18.1.2-35.g796ba272.el8.x86_64 102/160 2023-07-19T20:40:33.906 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /sys 2023-07-19T20:40:33.906 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /proc 2023-07-19T20:40:33.906 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /dev 2023-07-19T20:40:33.906 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /run 2023-07-19T20:40:33.906 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /mnt 2023-07-19T20:40:33.906 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /var/tmp 2023-07-19T20:40:33.906 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /home 2023-07-19T20:40:33.907 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /tmp 2023-07-19T20:40:33.907 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /dev 2023-07-19T20:40:33.907 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:40:34.312 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-volume-2:18.1.2-35.g796ba272.el8.noarch 103/160 2023-07-19T20:40:36.043 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-volume-2:18.1.2-35.g796ba272.el8.noarch 103/160 2023-07-19T20:40:36.283 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-osd-2:18.1.2-35.g796ba272.el8.x86_64 104/160 2023-07-19T20:40:36.550 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-osd-2:18.1.2-35.g796ba272.el8.x86_64 104/160 2023-07-19T20:40:36.728 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mds-2:18.1.2-35.g796ba272.el8.x86_64 105/160 2023-07-19T20:40:37.256 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mds-2:18.1.2-35.g796ba272.el8.x86_64 105/160 2023-07-19T20:40:37.445 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mon-2:18.1.2-35.g796ba272.el8.x86_64 106/160 2023-07-19T20:40:37.494 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mon-2:18.1.2-35.g796ba272.el8.x86_64 106/160 2023-07-19T20:40:37.670 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-19T20:40:37.868 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-19T20:40:38.020 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-19T20:40:38.113 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-19T20:40:38.429 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-19T20:40:38.662 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-19T20:40:38.730 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-19T20:40:38.730 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-19T20:40:38.730 INFO:teuthology.orchestra.run.smithi117.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-19T20:40:39.275 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:18.1.2-35.g796ba272.el8.noarch 112/160 2023-07-19T20:40:39.351 INFO:teuthology.orchestra.run.smithi117.stdout:(97/144): liboath-2.6.2-3.el8.x86_64.rpm 456 B/s | 59 kB 02:11 2023-07-19T20:40:39.376 INFO:teuthology.orchestra.run.smithi117.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 582 B/s | 75 kB 02:11 2023-07-19T20:40:39.435 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephadm-2:18.1.2-35.g796ba272.el8.noarch 112/160 2023-07-19T20:40:39.510 INFO:teuthology.orchestra.run.smithi117.stdout:(99/144): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 327 kB/s | 44 kB 00:00 2023-07-19T20:40:39.569 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-prometheus-alerts-2:18.1.2-35.g796ba272.el8 113/160 2023-07-19T20:40:39.593 INFO:teuthology.orchestra.run.smithi117.stdout:(100/144): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:12 2023-07-19T20:40:39.711 INFO:teuthology.orchestra.run.smithi117.stdout:(101/144): python3-cachetools-3.1.1-4.el8.noarc 283 kB/s | 33 kB 00:00 2023-07-19T20:40:39.807 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-grafana-dashboards-2:18.1.2-35.g796ba272.el 114/160 2023-07-19T20:40:39.820 INFO:teuthology.orchestra.run.smithi117.stdout:(102/144): python3-asyncssh-2.7.0-2.el8.noarch. 1.0 MB/s | 476 kB 00:00 2023-07-19T20:40:39.836 INFO:teuthology.orchestra.run.smithi117.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 130 kB/s | 16 kB 00:00 2023-07-19T20:40:39.861 INFO:teuthology.orchestra.run.smithi117.stdout:(104/144): python3-beautifulsoup4-4.6.3-2.el8.1 527 kB/s | 185 kB 00:00 2023-07-19T20:40:39.995 INFO:teuthology.orchestra.run.smithi117.stdout:(105/144): python3-cheroot-8.5.2-1.el8.noarch.r 983 kB/s | 173 kB 00:00 2023-07-19T20:40:40.019 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-cephadm-2:18.1.2-35.g796ba272.el8.noarc 115/160 2023-07-19T20:40:40.020 INFO:teuthology.orchestra.run.smithi117.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 513 kB/s | 81 kB 00:00 2023-07-19T20:40:40.095 INFO:teuthology.orchestra.run.smithi117.stdout:(107/144): python3-cherrypy-18.4.0-1.el8.noarch 1.4 MB/s | 384 kB 00:00 2023-07-19T20:40:40.129 INFO:teuthology.orchestra.run.smithi117.stdout:(108/144): python3-jaraco-6.2-6.el8.noarch.rpm 83 kB/s | 11 kB 00:00 2023-07-19T20:40:40.154 INFO:teuthology.orchestra.run.smithi117.stdout:(109/144): python3-jaraco-functools-2.0-4.el8.n 131 kB/s | 18 kB 00:00 2023-07-19T20:40:40.271 INFO:teuthology.orchestra.run.smithi117.stdout:(110/144): python3-logutils-0.3.5-11.el8.noarch 343 kB/s | 49 kB 00:00 2023-07-19T20:40:40.273 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.1.2-35.g796ba272.el8.noarc 115/160 2023-07-19T20:40:40.288 INFO:teuthology.orchestra.run.smithi117.stdout:(111/144): python3-more-itertools-7.2.0-3.el8.n 440 kB/s | 59 kB 00:00 2023-07-19T20:40:40.388 INFO:teuthology.orchestra.run.smithi117.stdout:(112/144): python3-kubernetes-11.0.0-6.el8.noar 4.0 MB/s | 1.2 MB 00:00 2023-07-19T20:40:40.405 INFO:teuthology.orchestra.run.smithi117.stdout:(113/144): python3-natsort-7.1.1-2.el8.noarch.r 450 kB/s | 60 kB 00:00 2023-07-19T20:40:40.506 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-dashboard-2:18.1.2-35.g796ba272.el8.noa 116/160 2023-07-19T20:40:40.523 INFO:teuthology.orchestra.run.smithi117.stdout:(114/144): python3-portend-2.6-1.el8.noarch.rpm 117 kB/s | 16 kB 00:00 2023-07-19T20:40:40.539 INFO:teuthology.orchestra.run.smithi117.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 252 kB/s | 34 kB 00:00 2023-07-19T20:40:40.664 INFO:teuthology.orchestra.run.smithi117.stdout:(116/144): python3-routes-2.4.1-12.el8.noarch.r 1.4 MB/s | 196 kB 00:00 2023-07-19T20:40:40.681 INFO:teuthology.orchestra.run.smithi117.stdout:(117/144): python3-rsa-4.8-1.el8.noarch.rpm 434 kB/s | 61 kB 00:00 2023-07-19T20:40:40.749 INFO:teuthology.orchestra.run.smithi117.stdout:(118/144): python3-pecan-1.3.2-9.el8.noarch.rpm 615 kB/s | 283 kB 00:00 2023-07-19T20:40:40.782 INFO:teuthology.orchestra.run.smithi117.stdout:(119/144): python3-simplegeneric-0.8.1-17.el8.n 160 kB/s | 19 kB 00:00 2023-07-19T20:40:40.807 INFO:teuthology.orchestra.run.smithi117.stdout:(120/144): python3-singledispatch-3.4.0.3-18.el 190 kB/s | 24 kB 00:00 2023-07-19T20:40:40.874 INFO:teuthology.orchestra.run.smithi117.stdout:(121/144): python3-tempora-1.14.1-5.el8.noarch. 233 kB/s | 29 kB 00:00 2023-07-19T20:40:40.908 INFO:teuthology.orchestra.run.smithi117.stdout:(122/144): python3-trustme-0.6.0-4.el8.noarch.r 219 kB/s | 27 kB 00:00 2023-07-19T20:40:40.976 INFO:teuthology.orchestra.run.smithi117.stdout:(123/144): python3-waitress-1.4.3-1.el8.noarch. 1.5 MB/s | 255 kB 00:00 2023-07-19T20:40:41.042 INFO:teuthology.orchestra.run.smithi117.stdout:(124/144): python3-websocket-client-0.56.0-5.el 457 kB/s | 61 kB 00:00 2023-07-19T20:40:41.125 INFO:teuthology.orchestra.run.smithi117.stdout:(125/144): python3-webtest-2.0.33-1.el8.noarch. 568 kB/s | 85 kB 00:00 2023-07-19T20:40:41.184 INFO:teuthology.orchestra.run.smithi117.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 162 kB/s | 23 kB 00:00 2023-07-19T20:40:41.360 INFO:teuthology.orchestra.run.smithi117.stdout:(127/144): python3-webob-1.8.5-1.el8.1.noarch.r 518 kB/s | 251 kB 00:00 2023-07-19T20:40:41.610 INFO:teuthology.orchestra.run.smithi117.stdout:(128/144): thrift-0.13.0-2.el8.x86_64.rpm 3.6 MB/s | 1.7 MB 00:00 2023-07-19T20:40:41.625 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.1.2-35.g796ba272.el8.noa 116/160 2023-07-19T20:40:41.787 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-diskprediction-local-2:18.1.2-35.g796ba 117/160 2023-07-19T20:40:42.512 INFO:teuthology.orchestra.run.smithi117.stdout:(129/144): NetworkManager-initscripts-updown-1. 226 kB/s | 143 kB 00:00 2023-07-19T20:40:42.512 INFO:teuthology.orchestra.run.smithi117.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 414 kB/s | 76 kB 00:00 2023-07-19T20:40:42.513 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.1.2-35.g796ba 117/160 2023-07-19T20:40:42.513 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-modules-core-2:18.1.2-35.g796ba272.el8. 118/160 2023-07-19T20:40:42.566 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-2:18.1.2-35.g796ba272.el8.x86_64 119/160 2023-07-19T20:40:42.630 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-2:18.1.2-35.g796ba272.el8.x86_64 119/160 2023-07-19T20:40:42.712 INFO:teuthology.orchestra.run.smithi117.stdout:(131/144): elfutils-libelf-0.189-2.el8.x86_64.r 819 kB/s | 232 kB 00:00 2023-07-19T20:40:42.821 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-rook-2:18.1.2-35.g796ba272.el8.noarch 120/160 2023-07-19T20:40:42.846 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-rook-2:18.1.2-35.g796ba272.el8.noarch 120/160 2023-07-19T20:40:42.961 INFO:teuthology.orchestra.run.smithi117.stdout:(132/144): elfutils-libs-0.189-2.el8.x86_64.rpm 1.2 MB/s | 302 kB 00:00 2023-07-19T20:40:43.018 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-2:18.1.2-35.g796ba272.el8.x86_64 121/160 2023-07-19T20:40:43.168 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-19T20:40:43.386 INFO:teuthology.orchestra.run.smithi117.stdout:(133/144): iproute-6.2.0-2.el8.x86_64.rpm 2.0 MB/s | 880 kB 00:00 2023-07-19T20:40:43.669 INFO:teuthology.orchestra.run.smithi117.stdout:(134/144): libblkid-2.32.1-42.el8.x86_64.rpm 778 kB/s | 220 kB 00:00 2023-07-19T20:40:43.819 INFO:teuthology.orchestra.run.smithi117.stdout:(135/144): libfdisk-2.32.1-42.el8.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2023-07-19T20:40:43.995 INFO:teuthology.orchestra.run.smithi117.stdout:(136/144): libmount-2.32.1-42.el8.x86_64.rpm 1.3 MB/s | 236 kB 00:00 2023-07-19T20:40:44.137 INFO:teuthology.orchestra.run.smithi117.stdout:(137/144): libsmartcols-2.32.1-42.el8.x86_64.rp 1.2 MB/s | 179 kB 00:00 2023-07-19T20:40:44.278 INFO:teuthology.orchestra.run.smithi117.stdout:(138/144): libuuid-2.32.1-42.el8.x86_64.rpm 696 kB/s | 98 kB 00:00 2023-07-19T20:40:44.687 INFO:teuthology.orchestra.run.smithi117.stdout:(139/144): librados2-18.1.2-35.g796ba272.el8.x8 1.0 MB/s | 3.7 MB 00:03 2023-07-19T20:40:44.746 INFO:teuthology.orchestra.run.smithi117.stdout:(140/144): util-linux-2.32.1-42.el8.x86_64.rpm 5.6 MB/s | 2.6 MB 00:00 2023-07-19T20:40:44.888 INFO:teuthology.orchestra.run.smithi117.stdout:(141/144): xfsdump-3.1.8-6.el8.x86_64.rpm 2.3 MB/s | 334 kB 00:00 2023-07-19T20:40:45.080 INFO:teuthology.orchestra.run.smithi117.stdout:(142/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.6 MB/s | 1.1 MB 00:00 2023-07-19T20:40:45.246 INFO:teuthology.orchestra.run.smithi117.stdout:(143/144): util-linux-user-2.32.1-42.el8.x86_64 183 kB/s | 102 kB 00:00 2023-07-19T20:40:45.946 INFO:teuthology.orchestra.run.smithi117.stdout:(144/144): librbd1-18.1.2-35.g796ba272.el8.x86_ 795 kB/s | 3.6 MB 00:04 2023-07-19T20:40:45.951 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2023-07-19T20:40:45.952 INFO:teuthology.orchestra.run.smithi117.stdout:Total 1.2 MB/s | 210 MB 02:49 2023-07-19T20:40:46.832 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2023-07-19T20:40:47.189 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2023-07-19T20:40:47.190 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2023-07-19T20:40:48.044 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-19T20:40:48.349 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2023-07-19T20:40:48.352 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2023-07-19T20:40:49.533 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-test-2:18.1.2-35.g796ba272.el8.x86_64 123/160 2023-07-19T20:40:49.723 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-radosgw-2:18.1.2-35.g796ba272.el8.x86_64 124/160 2023-07-19T20:40:49.815 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-radosgw-2:18.1.2-35.g796ba272.el8.x86_64 124/160 2023-07-19T20:40:49.985 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-immutable-object-cache-2:18.1.2-35.g796ba27 125/160 2023-07-19T20:40:50.057 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.1.2-35.g796ba27 125/160 2023-07-19T20:40:50.243 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-mirror-2:18.1.2-35.g796ba272.el8.x86_64 126/160 2023-07-19T20:40:50.654 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephfs-mirror-2:18.1.2-35.g796ba272.el8.x86_64 126/160 2023-07-19T20:40:50.861 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-mirror-2:18.1.2-35.g796ba272.el8.x86_64 127/160 2023-07-19T20:40:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-mirror-2:18.1.2-35.g796ba272.el8.x86_64 127/160 2023-07-19T20:40:51.497 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-19T20:40:52.670 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-fuse-2:18.1.2-35.g796ba272.el8.x86_64 129/160 2023-07-19T20:40:52.990 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-19T20:40:53.174 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-19T20:40:53.364 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-19T20:40:53.497 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-19T20:40:53.685 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs-devel-2:18.1.2-35.g796ba272.el8.x86_64 134/160 2023-07-19T20:40:53.921 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2023-07-19T20:40:54.097 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-19T20:40:54.313 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-19T20:40:54.509 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-19T20:40:54.588 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-19T20:40:54.734 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-19T20:40:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-19T20:40:54.850 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-19T20:40:54.991 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-19T20:40:55.101 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-19T20:40:55.155 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-19T20:40:55.184 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-19T20:40:55.328 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-19T20:40:55.397 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-19T20:40:55.534 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-19T20:40:55.626 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-top-2:18.1.2-35.g796ba272.el8.noarch 137/160 2023-07-19T20:40:55.826 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-fuse-2:18.1.2-35.g796ba272.el8.x86_64 138/160 2023-07-19T20:40:55.919 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-19T20:40:56.117 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:18.1.2-35.g796ba272.el8.x86_64 8/160 2023-07-19T20:40:56.163 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-nbd-2:18.1.2-35.g796ba272.el8.x86_64 139/160 2023-07-19T20:40:56.477 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-19T20:40:56.513 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:18.1.2-35.g796ba272.el8.x86_64 8/160 2023-07-19T20:40:56.612 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-19T20:40:56.632 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-19T20:40:56.700 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:18.1.2-35.g796ba272.el8.x86_64 9/160 2023-07-19T20:40:56.814 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:18.1.2-35.g796ba272.el8.x86_64 9/160 2023-07-19T20:40:56.828 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-19T20:40:57.042 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:18.1.2-35.g796ba272.el8.x86_64 10/160 2023-07-19T20:40:57.058 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-19T20:40:57.120 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:18.1.2-35.g796ba272.el8.x86_64 10/160 2023-07-19T20:40:57.170 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-19T20:40:57.314 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:18.1.2-35.g796ba272.el8.x86_64 11/160 2023-07-19T20:40:57.375 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-19T20:40:57.401 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-19T20:40:57.508 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-19T20:40:57.576 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-19T20:40:57.688 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-19T20:40:57.791 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-19T20:40:57.941 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-19T20:40:57.954 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-19T20:40:57.954 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-19T20:40:58.018 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-19T20:40:58.230 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-19T20:40:58.230 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-19T20:40:58.235 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-19T20:40:58.477 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-19T20:40:58.493 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-19T20:40:58.524 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-19T20:40:58.614 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-19T20:40:58.615 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-19T20:40:58.876 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-19T20:40:58.899 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-19T20:40:59.094 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-19T20:40:59.120 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-19T20:40:59.241 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:18.1.2-35.g796ba272.el8.x86_64 18/160 2023-07-19T20:40:59.274 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-19T20:40:59.344 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:18.1.2-35.g796ba272.el8.x86_64 18/160 2023-07-19T20:40:59.501 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-19T20:40:59.502 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-19T20:40:59.542 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:18.1.2-35.g796ba272.el8.x86_6 19/160 2023-07-19T20:40:59.650 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:18.1.2-35.g796ba272.el8.x86_6 19/160 2023-07-19T20:40:59.745 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-19T20:40:59.745 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-19T20:40:59.873 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-19T20:40:59.986 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-19T20:40:59.986 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-19T20:41:00.029 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-19T20:41:00.157 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-19T20:41:00.244 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-19T20:41:00.244 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-19T20:41:00.296 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-19T20:41:00.474 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-19T20:41:00.485 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-19T20:41:00.486 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-19T20:41:00.711 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-19T20:41:00.909 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-19T20:41:01.068 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-19T20:41:01.116 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-19T20:41:01.117 INFO:teuthology.orchestra.run.smithi130.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-19T20:41:01.117 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:41:01.258 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-19T20:41:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-2:18.1.2-35.g796ba272.el8.x86_64 1/160 2023-07-19T20:41:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-base-2:18.1.2-35.g796ba272.el8.x86_64 2/160 2023-07-19T20:41:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 3/160 2023-07-19T20:41:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-fuse-2:18.1.2-35.g796ba272.el8.x86_64 4/160 2023-07-19T20:41:01.825 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-immutable-object-cache-2:18.1.2-35.g796ba27 5/160 2023-07-19T20:41:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mds-2:18.1.2-35.g796ba272.el8.x86_64 6/160 2023-07-19T20:41:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-2:18.1.2-35.g796ba272.el8.x86_64 7/160 2023-07-19T20:41:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mon-2:18.1.2-35.g796ba272.el8.x86_64 8/160 2023-07-19T20:41:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-osd-2:18.1.2-35.g796ba272.el8.x86_64 9/160 2023-07-19T20:41:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-radosgw-2:18.1.2-35.g796ba272.el8.x86_64 10/160 2023-07-19T20:41:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-selinux-2:18.1.2-35.g796ba272.el8.x86_64 11/160 2023-07-19T20:41:01.826 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-test-2:18.1.2-35.g796ba272.el8.x86_64 12/160 2023-07-19T20:41:01.827 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-mirror-2:18.1.2-35.g796ba272.el8.x86_64 13/160 2023-07-19T20:41:01.827 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs-devel-2:18.1.2-35.g796ba272.el8.x86_64 14/160 2023-07-19T20:41:01.827 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs2-2:18.1.2-35.g796ba272.el8.x86_64 15/160 2023-07-19T20:41:01.827 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephsqlite-2:18.1.2-35.g796ba272.el8.x86_64 16/160 2023-07-19T20:41:01.827 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados-devel-2:18.1.2-35.g796ba272.el8.x86_64 17/160 2023-07-19T20:41:01.827 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libradosstriper1-2:18.1.2-35.g796ba272.el8.x86_6 18/160 2023-07-19T20:41:01.827 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librgw2-2:18.1.2-35.g796ba272.el8.x86_64 19/160 2023-07-19T20:41:01.828 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-argparse-2:18.1.2-35.g796ba272.el8. 20/160 2023-07-19T20:41:01.828 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-common-2:18.1.2-35.g796ba272.el8.x8 21/160 2023-07-19T20:41:01.828 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cephfs-2:18.1.2-35.g796ba272.el8.x86_64 22/160 2023-07-19T20:41:01.829 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rados-2:18.1.2-35.g796ba272.el8.x86_64 23/160 2023-07-19T20:41:01.829 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rbd-2:18.1.2-35.g796ba272.el8.x86_64 24/160 2023-07-19T20:41:01.829 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rgw-2:18.1.2-35.g796ba272.el8.x86_64 25/160 2023-07-19T20:41:01.829 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-fuse-2:18.1.2-35.g796ba272.el8.x86_64 26/160 2023-07-19T20:41:01.829 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-mirror-2:18.1.2-35.g796ba272.el8.x86_64 27/160 2023-07-19T20:41:01.839 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-nbd-2:18.1.2-35.g796ba272.el8.x86_64 28/160 2023-07-19T20:41:01.839 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-grafana-dashboards-2:18.1.2-35.g796ba272.el 29/160 2023-07-19T20:41:01.839 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-cephadm-2:18.1.2-35.g796ba272.el8.noarc 30/160 2023-07-19T20:41:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-dashboard-2:18.1.2-35.g796ba272.el8.noa 31/160 2023-07-19T20:41:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.1.2-35.g796ba 32/160 2023-07-19T20:41:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-modules-core-2:18.1.2-35.g796ba272.el8. 33/160 2023-07-19T20:41:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-rook-2:18.1.2-35.g796ba272.el8.noarch 34/160 2023-07-19T20:41:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-prometheus-alerts-2:18.1.2-35.g796ba272.el8 35/160 2023-07-19T20:41:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-volume-2:18.1.2-35.g796ba272.el8.noarch 36/160 2023-07-19T20:41:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephadm-2:18.1.2-35.g796ba272.el8.noarch 37/160 2023-07-19T20:41:01.840 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-top-2:18.1.2-35.g796ba272.el8.noarch 38/160 2023-07-19T20:41:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-19T20:41:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-19T20:41:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-19T20:41:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-19T20:41:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-19T20:41:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-19T20:41:01.841 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-19T20:41:01.842 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-19T20:41:01.842 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-19T20:41:01.842 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-19T20:41:01.842 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-19T20:41:01.842 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-19T20:41:01.842 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-19T20:41:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-19T20:41:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-19T20:41:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-19T20:41:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-19T20:41:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-19T20:41:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-19T20:41:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-19T20:41:01.843 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-19T20:41:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-19T20:41:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-19T20:41:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-19T20:41:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-19T20:41:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-19T20:41:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-19T20:41:01.844 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-19T20:41:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-19T20:41:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-19T20:41:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-19T20:41:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-19T20:41:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-19T20:41:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-19T20:41:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-19T20:41:01.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-19T20:41:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-19T20:41:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-19T20:41:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-19T20:41:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-19T20:41:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-19T20:41:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-19T20:41:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-19T20:41:01.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-19T20:41:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-19T20:41:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-19T20:41:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-19T20:41:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-19T20:41:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-19T20:41:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-19T20:41:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-19T20:41:01.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-19T20:41:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-19T20:41:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-19T20:41:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-19T20:41:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-19T20:41:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-19T20:41:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-19T20:41:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-19T20:41:01.848 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-19T20:41:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-19T20:41:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-19T20:41:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-19T20:41:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-19T20:41:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-19T20:41:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-19T20:41:01.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-19T20:41:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-19T20:41:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-19T20:41:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-19T20:41:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-19T20:41:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-19T20:41:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-19T20:41:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-19T20:41:01.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-19T20:41:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-19T20:41:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-19T20:41:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-19T20:41:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-19T20:41:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-19T20:41:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-19T20:41:01.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-19T20:41:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-19T20:41:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-19T20:41:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-19T20:41:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-19T20:41:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-19T20:41:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-19T20:41:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-19T20:41:01.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-19T20:41:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:18.1.2-35.g796ba272.el8.x86_64 129/160 2023-07-19T20:41:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-19T20:41:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:18.1.2-35.g796ba272.el8.x86_64 131/160 2023-07-19T20:41:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-19T20:41:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-19T20:41:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-19T20:41:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-19T20:41:01.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-19T20:41:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-19T20:41:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-19T20:41:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-19T20:41:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-19T20:41:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-19T20:41:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-19T20:41:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-19T20:41:01.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-19T20:41:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-19T20:41:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-19T20:41:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-19T20:41:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-19T20:41:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-19T20:41:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-19T20:41:01.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-19T20:41:01.856 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-19T20:41:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-19T20:41:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-19T20:41:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-19T20:41:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-19T20:41:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-19T20:41:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-19T20:41:01.857 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-19T20:41:01.913 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-19T20:41:02.074 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-19T20:41:02.765 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-19T20:41:03.110 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-19T20:41:03.362 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-19T20:41:03.535 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-19T20:41:03.734 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-19T20:41:03.930 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:18.1.2-35.g796ba272.el8.x8 30/160 2023-07-19T20:41:03.947 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-19T20:41:03.948 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:41:03.948 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2023-07-19T20:41:03.948 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-19T20:41:03.948 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-19T20:41:03.949 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-19T20:41:03.949 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-19T20:41:03.949 INFO:teuthology.orchestra.run.smithi130.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-19T20:41:03.949 INFO:teuthology.orchestra.run.smithi130.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-19T20:41:03.949 INFO:teuthology.orchestra.run.smithi130.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-19T20:41:03.949 INFO:teuthology.orchestra.run.smithi130.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-19T20:41:03.949 INFO:teuthology.orchestra.run.smithi130.stdout: librados2-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.949 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.950 INFO:teuthology.orchestra.run.smithi130.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-19T20:41:03.950 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-19T20:41:03.950 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-19T20:41:03.950 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-19T20:41:03.950 INFO:teuthology.orchestra.run.smithi130.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-19T20:41:03.950 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-19T20:41:03.950 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-07-19T20:41:03.950 INFO:teuthology.orchestra.run.smithi130.stdout: automake-1.16.1-7.el8.noarch 2023-07-19T20:41:03.951 INFO:teuthology.orchestra.run.smithi130.stdout: bison-3.0.4-10.el8.x86_64 2023-07-19T20:41:03.951 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.951 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.951 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.951 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.951 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:41:03.951 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.952 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.952 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.952 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:41:03.952 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:41:03.952 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:41:03.952 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:41:03.952 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:41:03.952 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.953 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.953 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:41:03.953 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.953 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.953 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.953 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:41:03.953 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:41:03.953 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.954 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:41:03.954 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-19T20:41:03.954 INFO:teuthology.orchestra.run.smithi130.stdout: flex-2.6.1-9.el8.x86_64 2023-07-19T20:41:03.954 INFO:teuthology.orchestra.run.smithi130.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-19T20:41:03.954 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-19T20:41:03.954 INFO:teuthology.orchestra.run.smithi130.stdout: jq-1.6-7.el8.x86_64 2023-07-19T20:41:03.954 INFO:teuthology.orchestra.run.smithi130.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-19T20:41:03.954 INFO:teuthology.orchestra.run.smithi130.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-19T20:41:03.955 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-19T20:41:03.955 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.955 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.955 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.955 INFO:teuthology.orchestra.run.smithi130.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-19T20:41:03.955 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-19T20:41:03.955 INFO:teuthology.orchestra.run.smithi130.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-19T20:41:03.955 INFO:teuthology.orchestra.run.smithi130.stdout: libpq-13.5-1.el8.x86_64 2023-07-19T20:41:03.956 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-19T20:41:03.956 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-19T20:41:03.956 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.956 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.956 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-19T20:41:03.956 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.956 INFO:teuthology.orchestra.run.smithi130.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-19T20:41:03.957 INFO:teuthology.orchestra.run.smithi130.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-19T20:41:03.957 INFO:teuthology.orchestra.run.smithi130.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-19T20:41:03.957 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-19T20:41:03.957 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-19T20:41:03.957 INFO:teuthology.orchestra.run.smithi130.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-19T20:41:03.957 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-19T20:41:03.957 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-19T20:41:03.957 INFO:teuthology.orchestra.run.smithi130.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-19T20:41:03.958 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-19T20:41:03.958 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-19T20:41:03.958 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-19T20:41:03.958 INFO:teuthology.orchestra.run.smithi130.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-19T20:41:03.958 INFO:teuthology.orchestra.run.smithi130.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-19T20:41:03.958 INFO:teuthology.orchestra.run.smithi130.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-19T20:41:03.958 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-19T20:41:03.959 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-19T20:41:03.959 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-19T20:41:03.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-19T20:41:03.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-19T20:41:03.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-19T20:41:03.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-19T20:41:03.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-19T20:41:03.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-19T20:41:03.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-19T20:41:03.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-19T20:41:03.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-19T20:41:03.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-19T20:41:03.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-19T20:41:03.961 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-19T20:41:03.961 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-19T20:41:03.961 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-19T20:41:03.961 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-19T20:41:03.961 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-19T20:41:03.961 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-19T20:41:03.961 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-19T20:41:03.961 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-19T20:41:03.962 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-19T20:41:03.962 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-19T20:41:03.962 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-19T20:41:03.962 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-19T20:41:03.962 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-19T20:41:03.962 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-19T20:41:03.962 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-19T20:41:03.962 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-19T20:41:03.963 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend-2.6-1.el8.noarch 2023-07-19T20:41:03.963 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-19T20:41:03.963 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-19T20:41:03.963 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-19T20:41:03.963 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-19T20:41:03.963 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-19T20:41:03.963 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-19T20:41:03.964 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.964 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.964 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-19T20:41:03.964 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-19T20:41:03.964 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.964 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-19T20:41:03.964 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-19T20:41:03.964 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-19T20:41:03.965 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-19T20:41:03.965 INFO:teuthology.orchestra.run.smithi130.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-19T20:41:03.965 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-19T20:41:03.965 INFO:teuthology.orchestra.run.smithi130.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-19T20:41:03.965 INFO:teuthology.orchestra.run.smithi130.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-19T20:41:03.965 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-19T20:41:03.965 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-19T20:41:03.965 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-19T20:41:03.966 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-19T20:41:03.966 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-19T20:41:03.966 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.966 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.966 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:41:03.966 INFO:teuthology.orchestra.run.smithi130.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-19T20:41:03.966 INFO:teuthology.orchestra.run.smithi130.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-19T20:41:03.968 INFO:teuthology.orchestra.run.smithi130.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-19T20:41:03.969 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-19T20:41:03.969 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-19T20:41:03.970 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-19T20:41:03.970 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:41:03.970 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-07-19T20:41:04.058 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:18.1.2-35.g796ba272.el8. 31/160 2023-07-19T20:41:04.248 DEBUG:teuthology.parallel:result is None 2023-07-19T20:41:04.302 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:18.1.2-35.g796ba272.el8.x86_64 32/160 2023-07-19T20:41:05.253 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-19T20:41:05.555 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-19T20:41:05.861 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-19T20:41:06.040 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-19T20:41:07.782 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-19T20:41:08.093 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-19T20:41:08.283 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-19T20:41:08.491 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-19T20:41:08.720 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:18.1.2-35.g796ba272.el8.x86_64 40/160 2023-07-19T20:41:08.895 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:18.1.2-35.g796ba272.el8.x86_64 41/160 2023-07-19T20:41:09.055 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-19T20:41:09.271 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-19T20:41:09.497 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-19T20:41:09.613 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-19T20:41:10.089 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-19T20:41:10.163 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-19T20:41:10.283 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-19T20:41:10.447 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-19T20:41:10.906 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-19T20:41:11.189 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-19T20:41:11.204 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-19T20:41:11.367 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-19T20:41:11.633 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-19T20:41:11.853 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-19T20:41:12.043 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-19T20:41:12.190 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-19T20:41:12.362 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-19T20:41:12.583 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-19T20:41:12.765 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-19T20:41:12.917 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-19T20:41:13.102 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-19T20:41:13.266 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-19T20:41:13.428 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-19T20:41:13.621 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-19T20:41:13.788 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-19T20:41:14.031 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-19T20:41:14.246 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-19T20:41:14.489 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-19T20:41:14.817 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-19T20:41:15.096 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-19T20:41:15.307 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-19T20:41:16.122 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-19T20:41:16.295 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:18.1.2-35.g796ba272.el8.x86_64 70/160 2023-07-19T20:41:16.373 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:18.1.2-35.g796ba272.el8.x86_64 70/160 2023-07-19T20:41:16.642 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:18.1.2-35.g796ba272.el8.x86_64 71/160 2023-07-19T20:41:16.873 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-19T20:41:17.271 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-19T20:41:17.549 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-19T20:41:17.758 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-19T20:41:18.009 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-19T20:41:18.225 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-19T20:41:19.332 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-19T20:41:19.697 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-19T20:41:19.953 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-19T20:41:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-19T20:41:20.520 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-19T20:41:20.729 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-19T20:41:20.964 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-19T20:41:21.148 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-19T20:41:21.477 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-19T20:41:21.674 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-19T20:41:21.871 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-19T20:41:22.034 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-19T20:41:22.329 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-19T20:41:22.548 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-19T20:41:22.673 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-19T20:41:22.884 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-19T20:41:23.095 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-19T20:41:23.345 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-19T20:41:23.512 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-19T20:41:23.661 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-19T20:41:23.744 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-19T20:41:23.961 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-19T20:41:24.103 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-19T20:41:26.617 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 100/160 2023-07-19T20:41:26.860 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 100/160 2023-07-19T20:41:27.438 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 100/160 2023-07-19T20:41:27.762 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:18.1.2-35.g796ba272.el8.x86_64 101/160 2023-07-19T20:41:27.864 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:18.1.2-35.g796ba272.el8.x86_64 101/160 2023-07-19T20:41:28.018 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:18.1.2-35.g796ba272.el8.x86_64 102/160 2023-07-19T20:41:46.708 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:18.1.2-35.g796ba272.el8.x86_64 102/160 2023-07-19T20:41:46.708 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2023-07-19T20:41:46.709 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2023-07-19T20:41:46.709 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /dev 2023-07-19T20:41:46.709 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /run 2023-07-19T20:41:46.709 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2023-07-19T20:41:46.710 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2023-07-19T20:41:46.710 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2023-07-19T20:41:46.710 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2023-07-19T20:41:46.710 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /dev 2023-07-19T20:41:46.710 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:41:47.106 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:18.1.2-35.g796ba272.el8.noarch 103/160 2023-07-19T20:41:48.674 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:18.1.2-35.g796ba272.el8.noarch 103/160 2023-07-19T20:41:48.907 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:18.1.2-35.g796ba272.el8.x86_64 104/160 2023-07-19T20:41:49.126 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:18.1.2-35.g796ba272.el8.x86_64 104/160 2023-07-19T20:41:49.347 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:18.1.2-35.g796ba272.el8.x86_64 105/160 2023-07-19T20:41:49.801 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:18.1.2-35.g796ba272.el8.x86_64 105/160 2023-07-19T20:41:50.014 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:18.1.2-35.g796ba272.el8.x86_64 106/160 2023-07-19T20:41:50.037 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:18.1.2-35.g796ba272.el8.x86_64 106/160 2023-07-19T20:41:50.253 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-19T20:41:50.432 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-19T20:41:50.580 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-19T20:41:50.657 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-19T20:41:50.948 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-19T20:41:51.205 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-19T20:41:51.690 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:18.1.2-35.g796ba272.el8.noarch 112/160 2023-07-19T20:41:51.851 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:18.1.2-35.g796ba272.el8.noarch 112/160 2023-07-19T20:41:51.977 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:18.1.2-35.g796ba272.el8 113/160 2023-07-19T20:41:52.191 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:18.1.2-35.g796ba272.el 114/160 2023-07-19T20:41:52.421 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:18.1.2-35.g796ba272.el8.noarc 115/160 2023-07-19T20:41:52.628 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.1.2-35.g796ba272.el8.noarc 115/160 2023-07-19T20:41:52.831 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:18.1.2-35.g796ba272.el8.noa 116/160 2023-07-19T20:41:53.793 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.1.2-35.g796ba272.el8.noa 116/160 2023-07-19T20:41:53.970 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:18.1.2-35.g796ba 117/160 2023-07-19T20:41:54.062 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.1.2-35.g796ba 117/160 2023-07-19T20:41:54.442 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:18.1.2-35.g796ba272.el8. 118/160 2023-07-19T20:41:54.689 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:18.1.2-35.g796ba272.el8.x86_64 119/160 2023-07-19T20:41:54.725 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:18.1.2-35.g796ba272.el8.x86_64 119/160 2023-07-19T20:41:54.904 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:18.1.2-35.g796ba272.el8.noarch 120/160 2023-07-19T20:41:54.915 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:18.1.2-35.g796ba272.el8.noarch 120/160 2023-07-19T20:41:55.123 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:18.1.2-35.g796ba272.el8.x86_64 121/160 2023-07-19T20:41:55.310 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-19T20:41:59.716 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-19T20:42:01.145 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:18.1.2-35.g796ba272.el8.x86_64 123/160 2023-07-19T20:42:01.363 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:18.1.2-35.g796ba272.el8.x86_64 124/160 2023-07-19T20:42:01.397 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:18.1.2-35.g796ba272.el8.x86_64 124/160 2023-07-19T20:42:01.552 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:18.1.2-35.g796ba27 125/160 2023-07-19T20:42:01.594 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.1.2-35.g796ba27 125/160 2023-07-19T20:42:01.760 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-mirror-2:18.1.2-35.g796ba272.el8.x86_64 126/160 2023-07-19T20:42:02.106 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephfs-mirror-2:18.1.2-35.g796ba272.el8.x86_64 126/160 2023-07-19T20:42:02.351 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:18.1.2-35.g796ba272.el8.x86_64 127/160 2023-07-19T20:42:02.553 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:18.1.2-35.g796ba272.el8.x86_64 127/160 2023-07-19T20:42:02.891 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-19T20:42:03.749 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:18.1.2-35.g796ba272.el8.x86_64 129/160 2023-07-19T20:42:04.023 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-19T20:42:04.240 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-19T20:42:04.429 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-19T20:42:04.583 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-19T20:42:04.786 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:18.1.2-35.g796ba272.el8.x86_64 134/160 2023-07-19T20:42:05.755 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-19T20:42:06.018 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-19T20:42:06.064 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-19T20:42:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-19T20:42:06.492 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-top-2:18.1.2-35.g796ba272.el8.noarch 137/160 2023-07-19T20:42:06.709 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:18.1.2-35.g796ba272.el8.x86_64 138/160 2023-07-19T20:42:06.989 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:18.1.2-35.g796ba272.el8.x86_64 139/160 2023-07-19T20:42:07.295 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-19T20:42:07.434 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-19T20:42:07.449 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-19T20:42:07.603 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-19T20:42:07.867 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-19T20:42:07.942 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-19T20:42:08.201 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-19T20:42:08.213 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-19T20:42:08.402 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-19T20:42:08.545 INFO:teuthology.orchestra.run.smithi124.stdout:[MIRROR] python3-asyncssh-2.7.0-2.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-asyncssh-2.7.0-2.el8.noarch.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-19T20:42:08.545 INFO:teuthology.orchestra.run.smithi124.stdout:[MIRROR] python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-19T20:42:08.588 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-19T20:42:08.787 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-19T20:42:08.787 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-19T20:42:08.886 INFO:teuthology.orchestra.run.smithi124.stdout:(143/144): python3-bcrypt-3.1.6-2.el8.1.x86_64. 341 B/s | 44 kB 02:10 2023-07-19T20:42:09.029 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-19T20:42:09.029 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-19T20:42:09.277 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-19T20:42:09.282 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-19T20:42:09.379 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-19T20:42:09.379 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-19T20:42:09.623 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-19T20:42:09.836 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-19T20:42:10.002 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-19T20:42:10.152 INFO:teuthology.orchestra.run.smithi124.stdout:(144/144): python3-asyncssh-2.7.0-2.el8.noarch. 3.6 kB/s | 476 kB 02:12 2023-07-19T20:42:10.153 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-07-19T20:42:10.154 INFO:teuthology.orchestra.run.smithi124.stdout:Total 776 kB/s | 210 MB 04:36 2023-07-19T20:42:10.261 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-19T20:42:10.261 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-19T20:42:10.478 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-19T20:42:10.478 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-19T20:42:10.719 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-19T20:42:10.720 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-19T20:42:10.911 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-19T20:42:10.912 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-19T20:42:11.023 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-07-19T20:42:11.152 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-19T20:42:11.153 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-19T20:42:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-19T20:42:11.380 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-07-19T20:42:11.380 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-07-19T20:42:11.575 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-19T20:42:12.162 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-19T20:42:12.162 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:18.1.2-35.g796ba272.el8.x86_64 1/160 2023-07-19T20:42:12.162 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:18.1.2-35.g796ba272.el8.x86_64 2/160 2023-07-19T20:42:12.162 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 3/160 2023-07-19T20:42:12.162 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:18.1.2-35.g796ba272.el8.x86_64 4/160 2023-07-19T20:42:12.162 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:18.1.2-35.g796ba27 5/160 2023-07-19T20:42:12.163 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:18.1.2-35.g796ba272.el8.x86_64 6/160 2023-07-19T20:42:12.163 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:18.1.2-35.g796ba272.el8.x86_64 7/160 2023-07-19T20:42:12.163 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:18.1.2-35.g796ba272.el8.x86_64 8/160 2023-07-19T20:42:12.163 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:18.1.2-35.g796ba272.el8.x86_64 9/160 2023-07-19T20:42:12.163 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:18.1.2-35.g796ba272.el8.x86_64 10/160 2023-07-19T20:42:12.163 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:18.1.2-35.g796ba272.el8.x86_64 11/160 2023-07-19T20:42:12.163 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:18.1.2-35.g796ba272.el8.x86_64 12/160 2023-07-19T20:42:12.163 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-mirror-2:18.1.2-35.g796ba272.el8.x86_64 13/160 2023-07-19T20:42:12.164 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:18.1.2-35.g796ba272.el8.x86_64 14/160 2023-07-19T20:42:12.164 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:18.1.2-35.g796ba272.el8.x86_64 15/160 2023-07-19T20:42:12.164 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:18.1.2-35.g796ba272.el8.x86_64 16/160 2023-07-19T20:42:12.164 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:18.1.2-35.g796ba272.el8.x86_64 17/160 2023-07-19T20:42:12.164 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:18.1.2-35.g796ba272.el8.x86_6 18/160 2023-07-19T20:42:12.164 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:18.1.2-35.g796ba272.el8.x86_64 19/160 2023-07-19T20:42:12.164 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:18.1.2-35.g796ba272.el8. 20/160 2023-07-19T20:42:12.165 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:18.1.2-35.g796ba272.el8.x8 21/160 2023-07-19T20:42:12.165 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:18.1.2-35.g796ba272.el8.x86_64 22/160 2023-07-19T20:42:12.166 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:18.1.2-35.g796ba272.el8.x86_64 23/160 2023-07-19T20:42:12.166 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:18.1.2-35.g796ba272.el8.x86_64 24/160 2023-07-19T20:42:12.166 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:18.1.2-35.g796ba272.el8.x86_64 25/160 2023-07-19T20:42:12.166 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:18.1.2-35.g796ba272.el8.x86_64 26/160 2023-07-19T20:42:12.166 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:18.1.2-35.g796ba272.el8.x86_64 27/160 2023-07-19T20:42:12.166 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:18.1.2-35.g796ba272.el8.x86_64 28/160 2023-07-19T20:42:12.167 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:18.1.2-35.g796ba272.el 29/160 2023-07-19T20:42:12.167 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:18.1.2-35.g796ba272.el8.noarc 30/160 2023-07-19T20:42:12.167 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:18.1.2-35.g796ba272.el8.noa 31/160 2023-07-19T20:42:12.167 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.1.2-35.g796ba 32/160 2023-07-19T20:42:12.176 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:18.1.2-35.g796ba272.el8. 33/160 2023-07-19T20:42:12.176 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:18.1.2-35.g796ba272.el8.noarch 34/160 2023-07-19T20:42:12.176 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:18.1.2-35.g796ba272.el8 35/160 2023-07-19T20:42:12.176 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:18.1.2-35.g796ba272.el8.noarch 36/160 2023-07-19T20:42:12.177 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:18.1.2-35.g796ba272.el8.noarch 37/160 2023-07-19T20:42:12.177 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-top-2:18.1.2-35.g796ba272.el8.noarch 38/160 2023-07-19T20:42:12.177 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-19T20:42:12.177 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-19T20:42:12.177 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-19T20:42:12.177 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-19T20:42:12.177 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-19T20:42:12.177 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-19T20:42:12.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-19T20:42:12.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-19T20:42:12.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-19T20:42:12.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-19T20:42:12.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-19T20:42:12.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-19T20:42:12.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-19T20:42:12.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-19T20:42:12.179 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-19T20:42:12.179 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-19T20:42:12.179 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-19T20:42:12.179 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-19T20:42:12.179 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-19T20:42:12.179 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-19T20:42:12.179 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-19T20:42:12.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-19T20:42:12.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-19T20:42:12.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-19T20:42:12.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-19T20:42:12.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-19T20:42:12.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-19T20:42:12.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-19T20:42:12.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-19T20:42:12.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-19T20:42:12.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-19T20:42:12.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-19T20:42:12.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-19T20:42:12.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-19T20:42:12.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-19T20:42:12.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-19T20:42:12.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-19T20:42:12.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-19T20:42:12.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-19T20:42:12.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-19T20:42:12.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-19T20:42:12.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-19T20:42:12.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-19T20:42:12.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-19T20:42:12.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-19T20:42:12.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-19T20:42:12.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-19T20:42:12.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-19T20:42:12.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-19T20:42:12.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-19T20:42:12.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-19T20:42:12.184 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-19T20:42:12.184 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-19T20:42:12.184 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-19T20:42:12.184 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-19T20:42:12.184 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-19T20:42:12.184 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-19T20:42:12.184 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-19T20:42:12.184 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-19T20:42:12.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-19T20:42:12.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-19T20:42:12.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-19T20:42:12.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-19T20:42:12.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-19T20:42:12.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-19T20:42:12.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-19T20:42:12.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-19T20:42:12.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-19T20:42:12.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-19T20:42:12.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-19T20:42:12.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-19T20:42:12.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-19T20:42:12.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-19T20:42:12.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-19T20:42:12.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-19T20:42:12.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-19T20:42:12.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-19T20:42:12.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-19T20:42:12.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-19T20:42:12.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-19T20:42:12.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-19T20:42:12.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-19T20:42:12.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-19T20:42:12.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-19T20:42:12.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-19T20:42:12.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-19T20:42:12.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-19T20:42:12.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-19T20:42:12.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-19T20:42:12.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-19T20:42:12.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:18.1.2-35.g796ba272.el8.x86_64 129/160 2023-07-19T20:42:12.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-19T20:42:12.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:18.1.2-35.g796ba272.el8.x86_64 131/160 2023-07-19T20:42:12.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-19T20:42:12.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-19T20:42:12.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-19T20:42:12.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-19T20:42:12.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-19T20:42:12.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-19T20:42:12.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-19T20:42:12.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-19T20:42:12.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-19T20:42:12.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-19T20:42:12.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-19T20:42:12.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-19T20:42:12.191 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-19T20:42:12.191 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-19T20:42:12.191 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-19T20:42:12.191 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-19T20:42:12.191 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-19T20:42:12.191 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-19T20:42:12.191 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-19T20:42:12.191 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-19T20:42:12.192 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-19T20:42:12.192 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-19T20:42:12.192 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-19T20:42:12.192 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-19T20:42:12.192 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-19T20:42:12.192 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-19T20:42:12.192 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-19T20:42:12.192 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-19T20:42:12.527 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-07-19T20:42:12.531 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-07-19T20:42:14.355 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-19T20:42:14.356 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:42:14.356 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2023-07-19T20:42:14.357 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-19T20:42:14.357 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-19T20:42:14.357 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-19T20:42:14.357 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-19T20:42:14.357 INFO:teuthology.orchestra.run.smithi117.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-19T20:42:14.357 INFO:teuthology.orchestra.run.smithi117.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-19T20:42:14.358 INFO:teuthology.orchestra.run.smithi117.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-19T20:42:14.358 INFO:teuthology.orchestra.run.smithi117.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-19T20:42:14.358 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.358 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.358 INFO:teuthology.orchestra.run.smithi117.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-19T20:42:14.358 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-19T20:42:14.358 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-19T20:42:14.359 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-19T20:42:14.359 INFO:teuthology.orchestra.run.smithi117.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-19T20:42:14.359 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-19T20:42:14.359 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2023-07-19T20:42:14.359 INFO:teuthology.orchestra.run.smithi117.stdout: automake-1.16.1-7.el8.noarch 2023-07-19T20:42:14.359 INFO:teuthology.orchestra.run.smithi117.stdout: bison-3.0.4-10.el8.x86_64 2023-07-19T20:42:14.359 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.360 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.360 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.360 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.360 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:42:14.360 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.360 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.360 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.361 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:42:14.361 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:42:14.361 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:42:14.362 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:42:14.362 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:42:14.362 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.362 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.362 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:42:14.362 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.362 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.363 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.363 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:42:14.363 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:42:14.363 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.363 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:42:14.363 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-19T20:42:14.363 INFO:teuthology.orchestra.run.smithi117.stdout: flex-2.6.1-9.el8.x86_64 2023-07-19T20:42:14.364 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-19T20:42:14.364 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-19T20:42:14.364 INFO:teuthology.orchestra.run.smithi117.stdout: jq-1.6-7.el8.x86_64 2023-07-19T20:42:14.364 INFO:teuthology.orchestra.run.smithi117.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-19T20:42:14.364 INFO:teuthology.orchestra.run.smithi117.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-19T20:42:14.364 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-19T20:42:14.364 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.365 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.365 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.365 INFO:teuthology.orchestra.run.smithi117.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-19T20:42:14.365 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-19T20:42:14.365 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-19T20:42:14.365 INFO:teuthology.orchestra.run.smithi117.stdout: libpq-13.5-1.el8.x86_64 2023-07-19T20:42:14.365 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-19T20:42:14.366 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-19T20:42:14.366 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.366 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.366 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-19T20:42:14.366 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.366 INFO:teuthology.orchestra.run.smithi117.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-19T20:42:14.366 INFO:teuthology.orchestra.run.smithi117.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-19T20:42:14.367 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-19T20:42:14.367 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-19T20:42:14.367 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-19T20:42:14.367 INFO:teuthology.orchestra.run.smithi117.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-19T20:42:14.367 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-19T20:42:14.367 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-19T20:42:14.367 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-19T20:42:14.368 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-19T20:42:14.368 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-19T20:42:14.368 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-19T20:42:14.368 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-19T20:42:14.368 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-19T20:42:14.368 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-19T20:42:14.368 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-19T20:42:14.369 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-19T20:42:14.369 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-19T20:42:14.369 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-19T20:42:14.369 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-19T20:42:14.369 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-19T20:42:14.369 INFO:teuthology.orchestra.run.smithi117.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-19T20:42:14.369 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-19T20:42:14.369 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.370 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.370 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.370 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-19T20:42:14.370 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-19T20:42:14.370 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-19T20:42:14.370 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-19T20:42:14.370 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-19T20:42:14.371 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-19T20:42:14.371 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-19T20:42:14.371 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-19T20:42:14.371 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-19T20:42:14.371 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-19T20:42:14.371 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-19T20:42:14.372 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-19T20:42:14.372 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-19T20:42:14.372 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-19T20:42:14.372 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-19T20:42:14.373 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-19T20:42:14.373 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-19T20:42:14.373 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-19T20:42:14.373 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-19T20:42:14.373 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-19T20:42:14.373 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-19T20:42:14.373 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-19T20:42:14.374 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-2.6-1.el8.noarch 2023-07-19T20:42:14.374 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-19T20:42:14.374 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-19T20:42:14.374 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-19T20:42:14.374 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-19T20:42:14.374 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-19T20:42:14.374 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-19T20:42:14.375 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.375 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.375 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-19T20:42:14.375 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-19T20:42:14.375 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.375 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-19T20:42:14.375 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-19T20:42:14.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-19T20:42:14.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-19T20:42:14.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-19T20:42:14.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-19T20:42:14.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-19T20:42:14.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-19T20:42:14.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-19T20:42:14.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-19T20:42:14.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-19T20:42:14.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-19T20:42:14.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-19T20:42:14.377 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.377 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.377 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:42:14.378 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-19T20:42:14.378 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-19T20:42:14.378 INFO:teuthology.orchestra.run.smithi117.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-19T20:42:14.378 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-19T20:42:14.378 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-19T20:42:14.379 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-19T20:42:14.379 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:42:14.379 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2023-07-19T20:42:14.595 DEBUG:teuthology.parallel:result is None 2023-07-19T20:42:18.155 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-07-19T20:42:18.331 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-19T20:42:18.532 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-19T20:42:18.653 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-19T20:42:18.728 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-19T20:42:18.903 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-19T20:42:18.972 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-19T20:42:19.151 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-19T20:42:19.383 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-19T20:42:19.555 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-19T20:42:19.745 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-19T20:42:20.141 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-19T20:42:20.311 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : librados2-2:18.1.2-35.g796ba272.el8.x86_64 8/160 2023-07-19T20:42:20.704 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librados2-2:18.1.2-35.g796ba272.el8.x86_64 8/160 2023-07-19T20:42:20.853 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : librbd1-2:18.1.2-35.g796ba272.el8.x86_64 9/160 2023-07-19T20:42:21.012 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librbd1-2:18.1.2-35.g796ba272.el8.x86_64 9/160 2023-07-19T20:42:21.186 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcephfs2-2:18.1.2-35.g796ba272.el8.x86_64 10/160 2023-07-19T20:42:21.283 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libcephfs2-2:18.1.2-35.g796ba272.el8.x86_64 10/160 2023-07-19T20:42:21.542 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rados-2:18.1.2-35.g796ba272.el8.x86_64 11/160 2023-07-19T20:42:21.670 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-19T20:42:21.877 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-19T20:42:22.086 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-19T20:42:22.197 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-19T20:42:22.416 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-19T20:42:22.684 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-19T20:42:23.045 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-19T20:42:23.256 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-19T20:42:23.436 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcephsqlite-2:18.1.2-35.g796ba272.el8.x86_64 18/160 2023-07-19T20:42:23.542 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libcephsqlite-2:18.1.2-35.g796ba272.el8.x86_64 18/160 2023-07-19T20:42:23.677 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libradosstriper1-2:18.1.2-35.g796ba272.el8.x86_6 19/160 2023-07-19T20:42:23.798 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libradosstriper1-2:18.1.2-35.g796ba272.el8.x86_6 19/160 2023-07-19T20:42:23.992 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-19T20:42:24.132 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-19T20:42:24.294 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-19T20:42:24.431 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-19T20:42:24.577 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-19T20:42:25.206 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-19T20:42:25.378 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-19T20:42:26.022 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-19T20:42:26.169 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-19T20:42:26.845 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-19T20:42:27.214 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-19T20:42:27.416 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-19T20:42:27.623 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-19T20:42:27.820 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-19T20:42:28.050 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-ceph-common-2:18.1.2-35.g796ba272.el8.x8 30/160 2023-07-19T20:42:28.179 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-ceph-argparse-2:18.1.2-35.g796ba272.el8. 31/160 2023-07-19T20:42:28.450 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cephfs-2:18.1.2-35.g796ba272.el8.x86_64 32/160 2023-07-19T20:42:29.448 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-19T20:42:29.811 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-19T20:42:30.116 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-19T20:42:30.303 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-19T20:42:32.062 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-19T20:42:32.356 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-19T20:42:32.562 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-19T20:42:32.795 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-19T20:42:33.007 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rbd-2:18.1.2-35.g796ba272.el8.x86_64 40/160 2023-07-19T20:42:33.166 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librados-devel-2:18.1.2-35.g796ba272.el8.x86_64 41/160 2023-07-19T20:42:33.401 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-19T20:42:33.592 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-19T20:42:33.844 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-19T20:42:33.904 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-19T20:42:34.076 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-19T20:42:34.139 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-19T20:42:34.296 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-19T20:42:34.460 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-19T20:42:34.923 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-19T20:42:35.203 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-19T20:42:35.218 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-19T20:42:35.379 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-19T20:42:35.661 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-19T20:42:35.908 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-19T20:42:36.047 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-19T20:42:36.196 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-19T20:42:36.409 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-19T20:42:36.604 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-19T20:42:36.827 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-19T20:42:36.979 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-19T20:42:37.173 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-19T20:42:37.345 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-19T20:42:37.557 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-19T20:42:37.717 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-19T20:42:37.882 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-19T20:42:38.114 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-19T20:42:38.380 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-19T20:42:38.590 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-19T20:42:38.914 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-19T20:42:39.193 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-19T20:42:39.384 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-19T20:42:40.184 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-19T20:42:40.609 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librgw2-2:18.1.2-35.g796ba272.el8.x86_64 70/160 2023-07-19T20:42:40.892 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librgw2-2:18.1.2-35.g796ba272.el8.x86_64 70/160 2023-07-19T20:42:41.099 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rgw-2:18.1.2-35.g796ba272.el8.x86_64 71/160 2023-07-19T20:42:41.356 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-19T20:42:41.706 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-19T20:42:41.954 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-19T20:42:42.210 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-19T20:42:42.442 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-19T20:42:42.714 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-19T20:42:43.835 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-19T20:42:44.186 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-19T20:42:44.383 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-19T20:42:44.576 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-19T20:42:44.866 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-19T20:42:45.134 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-19T20:42:45.360 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-19T20:42:45.578 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-19T20:42:45.875 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-19T20:42:46.105 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-19T20:42:46.268 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-19T20:42:46.431 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-19T20:42:46.765 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-19T20:42:46.987 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-19T20:42:47.171 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-19T20:42:47.368 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-19T20:42:47.635 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-19T20:42:47.835 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-19T20:42:48.068 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-19T20:42:48.225 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-19T20:42:48.356 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-19T20:42:48.525 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-19T20:42:48.650 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-19T20:42:51.177 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 100/160 2023-07-19T20:42:51.725 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 100/160 2023-07-19T20:42:52.310 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 100/160 2023-07-19T20:42:52.635 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-base-2:18.1.2-35.g796ba272.el8.x86_64 101/160 2023-07-19T20:42:52.741 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-base-2:18.1.2-35.g796ba272.el8.x86_64 101/160 2023-07-19T20:42:52.899 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-selinux-2:18.1.2-35.g796ba272.el8.x86_64 102/160 2023-07-19T20:43:12.096 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-selinux-2:18.1.2-35.g796ba272.el8.x86_64 102/160 2023-07-19T20:43:12.096 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /sys 2023-07-19T20:43:12.096 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /proc 2023-07-19T20:43:12.096 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /dev 2023-07-19T20:43:12.096 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /run 2023-07-19T20:43:12.097 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /mnt 2023-07-19T20:43:12.097 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /var/tmp 2023-07-19T20:43:12.097 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /home 2023-07-19T20:43:12.097 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /tmp 2023-07-19T20:43:12.098 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /dev 2023-07-19T20:43:12.098 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:12.505 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-volume-2:18.1.2-35.g796ba272.el8.noarch 103/160 2023-07-19T20:43:14.069 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-volume-2:18.1.2-35.g796ba272.el8.noarch 103/160 2023-07-19T20:43:14.298 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-osd-2:18.1.2-35.g796ba272.el8.x86_64 104/160 2023-07-19T20:43:14.517 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-osd-2:18.1.2-35.g796ba272.el8.x86_64 104/160 2023-07-19T20:43:14.721 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mds-2:18.1.2-35.g796ba272.el8.x86_64 105/160 2023-07-19T20:43:15.176 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mds-2:18.1.2-35.g796ba272.el8.x86_64 105/160 2023-07-19T20:43:15.388 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mon-2:18.1.2-35.g796ba272.el8.x86_64 106/160 2023-07-19T20:43:15.411 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mon-2:18.1.2-35.g796ba272.el8.x86_64 106/160 2023-07-19T20:43:15.636 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-19T20:43:15.832 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-19T20:43:16.004 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-19T20:43:16.083 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-19T20:43:16.524 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-19T20:43:16.805 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-19T20:43:17.283 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: cephadm-2:18.1.2-35.g796ba272.el8.noarch 112/160 2023-07-19T20:43:17.451 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : cephadm-2:18.1.2-35.g796ba272.el8.noarch 112/160 2023-07-19T20:43:17.602 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-prometheus-alerts-2:18.1.2-35.g796ba272.el8 113/160 2023-07-19T20:43:17.778 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-grafana-dashboards-2:18.1.2-35.g796ba272.el 114/160 2023-07-19T20:43:18.045 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-cephadm-2:18.1.2-35.g796ba272.el8.noarc 115/160 2023-07-19T20:43:18.256 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.1.2-35.g796ba272.el8.noarc 115/160 2023-07-19T20:43:18.514 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-dashboard-2:18.1.2-35.g796ba272.el8.noa 116/160 2023-07-19T20:43:19.478 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.1.2-35.g796ba272.el8.noa 116/160 2023-07-19T20:43:19.712 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-diskprediction-local-2:18.1.2-35.g796ba 117/160 2023-07-19T20:43:19.804 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.1.2-35.g796ba 117/160 2023-07-19T20:43:20.166 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-modules-core-2:18.1.2-35.g796ba272.el8. 118/160 2023-07-19T20:43:20.372 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-2:18.1.2-35.g796ba272.el8.x86_64 119/160 2023-07-19T20:43:20.410 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-2:18.1.2-35.g796ba272.el8.x86_64 119/160 2023-07-19T20:43:20.653 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-rook-2:18.1.2-35.g796ba272.el8.noarch 120/160 2023-07-19T20:43:20.664 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-rook-2:18.1.2-35.g796ba272.el8.noarch 120/160 2023-07-19T20:43:20.839 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-2:18.1.2-35.g796ba272.el8.x86_64 121/160 2023-07-19T20:43:21.043 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-19T20:43:25.437 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-19T20:43:26.832 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-test-2:18.1.2-35.g796ba272.el8.x86_64 123/160 2023-07-19T20:43:27.022 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-radosgw-2:18.1.2-35.g796ba272.el8.x86_64 124/160 2023-07-19T20:43:27.056 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-radosgw-2:18.1.2-35.g796ba272.el8.x86_64 124/160 2023-07-19T20:43:27.236 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-immutable-object-cache-2:18.1.2-35.g796ba27 125/160 2023-07-19T20:43:27.278 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.1.2-35.g796ba27 125/160 2023-07-19T20:43:27.519 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : cephfs-mirror-2:18.1.2-35.g796ba272.el8.x86_64 126/160 2023-07-19T20:43:27.864 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: cephfs-mirror-2:18.1.2-35.g796ba272.el8.x86_64 126/160 2023-07-19T20:43:28.109 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : rbd-mirror-2:18.1.2-35.g796ba272.el8.x86_64 127/160 2023-07-19T20:43:28.311 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: rbd-mirror-2:18.1.2-35.g796ba272.el8.x86_64 127/160 2023-07-19T20:43:28.633 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-19T20:43:29.547 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-fuse-2:18.1.2-35.g796ba272.el8.x86_64 129/160 2023-07-19T20:43:29.807 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-19T20:43:30.024 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-19T20:43:30.213 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-19T20:43:30.356 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-19T20:43:30.545 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcephfs-devel-2:18.1.2-35.g796ba272.el8.x86_64 134/160 2023-07-19T20:43:31.566 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-19T20:43:31.836 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-19T20:43:31.882 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-19T20:43:32.140 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-19T20:43:32.310 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : cephfs-top-2:18.1.2-35.g796ba272.el8.noarch 137/160 2023-07-19T20:43:32.551 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : rbd-fuse-2:18.1.2-35.g796ba272.el8.x86_64 138/160 2023-07-19T20:43:32.881 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : rbd-nbd-2:18.1.2-35.g796ba272.el8.x86_64 139/160 2023-07-19T20:43:33.137 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-19T20:43:33.352 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-19T20:43:33.371 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-19T20:43:33.545 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-19T20:43:33.810 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-19T20:43:33.884 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-19T20:43:34.127 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-19T20:43:34.139 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-19T20:43:34.320 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-19T20:43:34.547 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-19T20:43:34.697 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-19T20:43:34.697 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-19T20:43:34.955 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-19T20:43:34.955 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-19T20:43:35.162 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-19T20:43:35.167 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-19T20:43:35.271 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-19T20:43:35.272 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-19T20:43:35.532 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-19T20:43:35.729 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-19T20:43:35.869 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-19T20:43:36.078 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-19T20:43:36.078 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-19T20:43:36.348 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-19T20:43:36.350 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-19T20:43:36.587 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-19T20:43:36.587 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-19T20:43:36.763 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-19T20:43:36.764 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-19T20:43:36.968 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-19T20:43:36.968 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-19T20:43:37.154 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-19T20:43:37.343 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-19T20:43:37.971 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-19T20:43:37.972 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-2:18.1.2-35.g796ba272.el8.x86_64 1/160 2023-07-19T20:43:37.972 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-base-2:18.1.2-35.g796ba272.el8.x86_64 2/160 2023-07-19T20:43:37.972 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 3/160 2023-07-19T20:43:37.972 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-fuse-2:18.1.2-35.g796ba272.el8.x86_64 4/160 2023-07-19T20:43:37.972 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-immutable-object-cache-2:18.1.2-35.g796ba27 5/160 2023-07-19T20:43:37.972 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mds-2:18.1.2-35.g796ba272.el8.x86_64 6/160 2023-07-19T20:43:37.973 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-2:18.1.2-35.g796ba272.el8.x86_64 7/160 2023-07-19T20:43:37.973 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mon-2:18.1.2-35.g796ba272.el8.x86_64 8/160 2023-07-19T20:43:37.973 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-osd-2:18.1.2-35.g796ba272.el8.x86_64 9/160 2023-07-19T20:43:37.973 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-radosgw-2:18.1.2-35.g796ba272.el8.x86_64 10/160 2023-07-19T20:43:37.973 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-selinux-2:18.1.2-35.g796ba272.el8.x86_64 11/160 2023-07-19T20:43:37.973 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-test-2:18.1.2-35.g796ba272.el8.x86_64 12/160 2023-07-19T20:43:37.973 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : cephfs-mirror-2:18.1.2-35.g796ba272.el8.x86_64 13/160 2023-07-19T20:43:37.973 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcephfs-devel-2:18.1.2-35.g796ba272.el8.x86_64 14/160 2023-07-19T20:43:37.974 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcephfs2-2:18.1.2-35.g796ba272.el8.x86_64 15/160 2023-07-19T20:43:37.974 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcephsqlite-2:18.1.2-35.g796ba272.el8.x86_64 16/160 2023-07-19T20:43:37.974 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librados-devel-2:18.1.2-35.g796ba272.el8.x86_64 17/160 2023-07-19T20:43:37.974 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libradosstriper1-2:18.1.2-35.g796ba272.el8.x86_6 18/160 2023-07-19T20:43:37.974 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librgw2-2:18.1.2-35.g796ba272.el8.x86_64 19/160 2023-07-19T20:43:37.974 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-ceph-argparse-2:18.1.2-35.g796ba272.el8. 20/160 2023-07-19T20:43:37.974 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-ceph-common-2:18.1.2-35.g796ba272.el8.x8 21/160 2023-07-19T20:43:37.975 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cephfs-2:18.1.2-35.g796ba272.el8.x86_64 22/160 2023-07-19T20:43:37.975 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rados-2:18.1.2-35.g796ba272.el8.x86_64 23/160 2023-07-19T20:43:37.975 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rbd-2:18.1.2-35.g796ba272.el8.x86_64 24/160 2023-07-19T20:43:37.975 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rgw-2:18.1.2-35.g796ba272.el8.x86_64 25/160 2023-07-19T20:43:37.975 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : rbd-fuse-2:18.1.2-35.g796ba272.el8.x86_64 26/160 2023-07-19T20:43:37.975 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : rbd-mirror-2:18.1.2-35.g796ba272.el8.x86_64 27/160 2023-07-19T20:43:37.975 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : rbd-nbd-2:18.1.2-35.g796ba272.el8.x86_64 28/160 2023-07-19T20:43:37.975 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-grafana-dashboards-2:18.1.2-35.g796ba272.el 29/160 2023-07-19T20:43:37.976 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-cephadm-2:18.1.2-35.g796ba272.el8.noarc 30/160 2023-07-19T20:43:37.984 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-dashboard-2:18.1.2-35.g796ba272.el8.noa 31/160 2023-07-19T20:43:37.984 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.1.2-35.g796ba 32/160 2023-07-19T20:43:37.984 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-modules-core-2:18.1.2-35.g796ba272.el8. 33/160 2023-07-19T20:43:37.984 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-rook-2:18.1.2-35.g796ba272.el8.noarch 34/160 2023-07-19T20:43:37.984 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-prometheus-alerts-2:18.1.2-35.g796ba272.el8 35/160 2023-07-19T20:43:37.985 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-volume-2:18.1.2-35.g796ba272.el8.noarch 36/160 2023-07-19T20:43:37.985 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : cephadm-2:18.1.2-35.g796ba272.el8.noarch 37/160 2023-07-19T20:43:37.985 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : cephfs-top-2:18.1.2-35.g796ba272.el8.noarch 38/160 2023-07-19T20:43:37.985 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-19T20:43:37.985 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-19T20:43:37.985 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-19T20:43:37.985 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-19T20:43:37.985 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-19T20:43:37.986 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-19T20:43:37.986 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-19T20:43:37.986 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-19T20:43:37.986 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-19T20:43:37.986 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-19T20:43:37.987 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-19T20:43:37.987 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-19T20:43:37.987 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-19T20:43:37.987 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-19T20:43:37.987 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-19T20:43:37.987 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-19T20:43:37.987 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-19T20:43:37.987 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-19T20:43:37.988 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-19T20:43:37.988 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-19T20:43:37.988 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-19T20:43:37.988 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-19T20:43:37.988 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-19T20:43:37.988 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-19T20:43:37.988 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-19T20:43:37.988 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-19T20:43:37.989 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-19T20:43:37.989 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-19T20:43:37.989 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-19T20:43:37.989 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-19T20:43:37.989 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-19T20:43:37.989 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-19T20:43:37.989 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-19T20:43:37.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-19T20:43:37.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-19T20:43:37.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-19T20:43:37.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-19T20:43:37.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-19T20:43:37.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-19T20:43:37.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-19T20:43:37.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-19T20:43:37.991 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-19T20:43:37.991 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-19T20:43:37.991 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-19T20:43:37.991 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-19T20:43:37.991 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-19T20:43:37.991 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-19T20:43:37.991 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-19T20:43:37.991 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-19T20:43:37.992 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-19T20:43:37.992 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-19T20:43:37.992 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-19T20:43:37.992 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-19T20:43:37.992 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-19T20:43:37.992 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-19T20:43:37.992 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-19T20:43:37.992 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-19T20:43:37.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-19T20:43:37.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-19T20:43:37.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-19T20:43:37.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-19T20:43:37.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-19T20:43:37.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-19T20:43:37.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-19T20:43:37.993 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-19T20:43:37.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-19T20:43:37.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-19T20:43:37.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-19T20:43:37.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-19T20:43:37.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-19T20:43:37.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-19T20:43:37.994 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-19T20:43:37.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-19T20:43:37.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-19T20:43:37.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-19T20:43:37.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-19T20:43:37.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-19T20:43:37.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-19T20:43:37.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-19T20:43:37.995 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-19T20:43:37.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-19T20:43:37.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-19T20:43:37.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-19T20:43:37.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-19T20:43:37.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-19T20:43:37.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-19T20:43:37.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-19T20:43:37.996 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-19T20:43:37.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-19T20:43:37.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-19T20:43:37.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librados2-2:18.1.2-35.g796ba272.el8.x86_64 129/160 2023-07-19T20:43:37.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-19T20:43:37.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librbd1-2:18.1.2-35.g796ba272.el8.x86_64 131/160 2023-07-19T20:43:37.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-19T20:43:37.997 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-19T20:43:37.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-19T20:43:37.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-19T20:43:37.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-19T20:43:37.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-19T20:43:37.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-19T20:43:37.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-19T20:43:37.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-19T20:43:37.998 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-19T20:43:37.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-19T20:43:37.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-19T20:43:37.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-19T20:43:37.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-19T20:43:37.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-19T20:43:37.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-19T20:43:37.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-19T20:43:37.999 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-19T20:43:38.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-19T20:43:38.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-19T20:43:38.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-19T20:43:38.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-19T20:43:38.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-19T20:43:38.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-19T20:43:38.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-19T20:43:38.000 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-19T20:43:38.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-19T20:43:38.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-19T20:43:40.168 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-19T20:43:40.168 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:40.169 INFO:teuthology.orchestra.run.smithi124.stdout:Upgraded: 2023-07-19T20:43:40.169 INFO:teuthology.orchestra.run.smithi124.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-19T20:43:40.169 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-19T20:43:40.169 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-19T20:43:40.169 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-19T20:43:40.169 INFO:teuthology.orchestra.run.smithi124.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-19T20:43:40.169 INFO:teuthology.orchestra.run.smithi124.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-19T20:43:40.170 INFO:teuthology.orchestra.run.smithi124.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-19T20:43:40.170 INFO:teuthology.orchestra.run.smithi124.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-19T20:43:40.170 INFO:teuthology.orchestra.run.smithi124.stdout: librados2-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.170 INFO:teuthology.orchestra.run.smithi124.stdout: librbd1-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.170 INFO:teuthology.orchestra.run.smithi124.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-19T20:43:40.170 INFO:teuthology.orchestra.run.smithi124.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-19T20:43:40.170 INFO:teuthology.orchestra.run.smithi124.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-19T20:43:40.171 INFO:teuthology.orchestra.run.smithi124.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-19T20:43:40.171 INFO:teuthology.orchestra.run.smithi124.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-19T20:43:40.171 INFO:teuthology.orchestra.run.smithi124.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-19T20:43:40.171 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-07-19T20:43:40.171 INFO:teuthology.orchestra.run.smithi124.stdout: automake-1.16.1-7.el8.noarch 2023-07-19T20:43:40.171 INFO:teuthology.orchestra.run.smithi124.stdout: bison-3.0.4-10.el8.x86_64 2023-07-19T20:43:40.171 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.172 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-base-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.172 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.172 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-fuse-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.172 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-grafana-dashboards-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:43:40.172 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-immutable-object-cache-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.172 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mds-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.172 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.173 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-cephadm-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:43:40.173 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-dashboard-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:43:40.173 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-diskprediction-local-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:43:40.173 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-modules-core-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:43:40.173 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-rook-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:43:40.173 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mon-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.173 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-osd-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.174 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-prometheus-alerts-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:43:40.174 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-radosgw-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.174 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-selinux-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.174 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-test-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.174 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-volume-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:43:40.174 INFO:teuthology.orchestra.run.smithi124.stdout: cephadm-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:43:40.174 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-mirror-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.174 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-top-2:18.1.2-35.g796ba272.el8.noarch 2023-07-19T20:43:40.175 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-19T20:43:40.175 INFO:teuthology.orchestra.run.smithi124.stdout: flex-2.6.1-9.el8.x86_64 2023-07-19T20:43:40.175 INFO:teuthology.orchestra.run.smithi124.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-19T20:43:40.175 INFO:teuthology.orchestra.run.smithi124.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-19T20:43:40.175 INFO:teuthology.orchestra.run.smithi124.stdout: jq-1.6-7.el8.x86_64 2023-07-19T20:43:40.175 INFO:teuthology.orchestra.run.smithi124.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-19T20:43:40.175 INFO:teuthology.orchestra.run.smithi124.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-19T20:43:40.175 INFO:teuthology.orchestra.run.smithi124.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-19T20:43:40.176 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs-devel-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.176 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs2-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.176 INFO:teuthology.orchestra.run.smithi124.stdout: libcephsqlite-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.176 INFO:teuthology.orchestra.run.smithi124.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-19T20:43:40.176 INFO:teuthology.orchestra.run.smithi124.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-19T20:43:40.176 INFO:teuthology.orchestra.run.smithi124.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-19T20:43:40.176 INFO:teuthology.orchestra.run.smithi124.stdout: libpq-13.5-1.el8.x86_64 2023-07-19T20:43:40.177 INFO:teuthology.orchestra.run.smithi124.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-19T20:43:40.177 INFO:teuthology.orchestra.run.smithi124.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-19T20:43:40.177 INFO:teuthology.orchestra.run.smithi124.stdout: librados-devel-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.177 INFO:teuthology.orchestra.run.smithi124.stdout: libradosstriper1-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.177 INFO:teuthology.orchestra.run.smithi124.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-19T20:43:40.177 INFO:teuthology.orchestra.run.smithi124.stdout: librgw2-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.177 INFO:teuthology.orchestra.run.smithi124.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-19T20:43:40.177 INFO:teuthology.orchestra.run.smithi124.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-19T20:43:40.178 INFO:teuthology.orchestra.run.smithi124.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-19T20:43:40.178 INFO:teuthology.orchestra.run.smithi124.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-19T20:43:40.178 INFO:teuthology.orchestra.run.smithi124.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-19T20:43:40.178 INFO:teuthology.orchestra.run.smithi124.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-19T20:43:40.178 INFO:teuthology.orchestra.run.smithi124.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-19T20:43:40.178 INFO:teuthology.orchestra.run.smithi124.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-19T20:43:40.178 INFO:teuthology.orchestra.run.smithi124.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-19T20:43:40.178 INFO:teuthology.orchestra.run.smithi124.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-19T20:43:40.179 INFO:teuthology.orchestra.run.smithi124.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-19T20:43:40.179 INFO:teuthology.orchestra.run.smithi124.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-19T20:43:40.179 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-19T20:43:40.179 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-19T20:43:40.179 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-19T20:43:40.179 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-19T20:43:40.179 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-19T20:43:40.180 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-19T20:43:40.180 INFO:teuthology.orchestra.run.smithi124.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-19T20:43:40.180 INFO:teuthology.orchestra.run.smithi124.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-19T20:43:40.180 INFO:teuthology.orchestra.run.smithi124.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-19T20:43:40.180 INFO:teuthology.orchestra.run.smithi124.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-19T20:43:40.180 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-19T20:43:40.180 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-argparse-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.181 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-common-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.181 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cephfs-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.181 INFO:teuthology.orchestra.run.smithi124.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-19T20:43:40.181 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-19T20:43:40.181 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-19T20:43:40.181 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-19T20:43:40.181 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-19T20:43:40.182 INFO:teuthology.orchestra.run.smithi124.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-19T20:43:40.182 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-19T20:43:40.182 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-19T20:43:40.182 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-19T20:43:40.182 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-19T20:43:40.182 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-19T20:43:40.182 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-19T20:43:40.182 INFO:teuthology.orchestra.run.smithi124.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-19T20:43:40.183 INFO:teuthology.orchestra.run.smithi124.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-19T20:43:40.183 INFO:teuthology.orchestra.run.smithi124.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-19T20:43:40.183 INFO:teuthology.orchestra.run.smithi124.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-19T20:43:40.183 INFO:teuthology.orchestra.run.smithi124.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-19T20:43:40.183 INFO:teuthology.orchestra.run.smithi124.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-19T20:43:40.183 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-19T20:43:40.183 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-19T20:43:40.183 INFO:teuthology.orchestra.run.smithi124.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-19T20:43:40.184 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-19T20:43:40.184 INFO:teuthology.orchestra.run.smithi124.stdout: python3-portend-2.6-1.el8.noarch 2023-07-19T20:43:40.184 INFO:teuthology.orchestra.run.smithi124.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-19T20:43:40.184 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-19T20:43:40.184 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-19T20:43:40.184 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-19T20:43:40.184 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-19T20:43:40.185 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-19T20:43:40.185 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rados-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.185 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rbd-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.185 INFO:teuthology.orchestra.run.smithi124.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-19T20:43:40.185 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-19T20:43:40.185 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rgw-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.185 INFO:teuthology.orchestra.run.smithi124.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-19T20:43:40.185 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-19T20:43:40.186 INFO:teuthology.orchestra.run.smithi124.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-19T20:43:40.186 INFO:teuthology.orchestra.run.smithi124.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-19T20:43:40.186 INFO:teuthology.orchestra.run.smithi124.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-19T20:43:40.186 INFO:teuthology.orchestra.run.smithi124.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-19T20:43:40.186 INFO:teuthology.orchestra.run.smithi124.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-19T20:43:40.186 INFO:teuthology.orchestra.run.smithi124.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-19T20:43:40.186 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-19T20:43:40.186 INFO:teuthology.orchestra.run.smithi124.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-19T20:43:40.187 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-19T20:43:40.187 INFO:teuthology.orchestra.run.smithi124.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-19T20:43:40.187 INFO:teuthology.orchestra.run.smithi124.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-19T20:43:40.187 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-fuse-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.187 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-mirror-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.187 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-nbd-2:18.1.2-35.g796ba272.el8.x86_64 2023-07-19T20:43:40.187 INFO:teuthology.orchestra.run.smithi124.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-19T20:43:40.188 INFO:teuthology.orchestra.run.smithi124.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-19T20:43:40.188 INFO:teuthology.orchestra.run.smithi124.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-19T20:43:40.188 INFO:teuthology.orchestra.run.smithi124.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-19T20:43:40.188 INFO:teuthology.orchestra.run.smithi124.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-19T20:43:40.188 INFO:teuthology.orchestra.run.smithi124.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-19T20:43:40.189 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:40.189 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-07-19T20:43:40.396 DEBUG:teuthology.parallel:result is None 2023-07-19T20:43:40.398 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=796ba272b844628dfe71207e1e29131fa2eea4cd 2023-07-19T20:43:40.741 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-19T20:43:40.771 INFO:teuthology.orchestra.run.smithi117.stdout:18.1.2-35.g796ba272.el8 2023-07-19T20:43:40.772 INFO:teuthology.packaging:The installed version of ceph is 18.1.2-35.g796ba272.el8 2023-07-19T20:43:40.772 INFO:teuthology.task.install:The correct ceph version 18.1.2-35.g796ba272 is installed. 2023-07-19T20:43:40.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=796ba272b844628dfe71207e1e29131fa2eea4cd 2023-07-19T20:43:41.123 DEBUG:teuthology.orchestra.run.smithi124:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-19T20:43:41.148 INFO:teuthology.orchestra.run.smithi124.stdout:18.1.2-35.g796ba272.el8 2023-07-19T20:43:41.148 INFO:teuthology.packaging:The installed version of ceph is 18.1.2-35.g796ba272.el8 2023-07-19T20:43:41.148 INFO:teuthology.task.install:The correct ceph version 18.1.2-35.g796ba272 is installed. 2023-07-19T20:43:41.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=796ba272b844628dfe71207e1e29131fa2eea4cd 2023-07-19T20:43:41.460 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-19T20:43:41.521 INFO:teuthology.orchestra.run.smithi130.stdout:18.1.2-35.g796ba272.el8 2023-07-19T20:43:41.522 INFO:teuthology.packaging:The installed version of ceph is 18.1.2-35.g796ba272.el8 2023-07-19T20:43:41.522 INFO:teuthology.task.install:The correct ceph version 18.1.2-35.g796ba272 is installed. 2023-07-19T20:43:41.522 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-19T20:43:41.523 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:43:41.523 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-19T20:43:41.561 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:43:41.561 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-19T20:43:41.593 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:43:41.593 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-19T20:43:41.669 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-19T20:43:41.670 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:43:41.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2023-07-19T20:43:41.704 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-19T20:43:41.775 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:43:41.776 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/daemon-helper 2023-07-19T20:43:41.804 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-19T20:43:41.872 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:43:41.873 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2023-07-19T20:43:41.943 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-19T20:43:42.050 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-19T20:43:42.051 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:43:42.051 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-19T20:43:42.083 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-19T20:43:42.154 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:43:42.155 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-19T20:43:42.182 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-19T20:43:42.250 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:43:42.250 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-19T20:43:42.319 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-19T20:43:42.426 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-19T20:43:42.426 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:43:42.427 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2023-07-19T20:43:42.459 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-19T20:43:42.530 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:43:42.531 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/stdin-killer 2023-07-19T20:43:42.561 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-19T20:43:42.627 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:43:42.628 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2023-07-19T20:43:42.698 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-19T20:43:42.807 INFO:teuthology.run_tasks:Running task ceph... 2023-07-19T20:43:42.883 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-19T20:43:42.883 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2023-07-19T20:43:42.886 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 777 /var/log/ceph 2023-07-19T20:43:42.888 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /var/log/ceph 2023-07-19T20:43:42.956 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-19T20:43:42.957 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-19T20:43:42.959 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-19T20:43:42.962 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-19T20:43:43.030 INFO:tasks.ceph:Creating extra log directories... 2023-07-19T20:43:43.030 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-19T20:43:43.033 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-19T20:43:43.035 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-19T20:43:43.110 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-19T20:43:43.111 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-19T20:43:43.111 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-19T20:43:43.111 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:43:43.112 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-19T20:43:43.132 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-19T20:43:43.253 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-19T20:43:43.282 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:43:43.282 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-19T20:43:43.301 DEBUG:teuthology.orchestra.run.smithi124:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-19T20:43:43.416 DEBUG:teuthology.orchestra.run.smithi124:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-19T20:43:43.443 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:43:43.444 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-19T20:43:43.490 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-19T20:43:43.700 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-19T20:43:43.775 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-19T20:43:43.775 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-19T20:43:43.776 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344198', 'branch': 'wip-yuri4-testing-2023-07-06-0738-reef', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common}', 'email': None, 'first_in_suite': False, 'job_id': '7344198', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2023-07-06-0738-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '796ba272b844628dfe71207e1e29131fa2eea4cd'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '796ba272b844628dfe71207e1e29131fa2eea4cd'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2023-07-06-0738-reef', 'sha1': '796ba272b844628dfe71207e1e29131fa2eea4cd'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 8052, 'sha1': '796ba272b844628dfe71207e1e29131fa2eea4cd', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri4-testing-2023-07-06-0738-reef', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_796ba272b844628dfe71207e1e29131fa2eea4cd/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '796ba272b844628dfe71207e1e29131fa2eea4cd', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi117.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCVUqcg8yw5J2UoBenTJCQQ47FvEhMnvhSStRB/aEPd+fxaptn4eib9AJCMQBq26bBebsf6AlKS5qmXiSnYYEjR3HXGWi2yJXzKgtdkPRy82EivYsbwuvMQc1ttn6j/lv3acNKVIJdR8whW1It1Zqb8RT4lyT4+uEJevyX+5eRKF4EHEoiUp4/iFBpxkihJburhecm2vu1TUN6GTVvB2zkMYKlhs7NjyrO3sN16/ABAgyThJmZ+UPPHEC0wlmbtU3W77qLwtprfs4pzB1jXXtCn8FGsdh1MX+PeWbNDFzdg+e81k2AmFVkquyBZoZLBJADuCY407lUdsIHpzDDq8pE5i+gzhlnhnEG4HEjuQSFhfd/qvlGqp7V9yFV3OQzpzjIbLgXYuesXMYxEbj3huAGKhBw6QuYVhUUTEP4IzAB0G0nK4upJnpVuFYXQMGAnrM4oghAWxKIkSD4mWVrDmG1btNsZfpTi2ks0nc8DQb8j6iG/JZtIzo4rtGk2JuhmdM=', 'smithi124.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCT6mj6hZGnzyHL+bVojVqFh8FX1/5kXAbqR6LTxTJCOYKqqItHkpD0MV9pVcepNRmTeXE+qaxtMqAUEKvdKEe8GtvhZ/Y9o4/SJYUeRWkxWAe6RTEpM3oM8XBfSyokrB+RzXOorJKKYGE1lLSp13DPXLLhyOsHUBZdebB7Pg3rS2WLI9H1ew2yfZNiTdUIDlgRjtkPU6Ck/yLRr97FXth4OcRE/3f2jiJeo2Q2JKexgAacQimKe/n1iQABVE1gig6bx+Fw9fIQ6TTFhblcWXb34V5sGKfZa+NrMNQS9Bz3qIg1vC3+1HUkiDQP7rIJ53fj2udWIJbChDcMz8QqjaMCpUWHWckKLxeg02NPO+5EZhNptq5zpfabblH4jxucthK9aLlGajjWnX2iPo2apJIPgqMO+L5vkzPb8TnMtUA5r+3blz4ccui1R5KDOzZK1lYMow0USzg0xGIo2W6m149x9bthJbXrohWvDhsBQsVCI856B22nPCJNUIWvOea2PqE=', 'smithi130.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzyDjIR8G1gJoiIDRsjD7QC7isPwPKdjsKmz/s72zVjJmDbPOAqQO/pGlR/rdk1ZohFia8mPqio9tmKuy+l9KvrDxVzSIG8KnmQxYzlEb6iYZ7VPZlVAfGH5Gf92Ygyjv2CiKWMAztSEky04uLMXsTJoLEkTKGMERk5AJn9QMYk/qoENJ/uIjucBEEApGhreXd80HIML4DIt3/JFwJpGdv8tWSun8ZVbIU5zrTQHSBgnfiobBjTvF+gXqKkcDZm4fyfJrhnpKfPG+ppLowCIYdTqU0eAFv4LjHRSz/KBiZj1f9YKKs4jyp43u1mBxWw9mgqeYJ+56GAQIMacVac7zVZJuOScgIARwfSEUnC2+eSf7bExiRItWHFAEVdmj7Yf35+j627YMQjtFjvNeFcQ0JipgBdFkoUxZP7QtfgBiOF+IknpedgCQNRcYXZwC3Iii2KHg7AuTHxKF/vRIi0EE8rNnA5MjdTUNQFMQrzRqqJsSTQOQYFvo9puplYFg7PwE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '796ba272b844628dfe71207e1e29131fa2eea4cd'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '79491cb69dd37a1eafb93b3471998174bdfa2fd9', 'timestamp': '2023-07-19_19:57:09', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-19T20:43:43.777 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-19T20:43:43.779 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-19T20:43:43.781 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-19T20:43:43.827 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2023-07-19T20:43:43.841 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -d -m0777 -- /var/run/ceph 2023-07-19T20:43:43.843 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/run/ceph 2023-07-19T20:43:43.936 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:43:43.937 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2023-07-19T20:43:43.958 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-19T20:43:43.959 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2023-07-19T20:43:44.019 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-19T20:43:44.020 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-19T20:43:44.020 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 414351 Links: 1 2023-07-19T20:43:44.020 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-19T20:43:44.020 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2023-07-19T20:43:44.020 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-07-19 20:42:11.817239519 +0000 2023-07-19T20:43:44.021 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-07-19 20:33:54.036707108 +0000 2023-07-19T20:43:44.021 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-07-19 20:33:54.036707108 +0000 2023-07-19T20:43:44.021 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-07-19T20:43:44.021 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-19T20:43:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-07-19T20:43:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-07-19T20:43:44.091 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000309814 s, 1.7 MB/s 2023-07-19T20:43:44.092 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-19T20:43:44.155 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2023-07-19T20:43:44.215 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-19T20:43:44.215 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-19T20:43:44.216 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 418876 Links: 1 2023-07-19T20:43:44.217 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-19T20:43:44.217 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2023-07-19T20:43:44.217 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-07-19 20:42:11.817239519 +0000 2023-07-19T20:43:44.217 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-07-19 20:33:54.557696255 +0000 2023-07-19T20:43:44.218 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-07-19 20:33:54.557696255 +0000 2023-07-19T20:43:44.218 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-07-19T20:43:44.219 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-19T20:43:44.282 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-07-19T20:43:44.282 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-07-19T20:43:44.282 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000223104 s, 2.3 MB/s 2023-07-19T20:43:44.284 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-19T20:43:44.343 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2023-07-19T20:43:44.402 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-19T20:43:44.402 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-19T20:43:44.402 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 418460 Links: 1 2023-07-19T20:43:44.402 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-19T20:43:44.403 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2023-07-19T20:43:44.403 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-07-19 20:42:11.818239498 +0000 2023-07-19T20:43:44.403 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-07-19 20:33:55.124684443 +0000 2023-07-19T20:43:44.403 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-07-19 20:33:55.124684443 +0000 2023-07-19T20:43:44.403 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-07-19T20:43:44.403 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-19T20:43:44.469 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-07-19T20:43:44.469 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-07-19T20:43:44.469 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000290418 s, 1.8 MB/s 2023-07-19T20:43:44.470 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-19T20:43:44.529 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2023-07-19T20:43:44.587 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-19T20:43:44.588 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-19T20:43:44.588 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 417146 Links: 1 2023-07-19T20:43:44.588 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-19T20:43:44.588 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2023-07-19T20:43:44.588 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-07-19 20:42:11.818239498 +0000 2023-07-19T20:43:44.588 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-07-19 20:33:55.641673673 +0000 2023-07-19T20:43:44.589 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-07-19 20:33:55.641673673 +0000 2023-07-19T20:43:44.589 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-07-19T20:43:44.589 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-19T20:43:44.653 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-07-19T20:43:44.653 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-07-19T20:43:44.653 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000222717 s, 2.3 MB/s 2023-07-19T20:43:44.654 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-19T20:43:44.713 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-19T20:43:44.714 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:43:44.714 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/scratch_devs of=/dev/stdout 2023-07-19T20:43:44.737 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-19T20:43:44.737 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_1 2023-07-19T20:43:44.800 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-19T20:43:44.800 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-19T20:43:44.800 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 6h/6d Inode: 412998 Links: 1 2023-07-19T20:43:44.800 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-19T20:43:44.801 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-07-19T20:43:44.801 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-07-19 20:43:37.619711121 +0000 2023-07-19T20:43:44.801 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-07-19 20:33:46.929555202 +0000 2023-07-19T20:43:44.801 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-07-19 20:33:46.929555202 +0000 2023-07-19T20:43:44.801 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2023-07-19T20:43:44.801 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-19T20:43:44.873 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-07-19T20:43:44.873 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-07-19T20:43:44.873 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000281493 s, 1.8 MB/s 2023-07-19T20:43:44.874 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-19T20:43:44.938 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_2 2023-07-19T20:43:45.002 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-19T20:43:45.003 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-19T20:43:45.003 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 6h/6d Inode: 417079 Links: 1 2023-07-19T20:43:45.003 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-19T20:43:45.003 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-07-19T20:43:45.003 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-07-19 20:43:37.619711121 +0000 2023-07-19T20:43:45.004 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-07-19 20:33:47.454545767 +0000 2023-07-19T20:43:45.004 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-07-19 20:33:47.454545767 +0000 2023-07-19T20:43:45.004 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2023-07-19T20:43:45.004 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-19T20:43:45.072 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-07-19T20:43:45.072 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-07-19T20:43:45.073 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000225913 s, 2.3 MB/s 2023-07-19T20:43:45.073 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-19T20:43:45.134 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_3 2023-07-19T20:43:45.194 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-19T20:43:45.194 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-19T20:43:45.194 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 6h/6d Inode: 418981 Links: 1 2023-07-19T20:43:45.194 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-19T20:43:45.195 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-07-19T20:43:45.195 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-07-19 20:43:37.619711121 +0000 2023-07-19T20:43:45.195 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-07-19 20:33:47.983536261 +0000 2023-07-19T20:43:45.195 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-07-19 20:33:47.983536261 +0000 2023-07-19T20:43:45.195 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2023-07-19T20:43:45.195 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-19T20:43:45.262 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-07-19T20:43:45.263 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-07-19T20:43:45.263 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.00022815 s, 2.2 MB/s 2023-07-19T20:43:45.264 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-19T20:43:45.323 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_4 2023-07-19T20:43:45.383 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-19T20:43:45.384 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-19T20:43:45.384 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 6h/6d Inode: 419097 Links: 1 2023-07-19T20:43:45.384 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-19T20:43:45.384 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-07-19T20:43:45.384 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-07-19 20:43:37.619711121 +0000 2023-07-19T20:43:45.385 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-07-19 20:33:48.537526306 +0000 2023-07-19T20:43:45.385 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-07-19 20:33:48.537526306 +0000 2023-07-19T20:43:45.385 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2023-07-19T20:43:45.385 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-19T20:43:45.452 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-07-19T20:43:45.452 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-07-19T20:43:45.452 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000241167 s, 2.1 MB/s 2023-07-19T20:43:45.453 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-19T20:43:45.517 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-19T20:43:45.517 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi124.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-19T20:43:45.518 INFO:tasks.ceph:Generating config... 2023-07-19T20:43:45.519 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-19T20:43:45.520 INFO:tasks.ceph:[client] debug client = 20 2023-07-19T20:43:45.520 INFO:tasks.ceph:[client] debug ms = 1 2023-07-19T20:43:45.520 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-19T20:43:45.520 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-19T20:43:45.520 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-07-19T20:43:45.521 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-19T20:43:45.521 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-19T20:43:45.521 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-19T20:43:45.521 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-19T20:43:45.522 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-19T20:43:45.522 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-19T20:43:45.522 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-19T20:43:45.522 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-19T20:43:45.522 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-19T20:43:45.523 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-19T20:43:45.523 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-19T20:43:45.523 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-19T20:43:45.523 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-19T20:43:45.523 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-19T20:43:45.524 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-19T20:43:45.524 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-19T20:43:45.524 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-19T20:43:45.524 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-19T20:43:45.524 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-19T20:43:45.525 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-19T20:43:45.525 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-19T20:43:45.525 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-19T20:43:45.525 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-19T20:43:45.525 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-19T20:43:45.525 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-19T20:43:45.526 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-19T20:43:45.526 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-19T20:43:45.526 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-19T20:43:45.526 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-19T20:43:45.526 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-19T20:43:45.527 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-19T20:43:45.527 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-19T20:43:45.527 INFO:tasks.ceph:Setting up mon.a... 2023-07-19T20:43:45.527 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-19T20:43:45.592 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.keyring 2023-07-19T20:43:45.594 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-19T20:43:45.642 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-19T20:43:45.670 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.117'), ('mon.b', '172.21.15.124'), ('mon.c', '[v2:172.21.15.124:3301,v1:172.21.15.124:6790]')] 2023-07-19T20:43:45.671 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.117,172.21.15.124,[v2:172.21.15.124:3301,v1:172.21.15.124:6790]', 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-19T20:43:45.672 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:43:45.672 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-19T20:43:45.728 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.117 --add b 172.21.15.124 --addv c '[v2:172.21.15.124:3301,v1:172.21.15.124:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:43:45.817 INFO:teuthology.orchestra.run.smithi117.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:43:45.818 INFO:teuthology.orchestra.run.smithi117.stdout:monmaptool: generated fsid 46db5732-4a4f-4d1e-835b-9507e9513c02 2023-07-19T20:43:45.818 INFO:teuthology.orchestra.run.smithi117.stdout:setting min_mon_release = pacific 2023-07-19T20:43:45.818 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 0 2023-07-19T20:43:45.818 INFO:teuthology.orchestra.run.smithi117.stdout:fsid 46db5732-4a4f-4d1e-835b-9507e9513c02 2023-07-19T20:43:45.818 INFO:teuthology.orchestra.run.smithi117.stdout:last_changed 2023-07-19T20:43:45.824759+0000 2023-07-19T20:43:45.818 INFO:teuthology.orchestra.run.smithi117.stdout:created 2023-07-19T20:43:45.824759+0000 2023-07-19T20:43:45.819 INFO:teuthology.orchestra.run.smithi117.stdout:min_mon_release 16 (pacific) 2023-07-19T20:43:45.819 INFO:teuthology.orchestra.run.smithi117.stdout:election_strategy: 1 2023-07-19T20:43:45.819 INFO:teuthology.orchestra.run.smithi117.stdout:0: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.a 2023-07-19T20:43:45.819 INFO:teuthology.orchestra.run.smithi117.stdout:1: [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] mon.b 2023-07-19T20:43:45.819 INFO:teuthology.orchestra.run.smithi117.stdout:2: [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] mon.c 2023-07-19T20:43:45.819 INFO:teuthology.orchestra.run.smithi117.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-19T20:43:45.821 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-19T20:43:45.839 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 46db5732-4a4f-4d1e-835b-9507e9513c02... 2023-07-19T20:43:45.841 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-19T20:43:45.882 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-19T20:43:45.885 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-19T20:43:45.924 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2023-07-19T20:43:45.924 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2023-07-19T20:43:45.924 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-19T20:43:45.925 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2023-07-19T20:43:45.925 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.925 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2023-07-19T20:43:45.925 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.925 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2023-07-19T20:43:45.925 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.925 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2023-07-19T20:43:45.926 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2023-07-19T20:43:45.926 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.926 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2023-07-19T20:43:45.926 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2023-07-19T20:43:45.926 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.926 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-19T20:43:45.926 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2023-07-19T20:43:45.927 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.927 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2023-07-19T20:43:45.927 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-19T20:43:45.927 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.927 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2023-07-19T20:43:45.927 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.927 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2023-07-19T20:43:45.927 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2023-07-19T20:43:45.928 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2023-07-19T20:43:45.928 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2023-07-19T20:43:45.928 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2023-07-19T20:43:45.928 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2023-07-19T20:43:45.928 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2023-07-19T20:43:45.928 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-19T20:43:45.928 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-19T20:43:45.929 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2023-07-19T20:43:45.929 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.929 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-19T20:43:45.929 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.929 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2023-07-19T20:43:45.929 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.929 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2023-07-19T20:43:45.930 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.930 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2023-07-19T20:43:45.930 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2023-07-19T20:43:45.930 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2023-07-19T20:43:45.930 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.117,172.21.15.124,[v2:172.21.15.124:3301,v1:172.21.15.124:6790]" 2023-07-19T20:43:45.930 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn min per osd = 0 2023-07-19T20:43:45.930 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 46db5732-4a4f-4d1e-835b-9507e9513c02 2023-07-19T20:43:45.930 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.931 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2023-07-19T20:43:45.931 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2023-07-19T20:43:45.931 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.931 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2023-07-19T20:43:45.931 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2023-07-19T20:43:45.931 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2023-07-19T20:43:45.931 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.931 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2023-07-19T20:43:45.932 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2023-07-19T20:43:45.932 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.932 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2023-07-19T20:43:45.932 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2023-07-19T20:43:45.932 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2023-07-19T20:43:45.932 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.933 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2023-07-19T20:43:45.933 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2023-07-19T20:43:45.933 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.933 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2023-07-19T20:43:45.933 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.933 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2023-07-19T20:43:45.933 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.933 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2023-07-19T20:43:45.934 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.934 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2023-07-19T20:43:45.934 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2023-07-19T20:43:45.934 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.934 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2023-07-19T20:43:45.934 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2023-07-19T20:43:45.934 INFO:teuthology.orchestra.run.smithi117.stdout: bdev async discard = True 2023-07-19T20:43:45.934 INFO:teuthology.orchestra.run.smithi117.stdout: bdev enable discard = True 2023-07-19T20:43:45.935 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore allocator = bitmap 2023-07-19T20:43:45.935 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2023-07-19T20:43:45.935 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2023-07-19T20:43:45.935 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 1/20 2023-07-19T20:43:45.935 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 1/20 2023-07-19T20:43:45.935 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-07-19T20:43:45.935 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2023-07-19T20:43:45.936 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 4/10 2023-07-19T20:43:45.936 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2023-07-19T20:43:45.936 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2023-07-19T20:43:45.936 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2023-07-19T20:43:45.936 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2023-07-19T20:43:45.936 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2023-07-19T20:43:45.936 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2023-07-19T20:43:45.936 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.937 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2023-07-19T20:43:45.937 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-07-19T20:43:45.937 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2023-07-19T20:43:45.937 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2023-07-19T20:43:45.937 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2023-07-19T20:43:45.937 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2023-07-19T20:43:45.937 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2023-07-19T20:43:45.938 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2023-07-19T20:43:45.938 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.938 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2023-07-19T20:43:45.938 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-07-19T20:43:45.938 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2023-07-19T20:43:45.938 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2023-07-19T20:43:45.938 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2023-07-19T20:43:45.938 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2023-07-19T20:43:45.939 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2023-07-19T20:43:45.939 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2023-07-19T20:43:45.939 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2023-07-19T20:43:45.939 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2023-07-19T20:43:45.939 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2023-07-19T20:43:45.939 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.939 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-19T20:43:45.939 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2023-07-19T20:43:45.940 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2023-07-19T20:43:45.940 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.940 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2023-07-19T20:43:45.940 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-19T20:43:45.940 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-19T20:43:45.940 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.940 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2023-07-19T20:43:45.940 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2023-07-19T20:43:45.941 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.941 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2023-07-19T20:43:45.941 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2023-07-19T20:43:45.941 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:43:45.941 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2023-07-19T20:43:45.941 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2023-07-19T20:43:45.941 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2023-07-19T20:43:45.942 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2023-07-19T20:43:45.942 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-19T20:43:45.942 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-19T20:43:45.942 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2023-07-19T20:43:45.942 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2023-07-19T20:43:45.942 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-07-19T20:43:45.942 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2023-07-19T20:43:45.943 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2023-07-19T20:43:45.943 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2023-07-19T20:43:45.943 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2023-07-19T20:43:45.943 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2023-07-19T20:43:45.943 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2023-07-19T20:43:45.943 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2023-07-19T20:43:45.943 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2023-07-19T20:43:45.943 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2023-07-19T20:43:45.944 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2023-07-19T20:43:45.944 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2023-07-19T20:43:45.944 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-07-19T20:43:45.944 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2023-07-19T20:43:45.944 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2023-07-19T20:43:45.944 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2023-07-19T20:43:45.944 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = True 2023-07-19T20:43:45.945 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2023-07-19T20:43:45.945 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2023-07-19T20:43:45.945 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2023-07-19T20:43:45.946 INFO:teuthology.orchestra.run.smithi124.stdout:[global] 2023-07-19T20:43:45.946 INFO:teuthology.orchestra.run.smithi124.stdout: chdir = "" 2023-07-19T20:43:45.946 INFO:teuthology.orchestra.run.smithi124.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-19T20:43:45.946 INFO:teuthology.orchestra.run.smithi124.stdout: auth supported = cephx 2023-07-19T20:43:45.946 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.946 INFO:teuthology.orchestra.run.smithi124.stdout: filestore xattr use omap = true 2023-07-19T20:43:45.946 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.947 INFO:teuthology.orchestra.run.smithi124.stdout: mon clock drift allowed = 1.000 2023-07-19T20:43:45.947 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.947 INFO:teuthology.orchestra.run.smithi124.stdout: osd crush chooseleaf type = 0 2023-07-19T20:43:45.947 INFO:teuthology.orchestra.run.smithi124.stdout: auth debug = true 2023-07-19T20:43:45.947 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.947 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on old message = true 2023-07-19T20:43:45.947 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on bug = true 2023-07-19T20:43:45.948 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.948 INFO:teuthology.orchestra.run.smithi124.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-19T20:43:45.948 INFO:teuthology.orchestra.run.smithi124.stdout: mon pg warn max object skew = 0 2023-07-19T20:43:45.948 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.948 INFO:teuthology.orchestra.run.smithi124.stdout: # disable pg_autoscaler by default for new pools 2023-07-19T20:43:45.948 INFO:teuthology.orchestra.run.smithi124.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-19T20:43:45.948 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.948 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default size = 2 2023-07-19T20:43:45.949 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.949 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd allow primary affinity = true 2023-07-19T20:43:45.949 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd allow pg remap = true 2023-07-19T20:43:45.949 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on legacy crush tunables = false 2023-07-19T20:43:45.949 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on crush straw calc version zero = false 2023-07-19T20:43:45.950 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on no sortbitwise = false 2023-07-19T20:43:45.950 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on osd down out interval zero = false 2023-07-19T20:43:45.950 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on too few osds = false 2023-07-19T20:43:45.950 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-19T20:43:45.950 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-19T20:43:45.950 INFO:teuthology.orchestra.run.smithi124.stdout: mon_allow_pool_size_one = true 2023-07-19T20:43:45.950 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.950 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-19T20:43:45.951 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.951 INFO:teuthology.orchestra.run.smithi124.stdout: osd default data pool replay window = 5 2023-07-19T20:43:45.951 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.951 INFO:teuthology.orchestra.run.smithi124.stdout: mon allow pool delete = true 2023-07-19T20:43:45.951 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.951 INFO:teuthology.orchestra.run.smithi124.stdout: mon cluster log file level = debug 2023-07-19T20:43:45.951 INFO:teuthology.orchestra.run.smithi124.stdout: debug asserts on shutdown = true 2023-07-19T20:43:45.952 INFO:teuthology.orchestra.run.smithi124.stdout: mon health detail to clog = false 2023-07-19T20:43:45.952 INFO:teuthology.orchestra.run.smithi124.stdout: mon host = "172.21.15.117,172.21.15.124,[v2:172.21.15.124:3301,v1:172.21.15.124:6790]" 2023-07-19T20:43:45.952 INFO:teuthology.orchestra.run.smithi124.stdout: mon pg warn min per osd = 0 2023-07-19T20:43:45.952 INFO:teuthology.orchestra.run.smithi124.stdout: fsid = 46db5732-4a4f-4d1e-835b-9507e9513c02 2023-07-19T20:43:45.952 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.952 INFO:teuthology.orchestra.run.smithi124.stdout:[osd] 2023-07-19T20:43:45.952 INFO:teuthology.orchestra.run.smithi124.stdout: osd journal size = 100 2023-07-19T20:43:45.953 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.953 INFO:teuthology.orchestra.run.smithi124.stdout: osd scrub load threshold = 5.0 2023-07-19T20:43:45.953 INFO:teuthology.orchestra.run.smithi124.stdout: osd scrub max interval = 600 2023-07-19T20:43:45.953 INFO:teuthology.orchestra.run.smithi124.stdout: osd mclock profile = high_recovery_ops 2023-07-19T20:43:45.953 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.953 INFO:teuthology.orchestra.run.smithi124.stdout: osd recover clone overlap = true 2023-07-19T20:43:45.953 INFO:teuthology.orchestra.run.smithi124.stdout: osd recovery max chunk = 1048576 2023-07-19T20:43:45.953 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.954 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug shutdown = true 2023-07-19T20:43:45.954 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug op order = true 2023-07-19T20:43:45.954 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug verify stray on activate = true 2023-07-19T20:43:45.954 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.954 INFO:teuthology.orchestra.run.smithi124.stdout: osd open classes on start = true 2023-07-19T20:43:45.954 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug pg log writeout = true 2023-07-19T20:43:45.954 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.954 INFO:teuthology.orchestra.run.smithi124.stdout: osd deep scrub update digest min age = 30 2023-07-19T20:43:45.955 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.955 INFO:teuthology.orchestra.run.smithi124.stdout: osd map max advance = 10 2023-07-19T20:43:45.955 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.955 INFO:teuthology.orchestra.run.smithi124.stdout: journal zero on create = true 2023-07-19T20:43:45.955 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.955 INFO:teuthology.orchestra.run.smithi124.stdout: filestore ondisk finisher threads = 3 2023-07-19T20:43:45.956 INFO:teuthology.orchestra.run.smithi124.stdout: filestore apply finisher threads = 3 2023-07-19T20:43:45.956 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.956 INFO:teuthology.orchestra.run.smithi124.stdout: bdev debug aio = true 2023-07-19T20:43:45.956 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug misdirected ops = true 2023-07-19T20:43:45.956 INFO:teuthology.orchestra.run.smithi124.stdout: bdev async discard = True 2023-07-19T20:43:45.956 INFO:teuthology.orchestra.run.smithi124.stdout: bdev enable discard = True 2023-07-19T20:43:45.956 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore allocator = bitmap 2023-07-19T20:43:45.956 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore block size = 96636764160 2023-07-19T20:43:45.957 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore fsck on mount = True 2023-07-19T20:43:45.957 INFO:teuthology.orchestra.run.smithi124.stdout: debug bluefs = 1/20 2023-07-19T20:43:45.957 INFO:teuthology.orchestra.run.smithi124.stdout: debug bluestore = 1/20 2023-07-19T20:43:45.957 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-07-19T20:43:45.957 INFO:teuthology.orchestra.run.smithi124.stdout: debug osd = 20 2023-07-19T20:43:45.957 INFO:teuthology.orchestra.run.smithi124.stdout: debug rocksdb = 4/10 2023-07-19T20:43:45.957 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd backfillfull_ratio = 0.85 2023-07-19T20:43:45.958 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd full ratio = 0.9 2023-07-19T20:43:45.958 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd nearfull ratio = 0.8 2023-07-19T20:43:45.958 INFO:teuthology.orchestra.run.smithi124.stdout: osd failsafe full ratio = 0.95 2023-07-19T20:43:45.958 INFO:teuthology.orchestra.run.smithi124.stdout: osd objectstore = bluestore 2023-07-19T20:43:45.958 INFO:teuthology.orchestra.run.smithi124.stdout: osd op complaint time = 180 2023-07-19T20:43:45.958 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.958 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr] 2023-07-19T20:43:45.958 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-07-19T20:43:45.959 INFO:teuthology.orchestra.run.smithi124.stdout: debug mgr = 20 2023-07-19T20:43:45.959 INFO:teuthology.orchestra.run.smithi124.stdout: debug mon = 20 2023-07-19T20:43:45.959 INFO:teuthology.orchestra.run.smithi124.stdout: debug auth = 20 2023-07-19T20:43:45.959 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min pgs per osd = 4 2023-07-19T20:43:45.959 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min bytes per osd = 10 2023-07-19T20:43:45.959 INFO:teuthology.orchestra.run.smithi124.stdout: mgr/telemetry/nag = false 2023-07-19T20:43:45.959 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.959 INFO:teuthology.orchestra.run.smithi124.stdout:[mon] 2023-07-19T20:43:45.960 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-07-19T20:43:45.960 INFO:teuthology.orchestra.run.smithi124.stdout: debug mon = 20 2023-07-19T20:43:45.960 INFO:teuthology.orchestra.run.smithi124.stdout: debug paxos = 20 2023-07-19T20:43:45.960 INFO:teuthology.orchestra.run.smithi124.stdout: debug auth = 20 2023-07-19T20:43:45.960 INFO:teuthology.orchestra.run.smithi124.stdout: mon data avail warn = 5 2023-07-19T20:43:45.960 INFO:teuthology.orchestra.run.smithi124.stdout: mon mgr mkfs grace = 240 2023-07-19T20:43:45.960 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min pgs per osd = 4 2023-07-19T20:43:45.961 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd reporter subtree level = osd 2023-07-19T20:43:45.961 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd prime pg temp = true 2023-07-19T20:43:45.961 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min bytes per osd = 10 2023-07-19T20:43:45.961 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.961 INFO:teuthology.orchestra.run.smithi124.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-19T20:43:45.961 INFO:teuthology.orchestra.run.smithi124.stdout: auth mon ticket ttl = 660 # 11m 2023-07-19T20:43:45.961 INFO:teuthology.orchestra.run.smithi124.stdout: auth service ticket ttl = 240 # 4m 2023-07-19T20:43:45.961 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.962 INFO:teuthology.orchestra.run.smithi124.stdout: # don't complain about insecure global_id in the test suite 2023-07-19T20:43:45.962 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-19T20:43:45.962 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-19T20:43:45.962 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.962 INFO:teuthology.orchestra.run.smithi124.stdout: # 1m isn't quite enough 2023-07-19T20:43:45.962 INFO:teuthology.orchestra.run.smithi124.stdout: mon_down_mkfs_grace = 2m 2023-07-19T20:43:45.962 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.962 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_filestore_osds = false 2023-07-19T20:43:45.963 INFO:teuthology.orchestra.run.smithi124.stdout: mon op complaint time = 120 2023-07-19T20:43:45.963 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-07-19T20:43:45.963 INFO:teuthology.orchestra.run.smithi124.stdout:[client] 2023-07-19T20:43:45.963 INFO:teuthology.orchestra.run.smithi124.stdout: rgw cache enabled = true 2023-07-19T20:43:45.963 INFO:teuthology.orchestra.run.smithi124.stdout: rgw enable ops log = true 2023-07-19T20:43:45.963 INFO:teuthology.orchestra.run.smithi124.stdout: rgw enable usage log = true 2023-07-19T20:43:45.963 INFO:teuthology.orchestra.run.smithi124.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-19T20:43:45.963 INFO:teuthology.orchestra.run.smithi124.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-19T20:43:45.964 INFO:teuthology.orchestra.run.smithi124.stdout: client mount timeout = 600 2023-07-19T20:43:45.964 INFO:teuthology.orchestra.run.smithi124.stdout: debug client = 20 2023-07-19T20:43:45.964 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-07-19T20:43:45.964 INFO:teuthology.orchestra.run.smithi124.stdout: rados mon op timeout = 900 2023-07-19T20:43:45.964 INFO:teuthology.orchestra.run.smithi124.stdout: rados osd op timeout = 900 2023-07-19T20:43:45.964 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.a] 2023-07-19T20:43:45.964 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.b] 2023-07-19T20:43:45.964 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.c] 2023-07-19T20:43:45.965 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.a] 2023-07-19T20:43:45.965 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.c] 2023-07-19T20:43:45.965 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.b] 2023-07-19T20:43:45.965 INFO:teuthology.orchestra.run.smithi124.stdout:[mds] 2023-07-19T20:43:45.965 INFO:teuthology.orchestra.run.smithi124.stdout: debug mds = 20 2023-07-19T20:43:45.965 INFO:teuthology.orchestra.run.smithi124.stdout: debug mds balancer = 20 2023-07-19T20:43:45.965 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-07-19T20:43:45.966 INFO:teuthology.orchestra.run.smithi124.stdout: mds debug frag = True 2023-07-19T20:43:45.966 INFO:teuthology.orchestra.run.smithi124.stdout: mds debug scatterstat = True 2023-07-19T20:43:45.966 INFO:teuthology.orchestra.run.smithi124.stdout: mds op complaint time = 180 2023-07-19T20:43:45.966 INFO:teuthology.orchestra.run.smithi124.stdout: mds verify scatter = True 2023-07-19T20:43:45.966 INFO:teuthology.orchestra.run.smithi124.stdout: osd op complaint time = 180 2023-07-19T20:43:45.966 INFO:teuthology.orchestra.run.smithi124.stdout: rados mon op timeout = 900 2023-07-19T20:43:45.966 INFO:teuthology.orchestra.run.smithi124.stdout: rados osd op timeout = 900 2023-07-19T20:43:46.010 INFO:teuthology.orchestra.run.smithi130.stdout:[global] 2023-07-19T20:43:46.011 INFO:teuthology.orchestra.run.smithi130.stdout: chdir = "" 2023-07-19T20:43:46.011 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-19T20:43:46.011 INFO:teuthology.orchestra.run.smithi130.stdout: auth supported = cephx 2023-07-19T20:43:46.011 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.011 INFO:teuthology.orchestra.run.smithi130.stdout: filestore xattr use omap = true 2023-07-19T20:43:46.011 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.011 INFO:teuthology.orchestra.run.smithi130.stdout: mon clock drift allowed = 1.000 2023-07-19T20:43:46.012 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.012 INFO:teuthology.orchestra.run.smithi130.stdout: osd crush chooseleaf type = 0 2023-07-19T20:43:46.012 INFO:teuthology.orchestra.run.smithi130.stdout: auth debug = true 2023-07-19T20:43:46.012 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.012 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on old message = true 2023-07-19T20:43:46.012 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on bug = true 2023-07-19T20:43:46.012 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.013 INFO:teuthology.orchestra.run.smithi130.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-19T20:43:46.013 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn max object skew = 0 2023-07-19T20:43:46.013 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.013 INFO:teuthology.orchestra.run.smithi130.stdout: # disable pg_autoscaler by default for new pools 2023-07-19T20:43:46.013 INFO:teuthology.orchestra.run.smithi130.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-19T20:43:46.013 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.013 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default size = 2 2023-07-19T20:43:46.013 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.014 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow primary affinity = true 2023-07-19T20:43:46.014 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow pg remap = true 2023-07-19T20:43:46.014 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on legacy crush tunables = false 2023-07-19T20:43:46.014 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on crush straw calc version zero = false 2023-07-19T20:43:46.014 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on no sortbitwise = false 2023-07-19T20:43:46.014 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on osd down out interval zero = false 2023-07-19T20:43:46.014 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on too few osds = false 2023-07-19T20:43:46.014 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-19T20:43:46.015 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-19T20:43:46.015 INFO:teuthology.orchestra.run.smithi130.stdout: mon_allow_pool_size_one = true 2023-07-19T20:43:46.015 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.015 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-19T20:43:46.015 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.015 INFO:teuthology.orchestra.run.smithi130.stdout: osd default data pool replay window = 5 2023-07-19T20:43:46.015 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.016 INFO:teuthology.orchestra.run.smithi130.stdout: mon allow pool delete = true 2023-07-19T20:43:46.016 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.016 INFO:teuthology.orchestra.run.smithi130.stdout: mon cluster log file level = debug 2023-07-19T20:43:46.016 INFO:teuthology.orchestra.run.smithi130.stdout: debug asserts on shutdown = true 2023-07-19T20:43:46.016 INFO:teuthology.orchestra.run.smithi130.stdout: mon health detail to clog = false 2023-07-19T20:43:46.016 INFO:teuthology.orchestra.run.smithi130.stdout: mon host = "172.21.15.117,172.21.15.124,[v2:172.21.15.124:3301,v1:172.21.15.124:6790]" 2023-07-19T20:43:46.016 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn min per osd = 0 2023-07-19T20:43:46.016 INFO:teuthology.orchestra.run.smithi130.stdout: fsid = 46db5732-4a4f-4d1e-835b-9507e9513c02 2023-07-19T20:43:46.017 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.017 INFO:teuthology.orchestra.run.smithi130.stdout:[osd] 2023-07-19T20:43:46.017 INFO:teuthology.orchestra.run.smithi130.stdout: osd journal size = 100 2023-07-19T20:43:46.017 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.017 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub load threshold = 5.0 2023-07-19T20:43:46.017 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub max interval = 600 2023-07-19T20:43:46.017 INFO:teuthology.orchestra.run.smithi130.stdout: osd mclock profile = high_recovery_ops 2023-07-19T20:43:46.017 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.018 INFO:teuthology.orchestra.run.smithi130.stdout: osd recover clone overlap = true 2023-07-19T20:43:46.018 INFO:teuthology.orchestra.run.smithi130.stdout: osd recovery max chunk = 1048576 2023-07-19T20:43:46.018 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.018 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug shutdown = true 2023-07-19T20:43:46.018 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug op order = true 2023-07-19T20:43:46.019 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify stray on activate = true 2023-07-19T20:43:46.019 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.019 INFO:teuthology.orchestra.run.smithi130.stdout: osd open classes on start = true 2023-07-19T20:43:46.019 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug pg log writeout = true 2023-07-19T20:43:46.019 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.019 INFO:teuthology.orchestra.run.smithi130.stdout: osd deep scrub update digest min age = 30 2023-07-19T20:43:46.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.020 INFO:teuthology.orchestra.run.smithi130.stdout: osd map max advance = 10 2023-07-19T20:43:46.021 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.021 INFO:teuthology.orchestra.run.smithi130.stdout: journal zero on create = true 2023-07-19T20:43:46.021 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.021 INFO:teuthology.orchestra.run.smithi130.stdout: filestore ondisk finisher threads = 3 2023-07-19T20:43:46.021 INFO:teuthology.orchestra.run.smithi130.stdout: filestore apply finisher threads = 3 2023-07-19T20:43:46.021 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.021 INFO:teuthology.orchestra.run.smithi130.stdout: bdev debug aio = true 2023-07-19T20:43:46.021 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug misdirected ops = true 2023-07-19T20:43:46.022 INFO:teuthology.orchestra.run.smithi130.stdout: bdev async discard = True 2023-07-19T20:43:46.022 INFO:teuthology.orchestra.run.smithi130.stdout: bdev enable discard = True 2023-07-19T20:43:46.022 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore allocator = bitmap 2023-07-19T20:43:46.022 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore block size = 96636764160 2023-07-19T20:43:46.022 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore fsck on mount = True 2023-07-19T20:43:46.022 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluefs = 1/20 2023-07-19T20:43:46.022 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluestore = 1/20 2023-07-19T20:43:46.023 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-07-19T20:43:46.023 INFO:teuthology.orchestra.run.smithi130.stdout: debug osd = 20 2023-07-19T20:43:46.023 INFO:teuthology.orchestra.run.smithi130.stdout: debug rocksdb = 4/10 2023-07-19T20:43:46.023 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd backfillfull_ratio = 0.85 2023-07-19T20:43:46.023 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd full ratio = 0.9 2023-07-19T20:43:46.023 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd nearfull ratio = 0.8 2023-07-19T20:43:46.023 INFO:teuthology.orchestra.run.smithi130.stdout: osd failsafe full ratio = 0.95 2023-07-19T20:43:46.023 INFO:teuthology.orchestra.run.smithi130.stdout: osd objectstore = bluestore 2023-07-19T20:43:46.024 INFO:teuthology.orchestra.run.smithi130.stdout: osd op complaint time = 180 2023-07-19T20:43:46.024 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.024 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr] 2023-07-19T20:43:46.024 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-07-19T20:43:46.024 INFO:teuthology.orchestra.run.smithi130.stdout: debug mgr = 20 2023-07-19T20:43:46.024 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2023-07-19T20:43:46.024 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2023-07-19T20:43:46.025 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2023-07-19T20:43:46.025 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2023-07-19T20:43:46.025 INFO:teuthology.orchestra.run.smithi130.stdout: mgr/telemetry/nag = false 2023-07-19T20:43:46.025 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.025 INFO:teuthology.orchestra.run.smithi130.stdout:[mon] 2023-07-19T20:43:46.025 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-07-19T20:43:46.025 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2023-07-19T20:43:46.025 INFO:teuthology.orchestra.run.smithi130.stdout: debug paxos = 20 2023-07-19T20:43:46.026 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2023-07-19T20:43:46.026 INFO:teuthology.orchestra.run.smithi130.stdout: mon data avail warn = 5 2023-07-19T20:43:46.026 INFO:teuthology.orchestra.run.smithi130.stdout: mon mgr mkfs grace = 240 2023-07-19T20:43:46.026 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2023-07-19T20:43:46.026 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd reporter subtree level = osd 2023-07-19T20:43:46.026 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd prime pg temp = true 2023-07-19T20:43:46.026 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2023-07-19T20:43:46.026 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.027 INFO:teuthology.orchestra.run.smithi130.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-19T20:43:46.027 INFO:teuthology.orchestra.run.smithi130.stdout: auth mon ticket ttl = 660 # 11m 2023-07-19T20:43:46.027 INFO:teuthology.orchestra.run.smithi130.stdout: auth service ticket ttl = 240 # 4m 2023-07-19T20:43:46.027 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.027 INFO:teuthology.orchestra.run.smithi130.stdout: # don't complain about insecure global_id in the test suite 2023-07-19T20:43:46.027 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-19T20:43:46.027 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-19T20:43:46.027 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.030 INFO:teuthology.orchestra.run.smithi130.stdout: # 1m isn't quite enough 2023-07-19T20:43:46.030 INFO:teuthology.orchestra.run.smithi130.stdout: mon_down_mkfs_grace = 2m 2023-07-19T20:43:46.030 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.030 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_filestore_osds = false 2023-07-19T20:43:46.030 INFO:teuthology.orchestra.run.smithi130.stdout: mon op complaint time = 120 2023-07-19T20:43:46.031 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:43:46.031 INFO:teuthology.orchestra.run.smithi130.stdout:[client] 2023-07-19T20:43:46.031 INFO:teuthology.orchestra.run.smithi130.stdout: rgw cache enabled = true 2023-07-19T20:43:46.031 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable ops log = true 2023-07-19T20:43:46.031 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable usage log = true 2023-07-19T20:43:46.031 INFO:teuthology.orchestra.run.smithi130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-19T20:43:46.031 INFO:teuthology.orchestra.run.smithi130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-19T20:43:46.031 INFO:teuthology.orchestra.run.smithi130.stdout: client mount timeout = 600 2023-07-19T20:43:46.032 INFO:teuthology.orchestra.run.smithi130.stdout: debug client = 20 2023-07-19T20:43:46.032 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-07-19T20:43:46.032 INFO:teuthology.orchestra.run.smithi130.stdout: rados mon op timeout = 900 2023-07-19T20:43:46.032 INFO:teuthology.orchestra.run.smithi130.stdout: rados osd op timeout = 900 2023-07-19T20:43:46.032 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.a] 2023-07-19T20:43:46.032 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.b] 2023-07-19T20:43:46.032 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.c] 2023-07-19T20:43:46.032 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2023-07-19T20:43:46.033 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2023-07-19T20:43:46.033 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2023-07-19T20:43:46.033 INFO:teuthology.orchestra.run.smithi130.stdout:[mds] 2023-07-19T20:43:46.033 INFO:teuthology.orchestra.run.smithi130.stdout: debug mds = 20 2023-07-19T20:43:46.033 INFO:teuthology.orchestra.run.smithi130.stdout: debug mds balancer = 20 2023-07-19T20:43:46.033 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-07-19T20:43:46.033 INFO:teuthology.orchestra.run.smithi130.stdout: mds debug frag = True 2023-07-19T20:43:46.033 INFO:teuthology.orchestra.run.smithi130.stdout: mds debug scatterstat = True 2023-07-19T20:43:46.034 INFO:teuthology.orchestra.run.smithi130.stdout: mds op complaint time = 180 2023-07-19T20:43:46.034 INFO:teuthology.orchestra.run.smithi130.stdout: mds verify scatter = True 2023-07-19T20:43:46.034 INFO:teuthology.orchestra.run.smithi130.stdout: osd op complaint time = 180 2023-07-19T20:43:46.034 INFO:teuthology.orchestra.run.smithi130.stdout: rados mon op timeout = 900 2023-07-19T20:43:46.034 INFO:teuthology.orchestra.run.smithi130.stdout: rados osd op timeout = 900 2023-07-19T20:43:46.039 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-19T20:43:46.039 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-19T20:43:46.097 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-19T20:43:46.097 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:43:46.097 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-19T20:43:46.115 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:43:46.115 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-19T20:43:46.173 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2023-07-19T20:43:46.175 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:43:46.175 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-19T20:43:46.175 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-19T20:43:46.249 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:43:46.250 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:43:46.307 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi124.front.sepia.ceph.com 2023-07-19T20:43:46.309 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:43:46.309 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-19T20:43:46.309 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-19T20:43:46.354 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:43:46.354 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:43:46.416 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi130.front.sepia.ceph.com 2023-07-19T20:43:46.417 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:43:46.417 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-19T20:43:46.417 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-19T20:43:46.512 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:43:46.513 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:43:46.597 INFO:tasks.ceph:Setting up mon nodes... 2023-07-19T20:43:46.598 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-19T20:43:46.598 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-19T20:43:46.653 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-19T20:43:46.655 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-19T20:43:46.725 INFO:teuthology.orchestra.run.smithi124.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-19T20:43:46.728 INFO:tasks.ceph:Setting up mds nodes... 2023-07-19T20:43:46.729 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-19T20:43:46.782 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-19T20:43:46.786 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-19T20:43:46.819 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-19T20:43:46.912 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-19T20:43:46.915 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-19T20:43:46.941 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-19T20:43:47.003 INFO:teuthology.orchestra.run.smithi124.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-19T20:43:47.006 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-19T20:43:47.036 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-19T20:43:47.037 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-19T20:43:47.147 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-19T20:43:47.179 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-19T20:43:47.179 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi124.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-19T20:43:47.180 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-19T20:43:47.207 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-19T20:43:47.208 INFO:tasks.ceph:role: osd.0 2023-07-19T20:43:47.208 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2023-07-19T20:43:47.209 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-19T20:43:47.282 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-19T20:43:47.283 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-19T20:43:47.283 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-19T20:43:47.283 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-19T20:43:47.284 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-19T20:43:47.284 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-07-19T20:43:47.284 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-19T20:43:47.284 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-19T20:43:47.284 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-19T20:43:47.284 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-19T20:43:47.723 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-07-19T20:43:47.725 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-07-19T20:43:47.725 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-19T20:43:47.912 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-19T20:43:47.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-19T20:43:48.023 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-19T20:43:48.023 INFO:tasks.ceph:role: osd.1 2023-07-19T20:43:48.024 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2023-07-19T20:43:48.025 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-19T20:43:48.113 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-19T20:43:48.113 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-19T20:43:48.113 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-19T20:43:48.114 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-19T20:43:48.114 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-19T20:43:48.114 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-07-19T20:43:48.114 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-19T20:43:48.114 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-19T20:43:48.115 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-19T20:43:48.115 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-19T20:43:48.521 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-07-19T20:43:48.522 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-07-19T20:43:48.523 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-19T20:43:48.639 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-19T20:43:48.673 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-19T20:43:48.743 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-19T20:43:48.744 INFO:tasks.ceph:role: osd.2 2023-07-19T20:43:48.744 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2023-07-19T20:43:48.744 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-19T20:43:48.823 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-19T20:43:48.823 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-19T20:43:48.824 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-19T20:43:48.824 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-19T20:43:48.824 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-19T20:43:48.824 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-07-19T20:43:48.824 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-19T20:43:48.824 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-19T20:43:48.824 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-19T20:43:48.825 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-19T20:43:49.271 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-07-19T20:43:49.273 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-07-19T20:43:49.273 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-19T20:43:49.422 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-19T20:43:49.457 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-19T20:43:49.525 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-19T20:43:49.526 INFO:tasks.ceph:role: osd.3 2023-07-19T20:43:49.526 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2023-07-19T20:43:49.526 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-19T20:43:49.605 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-19T20:43:49.605 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-19T20:43:49.606 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-19T20:43:49.606 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-19T20:43:49.606 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-19T20:43:49.606 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-07-19T20:43:49.607 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-19T20:43:49.607 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-19T20:43:49.607 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-19T20:43:49.607 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-19T20:43:50.057 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-07-19T20:43:50.059 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-07-19T20:43:50.060 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-19T20:43:50.257 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-19T20:43:50.292 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:43:50.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:50.391+0000 7feff084e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-19T20:43:50.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:50.392+0000 7feff084e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-19T20:43:50.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:50.392+0000 7feff084e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-19T20:43:50.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:50.392+0000 7feff084e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-19T20:43:50.387 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:50.392+0000 7feff084e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-19T20:43:50.387 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:50.392+0000 7feff084e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-19T20:43:53.236 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-19T20:43:53.269 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:43:53.361 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:53.367+0000 7f7647539640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-19T20:43:53.361 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:53.367+0000 7f7647539640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-19T20:43:53.361 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:53.367+0000 7f7647539640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-19T20:43:53.362 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:53.367+0000 7f7647539640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-19T20:43:53.362 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:53.367+0000 7f7647539640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-19T20:43:53.362 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:53.368+0000 7f7647539640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-19T20:43:56.215 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-19T20:43:56.248 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:43:56.341 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:56.348+0000 7fd033259640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-19T20:43:56.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:56.348+0000 7fd033259640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-19T20:43:56.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:56.348+0000 7fd033259640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-19T20:43:56.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:56.348+0000 7fd033259640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-19T20:43:56.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:56.348+0000 7fd033259640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-19T20:43:56.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:56.348+0000 7fd033259640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-19T20:43:59.197 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-19T20:43:59.230 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:43:59.327 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:59.332+0000 7fa7d65f6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-19T20:43:59.328 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:59.333+0000 7fa7d65f6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-19T20:43:59.328 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:59.333+0000 7fa7d65f6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-19T20:43:59.328 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:59.333+0000 7fa7d65f6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-19T20:43:59.328 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:59.333+0000 7fa7d65f6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-19T20:43:59.329 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:43:59.333+0000 7fa7d65f6640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-19T20:44:02.174 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-19T20:44:02.209 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-19T20:44:02.243 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-19T20:44:02.243 INFO:tasks.ceph:role: osd.4 2023-07-19T20:44:02.243 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi124.front.sepia.ceph.com 2023-07-19T20:44:02.243 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-19T20:44:02.321 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-19T20:44:02.322 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-19T20:44:02.323 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-19T20:44:02.323 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-19T20:44:02.323 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-19T20:44:02.323 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2023-07-19T20:44:02.324 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-19T20:44:02.324 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-19T20:44:02.324 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-19T20:44:02.324 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-19T20:44:02.747 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2023-07-19T20:44:02.749 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2023-07-19T20:44:02.750 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-19T20:44:02.922 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-19T20:44:02.962 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-19T20:44:03.034 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-19T20:44:03.034 INFO:tasks.ceph:role: osd.5 2023-07-19T20:44:03.035 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi124.front.sepia.ceph.com 2023-07-19T20:44:03.035 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-19T20:44:03.113 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-19T20:44:03.113 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-19T20:44:03.114 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-19T20:44:03.114 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-19T20:44:03.114 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-19T20:44:03.114 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2023-07-19T20:44:03.114 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-19T20:44:03.115 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-19T20:44:03.115 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-19T20:44:03.115 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-19T20:44:03.550 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2023-07-19T20:44:03.552 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2023-07-19T20:44:03.552 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-19T20:44:03.661 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-19T20:44:03.698 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-19T20:44:03.771 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-19T20:44:03.771 INFO:tasks.ceph:role: osd.6 2023-07-19T20:44:03.772 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi124.front.sepia.ceph.com 2023-07-19T20:44:03.772 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-19T20:44:03.852 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-19T20:44:03.853 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-19T20:44:03.853 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-19T20:44:03.853 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-19T20:44:03.853 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-19T20:44:03.853 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2023-07-19T20:44:03.854 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-19T20:44:03.854 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-19T20:44:03.854 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-19T20:44:03.854 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-19T20:44:04.297 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2023-07-19T20:44:04.300 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2023-07-19T20:44:04.300 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-19T20:44:04.453 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-19T20:44:04.491 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-19T20:44:04.565 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-19T20:44:04.565 INFO:tasks.ceph:role: osd.7 2023-07-19T20:44:04.566 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi124.front.sepia.ceph.com 2023-07-19T20:44:04.566 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-19T20:44:04.647 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-19T20:44:04.648 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-19T20:44:04.648 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-19T20:44:04.648 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-19T20:44:04.649 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-19T20:44:04.649 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2023-07-19T20:44:04.649 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-19T20:44:04.649 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-19T20:44:04.650 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-19T20:44:04.650 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-19T20:44:05.093 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2023-07-19T20:44:05.095 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2023-07-19T20:44:05.098 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-19T20:44:05.252 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-19T20:44:05.294 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:44:05.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:05.397+0000 7f4ec6041640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-19T20:44:05.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:05.398+0000 7f4ec6041640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-19T20:44:05.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:05.398+0000 7f4ec6041640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-19T20:44:05.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:05.398+0000 7f4ec6041640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-19T20:44:05.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:05.398+0000 7f4ec6041640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-19T20:44:05.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:05.398+0000 7f4ec6041640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-19T20:44:08.246 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-19T20:44:08.281 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:44:08.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:08.383+0000 7f9c0ab42640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-19T20:44:08.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:08.384+0000 7f9c0ab42640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-19T20:44:08.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:08.384+0000 7f9c0ab42640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-19T20:44:08.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:08.384+0000 7f9c0ab42640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-19T20:44:08.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:08.384+0000 7f9c0ab42640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-19T20:44:08.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:08.384+0000 7f9c0ab42640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-19T20:44:11.230 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-19T20:44:11.263 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:44:11.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:11.366+0000 7fe18aa6f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-19T20:44:11.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:11.366+0000 7fe18aa6f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-19T20:44:11.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:11.366+0000 7fe18aa6f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-19T20:44:11.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:11.366+0000 7fe18aa6f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-19T20:44:11.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:11.366+0000 7fe18aa6f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-19T20:44:11.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:11.367+0000 7fe18aa6f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-19T20:44:13.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:44:13.782 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:44:13.784 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:44:14.223 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-19T20:44:14.258 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:44:14.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:14.361+0000 7fdc7e422640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-19T20:44:14.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:14.362+0000 7fdc7e422640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-19T20:44:14.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:14.362+0000 7fdc7e422640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-19T20:44:14.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:14.362+0000 7fdc7e422640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-19T20:44:14.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:14.362+0000 7fdc7e422640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-19T20:44:14.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:14.362+0000 7fdc7e422640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-19T20:44:17.213 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-19T20:44:17.247 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-19T20:44:17.247 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:44:17.248 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-19T20:44:17.281 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:44:17.281 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-19T20:44:17.355 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:44:17.355 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-19T20:44:17.426 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:44:17.426 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-19T20:44:17.498 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:44:17.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-19T20:44:17.568 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:44:17.569 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-19T20:44:17.637 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:44:17.638 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-19T20:44:17.706 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:44:17.706 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-19T20:44:17.738 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:44:17.739 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-19T20:44:17.808 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:44:17.809 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-19T20:44:17.877 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:44:17.878 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-19T20:44:17.945 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:44:17.946 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-19T20:44:18.015 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:44:18.015 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-19T20:44:18.082 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:44:18.083 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-19T20:44:18.135 INFO:tasks.ceph:Adding keys to all mons... 2023-07-19T20:44:18.135 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-19T20:44:18.139 DEBUG:teuthology.orchestra.run.smithi124:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-19T20:44:18.166 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr.y] 2023-07-19T20:44:18.167 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQACS7hkYftYJxAAo5qtnWajZJAk+N/ykp1Rxg== 2023-07-19T20:44:18.167 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.a] 2023-07-19T20:44:18.168 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQACS7hkDkQcLxAAzNxmo6hjgZCZWjLcij1uKg== 2023-07-19T20:44:18.168 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.c] 2023-07-19T20:44:18.168 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQACS7hkVE3XNhAAhuCLcBAT+LXYTnJEPOe25Q== 2023-07-19T20:44:18.168 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.0] 2023-07-19T20:44:18.169 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQAGS7hkwIpnFxAA8kQ9h4DuxAJSQQDQ8u2Exg== 2023-07-19T20:44:18.169 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.1] 2023-07-19T20:44:18.169 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQAJS7hkzMbzFRAAIT7HxQohBTpixe/4jtByaQ== 2023-07-19T20:44:18.170 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.2] 2023-07-19T20:44:18.170 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQAMS7hk64HKFBAAgqwMZViNddosEsiY7Rcvrw== 2023-07-19T20:44:18.170 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.3] 2023-07-19T20:44:18.171 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQAPS7hkHqXyExAAty0bRl5w3dx+nNmv+iHb7w== 2023-07-19T20:44:18.172 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr.x] 2023-07-19T20:44:18.172 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQACS7hkxACzKxAAuNarCn8GCSKJm9F/Ooz1RA== 2023-07-19T20:44:18.172 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.b] 2023-07-19T20:44:18.172 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQADS7hkpFepABAAQ9QVUKpJdxsGpF0+fhkizg== 2023-07-19T20:44:18.173 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.4] 2023-07-19T20:44:18.173 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQAVS7hk/L3GFxAALGTNTEK8fKZ4JlTzDmoO6Q== 2023-07-19T20:44:18.173 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.5] 2023-07-19T20:44:18.173 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQAYS7hkWRLzFhAAUKUWj2DFsiKBEANKJVUBvg== 2023-07-19T20:44:18.174 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.6] 2023-07-19T20:44:18.174 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQAbS7hkZjnoFRAATjzN1nn+MCDNuud8Fj+low== 2023-07-19T20:44:18.174 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.7] 2023-07-19T20:44:18.174 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQAeS7hkvjSgFRAAyQUumsHiYw2NvNfOaSjiFg== 2023-07-19T20:44:18.174 INFO:teuthology.orchestra.run.smithi124.stdout:[client.0] 2023-07-19T20:44:18.175 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQADS7hkov88CRAAHoaLO/lxvRuGZOni8NRqsg== 2023-07-19T20:44:18.177 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2023-07-19T20:44:18.178 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQACS7hkYftYJxAAo5qtnWajZJAk+N/ykp1Rxg== 2023-07-19T20:44:18.178 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2023-07-19T20:44:18.178 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQACS7hkDkQcLxAAzNxmo6hjgZCZWjLcij1uKg== 2023-07-19T20:44:18.178 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2023-07-19T20:44:18.178 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQACS7hkVE3XNhAAhuCLcBAT+LXYTnJEPOe25Q== 2023-07-19T20:44:18.178 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2023-07-19T20:44:18.178 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAGS7hkwIpnFxAA8kQ9h4DuxAJSQQDQ8u2Exg== 2023-07-19T20:44:18.179 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2023-07-19T20:44:18.179 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAJS7hkzMbzFRAAIT7HxQohBTpixe/4jtByaQ== 2023-07-19T20:44:18.179 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2023-07-19T20:44:18.179 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAMS7hk64HKFBAAgqwMZViNddosEsiY7Rcvrw== 2023-07-19T20:44:18.179 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2023-07-19T20:44:18.179 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAPS7hkHqXyExAAty0bRl5w3dx+nNmv+iHb7w== 2023-07-19T20:44:18.179 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2023-07-19T20:44:18.179 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQACS7hkxACzKxAAuNarCn8GCSKJm9F/Ooz1RA== 2023-07-19T20:44:18.180 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2023-07-19T20:44:18.180 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQADS7hkpFepABAAQ9QVUKpJdxsGpF0+fhkizg== 2023-07-19T20:44:18.180 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2023-07-19T20:44:18.180 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAVS7hk/L3GFxAALGTNTEK8fKZ4JlTzDmoO6Q== 2023-07-19T20:44:18.180 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2023-07-19T20:44:18.180 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAYS7hkWRLzFhAAUKUWj2DFsiKBEANKJVUBvg== 2023-07-19T20:44:18.180 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2023-07-19T20:44:18.181 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAbS7hkZjnoFRAATjzN1nn+MCDNuud8Fj+low== 2023-07-19T20:44:18.181 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2023-07-19T20:44:18.181 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAeS7hkvjSgFRAAyQUumsHiYw2NvNfOaSjiFg== 2023-07-19T20:44:18.181 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2023-07-19T20:44:18.181 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQADS7hkov88CRAAHoaLO/lxvRuGZOni8NRqsg== 2023-07-19T20:44:18.181 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-19T20:44:18.221 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-19T20:44:18.278 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-19T20:44:18.281 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-19T20:44:18.338 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-19T20:44:18.341 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-19T20:44:18.398 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.400 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.454 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.456 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.509 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.512 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.565 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.568 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.622 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-19T20:44:18.624 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-19T20:44:18.678 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-19T20:44:18.680 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-19T20:44:18.736 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.738 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.792 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.794 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.848 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.851 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.905 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.907 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-19T20:44:18.962 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-19T20:44:18.965 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-19T20:44:19.024 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-19T20:44:19.025 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-19T20:44:19.051 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-19T20:44:19.153 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-19T20:44:19.187 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-19T20:44:19.215 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-19T20:44:19.312 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-19T20:44:19.339 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-19T20:44:19.412 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-19T20:44:19.512 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-19T20:44:19.539 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:44:19.544 DEBUG:teuthology.orchestra.run.smithi124:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-19T20:44:19.602 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-19T20:44:19.603 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-19T20:44:19.603 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-19T20:44:19.613 INFO:tasks.ceph.mon.a:Started 2023-07-19T20:44:19.614 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-19T20:44:19.614 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-19T20:44:19.649 INFO:tasks.ceph.mon.b:Started 2023-07-19T20:44:19.650 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-19T20:44:19.651 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-19T20:44:19.657 INFO:tasks.ceph.mon.c:Started 2023-07-19T20:44:19.657 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-19T20:44:19.658 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-19T20:44:19.658 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-19T20:44:19.663 INFO:tasks.ceph.mgr.y:Started 2023-07-19T20:44:19.664 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-19T20:44:19.664 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-19T20:44:19.668 INFO:tasks.ceph.mgr.x:Started 2023-07-19T20:44:19.668 INFO:tasks.ceph:Setting crush tunables to default 2023-07-19T20:44:19.669 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd crush tunables default 2023-07-19T20:44:19.796 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.802+0000 7f1c33ceb700 1 Processor -- start 2023-07-19T20:44:19.797 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.803+0000 7f1c33ceb700 1 -- start start 2023-07-19T20:44:19.798 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.804+0000 7f1c33ceb700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c0b9b20 0x7f1c2c070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:19.799 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.804+0000 7f1c33ceb700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2c0708d0 con 0x7f1c2c0b8a40 2023-07-19T20:44:19.799 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.804+0000 7f1c33ceb700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2c06fc20 con 0x7f1c2c14ab00 2023-07-19T20:44:19.799 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.804+0000 7f1c33ceb700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0b9fc0 con 0x7f1c2c0b9b20 2023-07-19T20:44:19.799 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.804+0000 7f1c31a87700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1c2c0b8a40 0x7f1c2c0b6510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:60862/0 (socket says 172.21.15.117:60862) 2023-07-19T20:44:19.800 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.804+0000 7f1c31a87700 1 -- 172.21.15.117:0/3287615286 learned_addr learned my addr 172.21.15.117:0/3287615286 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:19.800 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.804+0000 7f1c32288700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c0b9b20 0x7f1c2c070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:19.800 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.804+0000 7f1c32288700 1 -- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c0b9b20 msgr2=0x7f1c2c070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-19T20:44:19.800 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.804+0000 7f1c32288700 1 -- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c0b9b20 msgr2=0x7f1c2c070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-19T20:44:19.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.804+0000 7f1c32288700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c0b9b20 0x7f1c2c070390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-19T20:44:19.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.804+0000 7f1c32288700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c0b9b20 0x7f1c2c070390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-19T20:44:19.979 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.986+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949850188 0 0) 0x7f1c2c0708d0 con 0x7f1c2c0b8a40 2023-07-19T20:44:19.979 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.986+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c180035b0 con 0x7f1c2c0b8a40 2023-07-19T20:44:19.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.986+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643057122 0 0) 0x7f1c2c06fc20 con 0x7f1c2c14ab00 2023-07-19T20:44:19.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.986+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c2c0708d0 con 0x7f1c2c14ab00 2023-07-19T20:44:19.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.986+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 <== mon.1 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3097152799 0 0) 0x7f1c2c0708d0 con 0x7f1c2c14ab00 2023-07-19T20:44:19.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.986+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c0b9b20 msgr2=0x7f1c2c070390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-19T20:44:19.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.986+0000 7f1c30a85700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c0b9b20 0x7f1c2c070390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:19.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.986+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 >> v1:172.21.15.117:6789/0 conn(0x7f1c2c0b8a40 legacy=0x7f1c2c0b6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:19.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.986+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c0ba260 con 0x7f1c2c14ab00 2023-07-19T20:44:19.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.986+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 <== mon.1 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f1c1c001670 con 0x7f1c2c14ab00 2023-07-19T20:44:19.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 >> v1:172.21.15.124:6789/0 conn(0x7f1c2c14ab00 legacy=0x7f1c2c0b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:19.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c30a85700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c18003c00 0x7f1c18003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:19.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c30a85700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c18004850 0x7f1c18004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:19.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c30a85700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c0b9b20 0x7f1c1800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:19.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0b9fc0 con 0x7f1c18003c00 2023-07-19T20:44:19.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c18005560 con 0x7f1c18004850 2023-07-19T20:44:19.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c18005720 con 0x7f1c2c0b9b20 2023-07-19T20:44:19.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c31a87700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c18003c00 0x7f1c18003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:19.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c32288700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c0b9b20 0x7f1c1800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:19.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c31286700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c18004850 0x7f1c18004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:19.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c31a87700 1 -- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c0b9b20 msgr2=0x7f1c1800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:19.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c31a87700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c0b9b20 0x7f1c1800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:19.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c31a87700 1 -- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c18004850 msgr2=0x7f1c18004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:19.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c31a87700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c18004850 0x7f1c18004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:19.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c31a87700 1 -- 172.21.15.117:0/3287615286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c0708d0 con 0x7f1c18003c00 2023-07-19T20:44:19.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c31286700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c18004850 0x7f1c18004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:19.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c31a87700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c18003c00 0x7f1c18003ff0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1c28001a80 tx=0x7f1c18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2ccf3c47025b31 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:19.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c28004b30 con 0x7f1c18003c00 2023-07-19T20:44:19.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c28004cb0 con 0x7f1c18003c00 2023-07-19T20:44:19.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.987+0000 7f1c30a85700 1 -- 172.21.15.117:0/3287615286 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c28007310 con 0x7f1c18003c00 2023-07-19T20:44:19.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.988+0000 7f1c33ceb700 1 -- 172.21.15.117:0/3287615286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c18003c00 msgr2=0x7f1c18003ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:19.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.988+0000 7f1c33ceb700 1 --2- 172.21.15.117:0/3287615286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c18003c00 0x7f1c18003ff0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1c28001a80 tx=0x7f1c18005880 comp rx=0 tx=0).stop 2023-07-19T20:44:19.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.988+0000 7f1c32288700 1 -- 172.21.15.117:0/3287615286 reap_dead start 2023-07-19T20:44:19.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.988+0000 7f1c33ceb700 1 -- 172.21.15.117:0/3287615286 shutdown_connections 2023-07-19T20:44:19.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.988+0000 7f1c33ceb700 1 -- 172.21.15.117:0/3287615286 >> 172.21.15.117:0/3287615286 conn(0x7f1c2c06cfa0 msgr2=0x7f1c2c06d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:19.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.988+0000 7f1c33ceb700 1 -- 172.21.15.117:0/3287615286 shutdown_connections 2023-07-19T20:44:19.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.988+0000 7f1c33ceb700 1 -- 172.21.15.117:0/3287615286 wait complete. 2023-07-19T20:44:19.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.989+0000 7f1c33ceb700 1 Processor -- start 2023-07-19T20:44:19.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.989+0000 7f1c33ceb700 1 -- start start 2023-07-19T20:44:19.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.990+0000 7f1c33ceb700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c18003c00 0x7f1c2c0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:19.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.990+0000 7f1c33ceb700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c142f30 0x7f1c2c1e3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:19.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.990+0000 7f1c33ceb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c2c1e36a0 0x7f1c2c1d0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:19.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.990+0000 7f1c33ceb700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0b5650 con 0x7f1c2c1e36a0 2023-07-19T20:44:19.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.990+0000 7f1c33ceb700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c141e40 con 0x7f1c18003c00 2023-07-19T20:44:19.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.990+0000 7f1c33ceb700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c1e3b10 con 0x7f1c2c142f30 2023-07-19T20:44:19.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c32288700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c2c1e36a0 0x7f1c2c1d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:19.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c31a87700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c18003c00 0x7f1c2c0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:19.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c32288700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c2c1e36a0 0x7f1c2c1d0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47608/0 (socket says 172.21.15.117:47608) 2023-07-19T20:44:19.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c32288700 1 -- 172.21.15.117:0/2977494109 learned_addr learned my addr 172.21.15.117:0/2977494109 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:19.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c31286700 1 --2- 172.21.15.117:0/2977494109 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c142f30 0x7f1c2c1e3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:19.992 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c32288700 1 -- 172.21.15.117:0/2977494109 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c142f30 msgr2=0x7f1c2c1e3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:19.993 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c32288700 1 --2- 172.21.15.117:0/2977494109 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c142f30 0x7f1c2c1e3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:19.993 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c32288700 1 -- 172.21.15.117:0/2977494109 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c18003c00 msgr2=0x7f1c2c0b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:19.993 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c32288700 1 --2- 172.21.15.117:0/2977494109 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c18003c00 0x7f1c2c0b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:19.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c32288700 1 -- 172.21.15.117:0/2977494109 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c1d25a0 con 0x7f1c2c1e36a0 2023-07-19T20:44:19.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c31286700 1 --2- 172.21.15.117:0/2977494109 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c142f30 0x7f1c2c1e3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:19.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c32288700 1 --2- 172.21.15.117:0/2977494109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c2c1e36a0 0x7f1c2c1d0960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c067910 tx=0x7f1c2400f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:19.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c227fc700 1 -- 172.21.15.117:0/2977494109 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2400fda0 con 0x7f1c2c1e36a0 2023-07-19T20:44:19.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c227fc700 1 -- 172.21.15.117:0/2977494109 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c24007e50 con 0x7f1c2c1e36a0 2023-07-19T20:44:19.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c33ceb700 1 -- 172.21.15.117:0/2977494109 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2c142050 con 0x7f1c2c1e36a0 2023-07-19T20:44:19.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.991+0000 7f1c33ceb700 1 -- 172.21.15.117:0/2977494109 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2c1433a0 con 0x7f1c2c1e36a0 2023-07-19T20:44:19.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.992+0000 7f1c227fc700 1 -- 172.21.15.117:0/2977494109 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24003c60 con 0x7f1c2c1e36a0 2023-07-19T20:44:19.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.992+0000 7f1c227fc700 1 -- 172.21.15.117:0/2977494109 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1c24004030 con 0x7f1c2c1e36a0 2023-07-19T20:44:19.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.992+0000 7f1c227fc700 1 -- 172.21.15.117:0/2977494109 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1c24015510 con 0x7f1c2c1e36a0 2023-07-19T20:44:19.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.992+0000 7f1c33ceb700 1 -- 172.21.15.117:0/2977494109 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c140052e0 con 0x7f1c2c1e36a0 2023-07-19T20:44:19.997 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:19.995+0000 7f1c227fc700 1 -- 172.21.15.117:0/2977494109 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f1c2401b070 con 0x7f1c2c1e36a0 2023-07-19T20:44:20.065 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:20.072+0000 7f1c33ceb700 1 -- 172.21.15.117:0/2977494109 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f1c14005860 con 0x7f1c2c1e36a0 2023-07-19T20:44:20.068 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:20.074+0000 7f1c227fc700 1 -- 172.21.15.117:0/2977494109 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1c24004470 con 0x7f1c2c1e36a0 2023-07-19T20:44:20.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:20.075+0000 7f1c33ceb700 1 -- 172.21.15.117:0/2977494109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c2c1e36a0 msgr2=0x7f1c2c1d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:20.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:20.075+0000 7f1c33ceb700 1 --2- 172.21.15.117:0/2977494109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c2c1e36a0 0x7f1c2c1d0960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c067910 tx=0x7f1c2400f430 comp rx=0 tx=0).stop 2023-07-19T20:44:20.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:20.075+0000 7f1c33ceb700 1 -- 172.21.15.117:0/2977494109 shutdown_connections 2023-07-19T20:44:20.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:20.075+0000 7f1c33ceb700 1 --2- 172.21.15.117:0/2977494109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c2c1e36a0 0x7f1c2c1d0960 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:20.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:20.075+0000 7f1c33ceb700 1 --2- 172.21.15.117:0/2977494109 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c18003c00 0x7f1c2c0b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:20.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:20.075+0000 7f1c33ceb700 1 --2- 172.21.15.117:0/2977494109 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1c2c142f30 0x7f1c2c1e3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:20.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:20.075+0000 7f1c33ceb700 1 -- 172.21.15.117:0/2977494109 >> 172.21.15.117:0/2977494109 conn(0x7f1c2c06cfa0 msgr2=0x7f1c2c0b73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:20.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:20.076+0000 7f1c33ceb700 1 -- 172.21.15.117:0/2977494109 shutdown_connections 2023-07-19T20:44:20.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:20.076+0000 7f1c33ceb700 1 -- 172.21.15.117:0/2977494109 wait complete. 2023-07-19T20:44:20.071 INFO:teuthology.orchestra.run.smithi117.stderr:adjusted tunables profile to default 2023-07-19T20:44:20.082 INFO:tasks.ceph:check_enable_crimson: False 2023-07-19T20:44:20.083 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-19T20:44:20.083 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:44:20.084 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-19T20:44:20.102 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:20.108+0000 7f765b5f0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-19T20:44:20.109 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:20.115+0000 7f31b328c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-19T20:44:20.111 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:44:20.111 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-19T20:44:20.179 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:44:20.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-19T20:44:20.259 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-07-19T20:44:20.259 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-19T20:44:20.274 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:20.281+0000 7f765b5f0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-19T20:44:20.287 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:20.294+0000 7f31b328c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-19T20:44:20.318 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:44:20.319 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-19T20:44:20.346 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:44:20.347 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-19T20:44:20.413 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:44:20.414 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-19T20:44:20.480 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-07-19T20:44:20.480 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-19T20:44:20.547 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new ba167591-6958-4ea1-9575-8c134f47ca2e 0 2023-07-19T20:44:20.624 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:20.630+0000 7f31b328c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-19T20:44:20.629 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:20.636+0000 7f765b5f0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-19T20:44:20.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.718+0000 7f51282d2700 1 Processor -- start 2023-07-19T20:44:20.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.718+0000 7f51282d2700 1 -- start start 2023-07-19T20:44:20.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f51282d2700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f51200721e0 0x7f51200b9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:20.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f51282d2700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5120147aa0 0x7f5120147f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:20.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f51282d2700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51200be6e0 con 0x7f512009cf10 2023-07-19T20:44:20.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f51282d2700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5120148460 con 0x7f5120147aa0 2023-07-19T20:44:20.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f51282d2700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512006e170 con 0x7f51200721e0 2023-07-19T20:44:20.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f512586d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f51200721e0 0x7f51200b9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:20.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f512686f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5120147aa0 0x7f5120147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:20.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f512586d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f51200721e0 0x7f51200b9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:57202/0 (socket says 172.21.15.124:57202) 2023-07-19T20:44:20.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f512586d700 1 -- 172.21.15.124:0/2010866777 learned_addr learned my addr 172.21.15.124:0/2010866777 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:20.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f512686f700 1 -- 172.21.15.124:0/2010866777 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f51200721e0 msgr2=0x7f51200b9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:20.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f512686f700 1 --2- 172.21.15.124:0/2010866777 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f51200721e0 0x7f51200b9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:20.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f512686f700 1 -- 172.21.15.124:0/2010866777 >> v1:172.21.15.117:6789/0 conn(0x7f512009cf10 legacy=0x7f51200bdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:20.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f512686f700 1 -- 172.21.15.124:0/2010866777 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512006e450 con 0x7f5120147aa0 2023-07-19T20:44:20.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f512586d700 1 --2- 172.21.15.124:0/2010866777 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f51200721e0 0x7f51200b9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:20.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.719+0000 7f512506c700 1 -- 172.21.15.124:0/2010866777 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675918116 0 0) 0x7f51200be6e0 con 0x7f512009cf10 2023-07-19T20:44:20.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.720+0000 7f512686f700 1 --2- 172.21.15.124:0/2010866777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5120147aa0 0x7f5120147f20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5118009d90 tx=0x7f511800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8432b5d429e7dca server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:20.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.720+0000 7f512506c700 1 -- 172.21.15.124:0/2010866777 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511800e070 con 0x7f5120147aa0 2023-07-19T20:44:20.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.720+0000 7f512506c700 1 -- 172.21.15.124:0/2010866777 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511800bb20 con 0x7f5120147aa0 2023-07-19T20:44:20.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.720+0000 7f512506c700 1 -- 172.21.15.124:0/2010866777 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5118012430 con 0x7f5120147aa0 2023-07-19T20:44:20.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.720+0000 7f51282d2700 1 -- 172.21.15.124:0/2010866777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5120147aa0 msgr2=0x7f5120147f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:20.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.720+0000 7f51282d2700 1 --2- 172.21.15.124:0/2010866777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5120147aa0 0x7f5120147f20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5118009d90 tx=0x7f511800b330 comp rx=0 tx=0).stop 2023-07-19T20:44:20.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.720+0000 7f51282d2700 1 -- 172.21.15.124:0/2010866777 shutdown_connections 2023-07-19T20:44:20.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.720+0000 7f51282d2700 1 --2- 172.21.15.124:0/2010866777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5120147aa0 0x7f5120147f20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:20.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.720+0000 7f51282d2700 1 --2- 172.21.15.124:0/2010866777 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f51200721e0 0x7f51200b9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:20.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.720+0000 7f51282d2700 1 -- 172.21.15.124:0/2010866777 >> 172.21.15.124:0/2010866777 conn(0x7f512006c300 msgr2=0x7f51200bd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:20.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.720+0000 7f51282d2700 1 -- 172.21.15.124:0/2010866777 shutdown_connections 2023-07-19T20:44:20.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.720+0000 7f51282d2700 1 -- 172.21.15.124:0/2010866777 wait complete. 2023-07-19T20:44:20.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.722+0000 7f51282d2700 1 Processor -- start 2023-07-19T20:44:20.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.722+0000 7f51282d2700 1 -- start start 2023-07-19T20:44:20.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.722+0000 7f51282d2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51200721e0 0x7f51200a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:20.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.722+0000 7f51282d2700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f512009cf10 0x7f512009c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:20.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.722+0000 7f51282d2700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5120147aa0 0x7f51201e3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:20.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.722+0000 7f51282d2700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51200a0970 con 0x7f51200721e0 2023-07-19T20:44:20.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.722+0000 7f51282d2700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51200a25e0 con 0x7f5120147aa0 2023-07-19T20:44:20.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.722+0000 7f51282d2700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51200a0bc0 con 0x7f512009cf10 2023-07-19T20:44:20.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.722+0000 7f512586d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f512009cf10 0x7f512009c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:20.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.722+0000 7f512586d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f512009cf10 0x7f512009c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:57218/0 (socket says 172.21.15.124:57218) 2023-07-19T20:44:20.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.722+0000 7f512686f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5120147aa0 0x7f51201e3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:20.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.722+0000 7f512586d700 1 -- 172.21.15.124:0/2894590040 learned_addr learned my addr 172.21.15.124:0/2894590040 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:20.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.722+0000 7f512606e700 1 --2- 172.21.15.124:0/2894590040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51200721e0 0x7f51200a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:20.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.723+0000 7f512586d700 1 -- 172.21.15.124:0/2894590040 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5120147aa0 msgr2=0x7f51201e3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:20.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.723+0000 7f512586d700 1 --2- 172.21.15.124:0/2894590040 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5120147aa0 0x7f51201e3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:20.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.723+0000 7f512586d700 1 -- 172.21.15.124:0/2894590040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51200721e0 msgr2=0x7f51200a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:20.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.723+0000 7f512586d700 1 --2- 172.21.15.124:0/2894590040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51200721e0 0x7f51200a2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:20.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.723+0000 7f512586d700 1 -- 172.21.15.124:0/2894590040 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511000b7f0 con 0x7f512009cf10 2023-07-19T20:44:20.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.723+0000 7f512686f700 1 --2- 172.21.15.124:0/2894590040 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5120147aa0 0x7f51201e3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:20.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.723+0000 7f512586d700 1 --2- 172.21.15.124:0/2894590040 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f512009cf10 0x7f512009c4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f511000ed70 tx=0x7f511000d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:20.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.723+0000 7f5116ffd700 1 -- 172.21.15.124:0/2894590040 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000ee60 con 0x7f512009cf10 2023-07-19T20:44:20.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.723+0000 7f5116ffd700 1 -- 172.21.15.124:0/2894590040 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5110010440 con 0x7f512009cf10 2023-07-19T20:44:20.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.723+0000 7f51282d2700 1 -- 172.21.15.124:0/2894590040 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5118009a70 con 0x7f512009cf10 2023-07-19T20:44:20.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.723+0000 7f5116ffd700 1 -- 172.21.15.124:0/2894590040 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51100107b0 con 0x7f512009cf10 2023-07-19T20:44:20.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.723+0000 7f51282d2700 1 -- 172.21.15.124:0/2894590040 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51200a0ea0 con 0x7f512009cf10 2023-07-19T20:44:20.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.723+0000 7f5116ffd700 1 -- 172.21.15.124:0/2894590040 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5110005d20 con 0x7f512009cf10 2023-07-19T20:44:20.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.723+0000 7f5116ffd700 1 -- 172.21.15.124:0/2894590040 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5110006670 con 0x7f512009cf10 2023-07-19T20:44:20.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.724+0000 7f51282d2700 1 -- 172.21.15.124:0/2894590040 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51200a2440 con 0x7f512009cf10 2023-07-19T20:44:20.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.726+0000 7f5116ffd700 1 -- 172.21.15.124:0/2894590040 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f51200a2440 con 0x7f512009cf10 2023-07-19T20:44:20.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.809+0000 7f51282d2700 1 -- 172.21.15.124:0/2894590040 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ba167591-6958-4ea1-9575-8c134f47ca2e", "id": 0} v 0) v1 -- 0x7f51200a2ac0 con 0x7f512009cf10 2023-07-19T20:44:20.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.813+0000 7f5116ffd700 1 -- 172.21.15.124:0/2894590040 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ba167591-6958-4ea1-9575-8c134f47ca2e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f51200a2ac0 con 0x7f512009cf10 2023-07-19T20:44:20.806 INFO:teuthology.orchestra.run.smithi124.stdout:0 2023-07-19T20:44:20.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.813+0000 7f51282d2700 1 -- 172.21.15.124:0/2894590040 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f512009cf10 msgr2=0x7f512009c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:20.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.813+0000 7f51282d2700 1 --2- 172.21.15.124:0/2894590040 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f512009cf10 0x7f512009c4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f511000ed70 tx=0x7f511000d630 comp rx=0 tx=0).stop 2023-07-19T20:44:20.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.814+0000 7f51282d2700 1 -- 172.21.15.124:0/2894590040 shutdown_connections 2023-07-19T20:44:20.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.814+0000 7f51282d2700 1 --2- 172.21.15.124:0/2894590040 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5120147aa0 0x7f51201e3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:20.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.814+0000 7f51282d2700 1 --2- 172.21.15.124:0/2894590040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51200721e0 0x7f51200a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:20.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.814+0000 7f51282d2700 1 --2- 172.21.15.124:0/2894590040 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f512009cf10 0x7f512009c4c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:20.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.814+0000 7f51282d2700 1 -- 172.21.15.124:0/2894590040 >> 172.21.15.124:0/2894590040 conn(0x7f512006c300 msgr2=0x7f512009ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:20.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.814+0000 7f51282d2700 1 -- 172.21.15.124:0/2894590040 shutdown_connections 2023-07-19T20:44:20.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.814+0000 7f51282d2700 1 -- 172.21.15.124:0/2894590040 wait complete. 2023-07-19T20:44:20.819 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new a7edc950-d9a1-4925-86bc-0ebc219286e0 1 2023-07-19T20:44:20.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.991+0000 7f874a607700 1 Processor -- start 2023-07-19T20:44:20.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.991+0000 7f874a607700 1 -- start start 2023-07-19T20:44:20.987 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.992+0000 7f874a607700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f87440a05f0 0x7f874414bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:20.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.992+0000 7f874a607700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8744142f60 con 0x7f87440a0a90 2023-07-19T20:44:20.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.992+0000 7f874a607700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87440bf620 con 0x7f8744142b90 2023-07-19T20:44:20.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.992+0000 7f874a607700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87440bdda0 con 0x7f87440a05f0 2023-07-19T20:44:20.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.992+0000 7f87437fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f87440a05f0 0x7f874414bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:20.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.992+0000 7f87437fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f87440a05f0 0x7f874414bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54478/0 (socket says 172.21.15.124:54478) 2023-07-19T20:44:20.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.992+0000 7f87437fe700 1 -- 172.21.15.124:0/740803971 learned_addr learned my addr 172.21.15.124:0/740803971 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:20.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.992+0000 7f87437fe700 1 -- 172.21.15.124:0/740803971 >> v1:172.21.15.124:6789/0 conn(0x7f8744142b90 legacy=0x7f8744072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:20.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.992+0000 7f87437fe700 1 -- 172.21.15.124:0/740803971 >> v1:172.21.15.117:6789/0 conn(0x7f87440a0a90 legacy=0x7f8744153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:20.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.992+0000 7f87437fe700 1 -- 172.21.15.124:0/740803971 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87440bdf80 con 0x7f87440a05f0 2023-07-19T20:44:20.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.992+0000 7f87437fe700 1 --2- 172.21.15.124:0/740803971 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f87440a05f0 0x7f874414bfe0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f87380098f0 tx=0x7f8738009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d437bc905d9ddd71 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:20.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.992+0000 7f8742ffd700 1 -- 172.21.15.124:0/740803971 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873800b8a0 con 0x7f87440a05f0 2023-07-19T20:44:20.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.993+0000 7f8742ffd700 1 -- 172.21.15.124:0/740803971 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873800ba00 con 0x7f87440a05f0 2023-07-19T20:44:20.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.993+0000 7f8742ffd700 1 -- 172.21.15.124:0/740803971 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873800bd90 con 0x7f87440a05f0 2023-07-19T20:44:20.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.993+0000 7f874a607700 1 -- 172.21.15.124:0/740803971 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f87440a05f0 msgr2=0x7f874414bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:20.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.993+0000 7f874a607700 1 --2- 172.21.15.124:0/740803971 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f87440a05f0 0x7f874414bfe0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f87380098f0 tx=0x7f8738009c00 comp rx=0 tx=0).stop 2023-07-19T20:44:20.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.993+0000 7f874a607700 1 -- 172.21.15.124:0/740803971 shutdown_connections 2023-07-19T20:44:20.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.993+0000 7f874a607700 1 --2- 172.21.15.124:0/740803971 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f87440a05f0 0x7f874414bfe0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:20.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.993+0000 7f874a607700 1 -- 172.21.15.124:0/740803971 >> 172.21.15.124:0/740803971 conn(0x7f87440bea10 msgr2=0x7f87440bee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:20.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.993+0000 7f874a607700 1 -- 172.21.15.124:0/740803971 shutdown_connections 2023-07-19T20:44:20.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.993+0000 7f874a607700 1 -- 172.21.15.124:0/740803971 wait complete. 2023-07-19T20:44:20.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.994+0000 7f874a607700 1 Processor -- start 2023-07-19T20:44:20.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.994+0000 7f874a607700 1 -- start start 2023-07-19T20:44:20.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f874a607700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f87440a05f0 0x7f87440b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:20.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f874a607700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f87440a0a90 0x7f8744149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:20.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f874a607700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8744142b90 0x7f874414a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:20.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f874a607700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87440b50d0 con 0x7f8744142b90 2023-07-19T20:44:20.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f874a607700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8744149a60 con 0x7f87440a05f0 2023-07-19T20:44:20.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f874a607700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87440a1f70 con 0x7f87440a0a90 2023-07-19T20:44:20.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f8743fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f87440a05f0 0x7f87440b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:20.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f8743fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f87440a05f0 0x7f87440b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54490/0 (socket says 172.21.15.124:54490) 2023-07-19T20:44:20.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f8743fff700 1 -- 172.21.15.124:0/1459439365 learned_addr learned my addr 172.21.15.124:0/1459439365 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:20.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f87437fe700 1 --2- 172.21.15.124:0/1459439365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f87440a0a90 0x7f8744149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:20.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f8748ba4700 1 --2- 172.21.15.124:0/1459439365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8744142b90 0x7f874414a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:20.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f87437fe700 1 -- 172.21.15.124:0/1459439365 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f87440a05f0 msgr2=0x7f87440b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:20.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f87437fe700 1 --2- 172.21.15.124:0/1459439365 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f87440a05f0 0x7f87440b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:20.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f87437fe700 1 -- 172.21.15.124:0/1459439365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8744142b90 msgr2=0x7f874414a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:20.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f87437fe700 1 --2- 172.21.15.124:0/1459439365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8744142b90 0x7f874414a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:20.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f87437fe700 1 -- 172.21.15.124:0/1459439365 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8738009550 con 0x7f87440a0a90 2023-07-19T20:44:20.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.995+0000 7f8743fff700 1 --2- 172.21.15.124:0/1459439365 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f87440a05f0 0x7f87440b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:20.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.996+0000 7f87437fe700 1 --2- 172.21.15.124:0/1459439365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f87440a0a90 0x7f8744149ef0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8738016000 tx=0x7f8738004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:20.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.996+0000 7f8740ff9700 1 -- 172.21.15.124:0/1459439365 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738004380 con 0x7f87440a0a90 2023-07-19T20:44:20.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.996+0000 7f8740ff9700 1 -- 172.21.15.124:0/1459439365 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873801f070 con 0x7f87440a0a90 2023-07-19T20:44:20.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.996+0000 7f874a607700 1 -- 172.21.15.124:0/1459439365 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874414ade0 con 0x7f87440a0a90 2023-07-19T20:44:20.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.996+0000 7f8740ff9700 1 -- 172.21.15.124:0/1459439365 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87380036a0 con 0x7f87440a0a90 2023-07-19T20:44:20.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.996+0000 7f874a607700 1 -- 172.21.15.124:0/1459439365 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87440a24a0 con 0x7f87440a0a90 2023-07-19T20:44:20.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.996+0000 7f8740ff9700 1 -- 172.21.15.124:0/1459439365 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8738021030 con 0x7f87440a0a90 2023-07-19T20:44:20.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.996+0000 7f8740ff9700 1 -- 172.21.15.124:0/1459439365 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f873801a8e0 con 0x7f87440a0a90 2023-07-19T20:44:21.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.997+0000 7f874a607700 1 -- 172.21.15.124:0/1459439365 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87440be210 con 0x7f87440a0a90 2023-07-19T20:44:21.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:20.999+0000 7f8740ff9700 1 -- 172.21.15.124:0/1459439365 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f8738015020 con 0x7f87440a0a90 2023-07-19T20:44:21.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.082+0000 7f874a607700 1 -- 172.21.15.124:0/1459439365 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a7edc950-d9a1-4925-86bc-0ebc219286e0", "id": 1} v 0) v1 -- 0x7f874409f050 con 0x7f87440a0a90 2023-07-19T20:44:21.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.090+0000 7f8740ff9700 1 -- 172.21.15.124:0/1459439365 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7edc950-d9a1-4925-86bc-0ebc219286e0", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8738003bc0 con 0x7f87440a0a90 2023-07-19T20:44:21.084 INFO:teuthology.orchestra.run.smithi124.stdout:1 2023-07-19T20:44:21.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.091+0000 7f874a607700 1 -- 172.21.15.124:0/1459439365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f87440a0a90 msgr2=0x7f8744149ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.091+0000 7f874a607700 1 --2- 172.21.15.124:0/1459439365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f87440a0a90 0x7f8744149ef0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8738016000 tx=0x7f8738004750 comp rx=0 tx=0).stop 2023-07-19T20:44:21.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.091+0000 7f874a607700 1 -- 172.21.15.124:0/1459439365 shutdown_connections 2023-07-19T20:44:21.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.091+0000 7f874a607700 1 --2- 172.21.15.124:0/1459439365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8744142b90 0x7f874414a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.091+0000 7f874a607700 1 --2- 172.21.15.124:0/1459439365 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f87440a05f0 0x7f87440b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.091+0000 7f874a607700 1 --2- 172.21.15.124:0/1459439365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f87440a0a90 0x7f8744149ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.091+0000 7f874a607700 1 -- 172.21.15.124:0/1459439365 >> 172.21.15.124:0/1459439365 conn(0x7f87440bea10 msgr2=0x7f874409fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:21.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.091+0000 7f874a607700 1 -- 172.21.15.124:0/1459439365 shutdown_connections 2023-07-19T20:44:21.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.091+0000 7f874a607700 1 -- 172.21.15.124:0/1459439365 wait complete. 2023-07-19T20:44:21.096 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new 4c86c33f-bb95-445e-a0ba-c0a3496f2950 2 2023-07-19T20:44:21.125 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:21.131+0000 7f31b328c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-19T20:44:21.154 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:21.160+0000 7f765b5f0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-19T20:44:21.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.225+0000 7efff1b44700 1 Processor -- start 2023-07-19T20:44:21.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.225+0000 7efff1b44700 1 -- start start 2023-07-19T20:44:21.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.225+0000 7efff1b44700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7effec072740 0x7effec14eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.225+0000 7efff1b44700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7effec0b8cc0 0x7effec0bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.225+0000 7efff1b44700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7effec0be510 0x7effec06a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.225+0000 7efff1b44700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec14e690 con 0x7effec072740 2023-07-19T20:44:21.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.225+0000 7efff1b44700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec06c9f0 con 0x7effec0be510 2023-07-19T20:44:21.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.225+0000 7efff1b44700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec0b9160 con 0x7effec0b8cc0 2023-07-19T20:44:21.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.225+0000 7effeaffd700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7effec0b8cc0 0x7effec0bdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.225+0000 7effebfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7effec0be510 0x7effec06a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.225+0000 7effeaffd700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7effec0b8cc0 0x7effec0bdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:57226/0 (socket says 172.21.15.124:57226) 2023-07-19T20:44:21.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.225+0000 7effeaffd700 1 -- 172.21.15.124:0/2119155786 learned_addr learned my addr 172.21.15.124:0/2119155786 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:21.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.225+0000 7effeb7fe700 1 --2- 172.21.15.124:0/2119155786 >> v2:172.21.15.117:3300/0 conn(0x7effec072740 0x7effec14eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7effeaffd700 1 -- 172.21.15.124:0/2119155786 >> v2:172.21.15.124:3300/0 conn(0x7effec0be510 msgr2=0x7effec06a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:21.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7effeaffd700 1 --2- 172.21.15.124:0/2119155786 >> v2:172.21.15.124:3300/0 conn(0x7effec0be510 0x7effec06a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7effeaffd700 1 -- 172.21.15.124:0/2119155786 >> v2:172.21.15.117:3300/0 conn(0x7effec072740 msgr2=0x7effec14eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:21.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7effeaffd700 1 --2- 172.21.15.124:0/2119155786 >> v2:172.21.15.117:3300/0 conn(0x7effec072740 0x7effec14eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7effeaffd700 1 -- 172.21.15.124:0/2119155786 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec14e320 con 0x7effec0b8cc0 2023-07-19T20:44:21.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7effeb7fe700 1 --2- 172.21.15.124:0/2119155786 >> v2:172.21.15.117:3300/0 conn(0x7effec072740 0x7effec14eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:21.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7effeaffd700 1 --2- 172.21.15.124:0/2119155786 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7effec0b8cc0 0x7effec0bdfd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7effec06fd10 tx=0x7effe0009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14a9a086462d913a server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:21.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7effea7fc700 1 -- 172.21.15.124:0/2119155786 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0011830 con 0x7effec0b8cc0 2023-07-19T20:44:21.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7effea7fc700 1 -- 172.21.15.124:0/2119155786 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe0011990 con 0x7effec0b8cc0 2023-07-19T20:44:21.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7effea7fc700 1 -- 172.21.15.124:0/2119155786 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0011d20 con 0x7effec0b8cc0 2023-07-19T20:44:21.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7efff1b44700 1 -- 172.21.15.124:0/2119155786 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7effec0b8cc0 msgr2=0x7effec0bdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7efff1b44700 1 --2- 172.21.15.124:0/2119155786 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7effec0b8cc0 0x7effec0bdfd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7effec06fd10 tx=0x7effe0009bd0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7efff1b44700 1 -- 172.21.15.124:0/2119155786 shutdown_connections 2023-07-19T20:44:21.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7efff1b44700 1 --2- 172.21.15.124:0/2119155786 >> v2:172.21.15.117:3300/0 conn(0x7effec072740 0x7effec14eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7efff1b44700 1 --2- 172.21.15.124:0/2119155786 >> v2:172.21.15.124:3300/0 conn(0x7effec0be510 0x7effec06a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.226+0000 7efff1b44700 1 --2- 172.21.15.124:0/2119155786 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7effec0b8cc0 0x7effec0bdfd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.227+0000 7efff1b44700 1 -- 172.21.15.124:0/2119155786 >> 172.21.15.124:0/2119155786 conn(0x7effec06c300 msgr2=0x7effec0bd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:21.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.227+0000 7efff1b44700 1 -- 172.21.15.124:0/2119155786 shutdown_connections 2023-07-19T20:44:21.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.227+0000 7efff1b44700 1 -- 172.21.15.124:0/2119155786 wait complete. 2023-07-19T20:44:21.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.228+0000 7efff1b44700 1 Processor -- start 2023-07-19T20:44:21.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.228+0000 7efff1b44700 1 -- start start 2023-07-19T20:44:21.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.228+0000 7efff1b44700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7effec0b8cc0 0x7effec1d4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.228+0000 7efff1b44700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effec0be510 0x7effec14c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.228+0000 7efff1b44700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7effec1e3540 0x7effec1e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.228+0000 7efff1b44700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec1d4cd0 con 0x7effec0be510 2023-07-19T20:44:21.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.228+0000 7efff1b44700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec14b410 con 0x7effec1e3540 2023-07-19T20:44:21.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.228+0000 7efff1b44700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec14c490 con 0x7effec0b8cc0 2023-07-19T20:44:21.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.228+0000 7effeb7fe700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7effec0b8cc0 0x7effec1d4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.228+0000 7effeb7fe700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7effec0b8cc0 0x7effec1d4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:57238/0 (socket says 172.21.15.124:57238) 2023-07-19T20:44:21.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.228+0000 7effeb7fe700 1 -- 172.21.15.124:0/1993652847 learned_addr learned my addr 172.21.15.124:0/1993652847 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:21.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.228+0000 7effebfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7effec1e3540 0x7effec1e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.229+0000 7effeaffd700 1 --2- 172.21.15.124:0/1993652847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effec0be510 0x7effec14c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.229+0000 7effeb7fe700 1 -- 172.21.15.124:0/1993652847 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7effec1e3540 msgr2=0x7effec1e39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.229+0000 7effeb7fe700 1 --2- 172.21.15.124:0/1993652847 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7effec1e3540 0x7effec1e39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.229+0000 7effeb7fe700 1 -- 172.21.15.124:0/1993652847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effec0be510 msgr2=0x7effec14c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.229+0000 7effeb7fe700 1 --2- 172.21.15.124:0/1993652847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effec0be510 0x7effec14c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.229+0000 7effeb7fe700 1 -- 172.21.15.124:0/1993652847 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe0009550 con 0x7effec0b8cc0 2023-07-19T20:44:21.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.229+0000 7effebfff700 1 --2- 172.21.15.124:0/1993652847 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7effec1e3540 0x7effec1e39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:21.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.229+0000 7effeb7fe700 1 --2- 172.21.15.124:0/1993652847 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7effec0b8cc0 0x7effec1d4790 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7effdc00e840 tx=0x7effdc00eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:21.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.229+0000 7effd3fff700 1 -- 172.21.15.124:0/1993652847 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc013610 con 0x7effec0b8cc0 2023-07-19T20:44:21.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.229+0000 7effd3fff700 1 -- 172.21.15.124:0/1993652847 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc013770 con 0x7effec0b8cc0 2023-07-19T20:44:21.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.229+0000 7effd3fff700 1 -- 172.21.15.124:0/1993652847 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc013b20 con 0x7effec0b8cc0 2023-07-19T20:44:21.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.230+0000 7efff1b44700 1 -- 172.21.15.124:0/1993652847 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec14c0e0 con 0x7effec0b8cc0 2023-07-19T20:44:21.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.230+0000 7efff1b44700 1 -- 172.21.15.124:0/1993652847 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec14b050 con 0x7effec0b8cc0 2023-07-19T20:44:21.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.230+0000 7effd3fff700 1 -- 172.21.15.124:0/1993652847 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7effdc01c450 con 0x7effec0b8cc0 2023-07-19T20:44:21.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.230+0000 7effd3fff700 1 -- 172.21.15.124:0/1993652847 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7effdc0128c0 con 0x7effec0b8cc0 2023-07-19T20:44:21.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.230+0000 7efff1b44700 1 -- 172.21.15.124:0/1993652847 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec14a7b0 con 0x7effec0b8cc0 2023-07-19T20:44:21.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.233+0000 7effd3fff700 1 -- 172.21.15.124:0/1993652847 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7effdc021060 con 0x7effec0b8cc0 2023-07-19T20:44:21.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.315+0000 7efff1b44700 1 -- 172.21.15.124:0/1993652847 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4c86c33f-bb95-445e-a0ba-c0a3496f2950", "id": 2} v 0) v1 -- 0x7effec067940 con 0x7effec0b8cc0 2023-07-19T20:44:21.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.323+0000 7effd3fff700 1 -- 172.21.15.124:0/1993652847 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4c86c33f-bb95-445e-a0ba-c0a3496f2950", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7effdc017070 con 0x7effec0b8cc0 2023-07-19T20:44:21.318 INFO:teuthology.orchestra.run.smithi124.stdout:2 2023-07-19T20:44:21.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.324+0000 7efff1b44700 1 -- 172.21.15.124:0/1993652847 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7effec0b8cc0 msgr2=0x7effec1d4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.324+0000 7efff1b44700 1 --2- 172.21.15.124:0/1993652847 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7effec0b8cc0 0x7effec1d4790 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7effdc00e840 tx=0x7effdc00eb50 comp rx=0 tx=0).stop 2023-07-19T20:44:21.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.324+0000 7efff1b44700 1 -- 172.21.15.124:0/1993652847 shutdown_connections 2023-07-19T20:44:21.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.324+0000 7efff1b44700 1 --2- 172.21.15.124:0/1993652847 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7effec1e3540 0x7effec1e39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.324+0000 7efff1b44700 1 --2- 172.21.15.124:0/1993652847 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7effec0b8cc0 0x7effec1d4790 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.324+0000 7efff1b44700 1 --2- 172.21.15.124:0/1993652847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effec0be510 0x7effec14c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.324+0000 7efff1b44700 1 -- 172.21.15.124:0/1993652847 >> 172.21.15.124:0/1993652847 conn(0x7effec06c300 msgr2=0x7effec06e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:21.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.324+0000 7efff1b44700 1 -- 172.21.15.124:0/1993652847 shutdown_connections 2023-07-19T20:44:21.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.324+0000 7efff1b44700 1 -- 172.21.15.124:0/1993652847 wait complete. 2023-07-19T20:44:21.321 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:21.324+0000 7f31b328c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-19T20:44:21.330 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new 0413180f-4fcb-489b-88f3-41aa9da56f8b 3 2023-07-19T20:44:21.354 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:21.360+0000 7f765b5f0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-19T20:44:21.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.459+0000 7f6528be0700 1 Processor -- start 2023-07-19T20:44:21.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.459+0000 7f6528be0700 1 -- start start 2023-07-19T20:44:21.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.460+0000 7f6528be0700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65240bbab0 0x7f652414b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f6528be0700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652409ea70 con 0x7f65240bc600 2023-07-19T20:44:21.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f6528be0700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652409e800 con 0x7f652409ee90 2023-07-19T20:44:21.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f6528be0700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652414abd0 con 0x7f65240bbab0 2023-07-19T20:44:21.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f6522d9d700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f652409ee90 0x7f6524155360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:49476/0 (socket says 172.21.15.124:49476) 2023-07-19T20:44:21.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f6522d9d700 1 -- 172.21.15.124:0/812308064 learned_addr learned my addr 172.21.15.124:0/812308064 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-07-19T20:44:21.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f6521d9b700 1 --2- 172.21.15.124:0/812308064 >> v2:172.21.15.117:3300/0 conn(0x7f65240bbab0 0x7f652414b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f652159a700 1 -- 172.21.15.124:0/812308064 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853540315 0 0) 0x7f652409e800 con 0x7f652409ee90 2023-07-19T20:44:21.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f652159a700 1 -- 172.21.15.124:0/812308064 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f650c0035b0 con 0x7f652409ee90 2023-07-19T20:44:21.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f652159a700 1 -- 172.21.15.124:0/812308064 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241633384 0 0) 0x7f652409ea70 con 0x7f65240bc600 2023-07-19T20:44:21.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f652159a700 1 -- 172.21.15.124:0/812308064 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f652409e800 con 0x7f65240bc600 2023-07-19T20:44:21.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f6521d9b700 1 -- 172.21.15.124:0/812308064 >> v1:172.21.15.124:6789/0 conn(0x7f652409ee90 legacy=0x7f6524155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f6521d9b700 1 -- 172.21.15.124:0/812308064 >> v1:172.21.15.117:6789/0 conn(0x7f65240bc600 legacy=0x7f652409f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f652159a700 1 -- 172.21.15.124:0/812308064 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3810136076 0 0) 0x7f652409e800 con 0x7f65240bc600 2023-07-19T20:44:21.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f6521d9b700 1 -- 172.21.15.124:0/812308064 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652414ae70 con 0x7f65240bbab0 2023-07-19T20:44:21.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.461+0000 7f6521d9b700 1 --2- 172.21.15.124:0/812308064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65240bbab0 0x7f652414b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6518009840 tx=0x7f6518009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65c99809955f62 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:21.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.462+0000 7f652159a700 1 -- 172.21.15.124:0/812308064 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6514001670 con 0x7f65240bbab0 2023-07-19T20:44:21.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.462+0000 7f652159a700 1 -- 172.21.15.124:0/812308064 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6518004030 con 0x7f65240bbab0 2023-07-19T20:44:21.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.462+0000 7f652159a700 1 -- 172.21.15.124:0/812308064 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65180043c0 con 0x7f65240bbab0 2023-07-19T20:44:21.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.462+0000 7f6528be0700 1 -- 172.21.15.124:0/812308064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65240bbab0 msgr2=0x7f652414b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.462+0000 7f6528be0700 1 --2- 172.21.15.124:0/812308064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65240bbab0 0x7f652414b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6518009840 tx=0x7f6518009b50 comp rx=0 tx=0).stop 2023-07-19T20:44:21.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.462+0000 7f6528be0700 1 -- 172.21.15.124:0/812308064 shutdown_connections 2023-07-19T20:44:21.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.462+0000 7f6528be0700 1 --2- 172.21.15.124:0/812308064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65240bbab0 0x7f652414b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.462+0000 7f6528be0700 1 -- 172.21.15.124:0/812308064 >> 172.21.15.124:0/812308064 conn(0x7f65240bd0b0 msgr2=0x7f65240bd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:21.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.462+0000 7f6528be0700 1 -- 172.21.15.124:0/812308064 shutdown_connections 2023-07-19T20:44:21.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.462+0000 7f6528be0700 1 -- 172.21.15.124:0/812308064 wait complete. 2023-07-19T20:44:21.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.464+0000 7f6528be0700 1 Processor -- start 2023-07-19T20:44:21.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.464+0000 7f6528be0700 1 -- start start 2023-07-19T20:44:21.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.464+0000 7f6528be0700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f652409ee90 0x7f65241d77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.464+0000 7f6528be0700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65240bbab0 0x7f6524070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.464+0000 7f6528be0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65240bc600 0x7f6524145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.464+0000 7f6528be0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65241d7d00 con 0x7f65240bc600 2023-07-19T20:44:21.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.464+0000 7f6528be0700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65240701b0 con 0x7f652409ee90 2023-07-19T20:44:21.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.464+0000 7f6528be0700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652406fed0 con 0x7f65240bbab0 2023-07-19T20:44:21.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.464+0000 7f652259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f652409ee90 0x7f65241d77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.464+0000 7f6521d9b700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65240bbab0 0x7f6524070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.464+0000 7f6521d9b700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65240bbab0 0x7f6524070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:57244/0 (socket says 172.21.15.124:57244) 2023-07-19T20:44:21.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.464+0000 7f652259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f652409ee90 0x7f65241d77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54518/0 (socket says 172.21.15.124:54518) 2023-07-19T20:44:21.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.464+0000 7f6521d9b700 1 -- 172.21.15.124:0/3574998388 learned_addr learned my addr 172.21.15.124:0/3574998388 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:21.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.464+0000 7f6522d9d700 1 --2- 172.21.15.124:0/3574998388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65240bc600 0x7f6524145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.469 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.465+0000 7f652259c700 1 -- 172.21.15.124:0/3574998388 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65240bbab0 msgr2=0x7f6524070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.469 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.465+0000 7f652259c700 1 --2- 172.21.15.124:0/3574998388 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65240bbab0 0x7f6524070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.469 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.465+0000 7f652259c700 1 -- 172.21.15.124:0/3574998388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65240bc600 msgr2=0x7f6524145cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.469 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.465+0000 7f652259c700 1 --2- 172.21.15.124:0/3574998388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65240bc600 0x7f6524145cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.469 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.465+0000 7f652259c700 1 -- 172.21.15.124:0/3574998388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65180094a0 con 0x7f652409ee90 2023-07-19T20:44:21.469 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.465+0000 7f6521d9b700 1 --2- 172.21.15.124:0/3574998388 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65240bbab0 0x7f6524070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:21.469 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.465+0000 7f652259c700 1 --2- 172.21.15.124:0/3574998388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f652409ee90 0x7f65241d77c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6514001380 tx=0x7f651400ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:21.469 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.465+0000 7f6512ffd700 1 -- 172.21.15.124:0/3574998388 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65140054e0 con 0x7f652409ee90 2023-07-19T20:44:21.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.465+0000 7f6512ffd700 1 -- 172.21.15.124:0/3574998388 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6514001d20 con 0x7f652409ee90 2023-07-19T20:44:21.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.465+0000 7f6528be0700 1 -- 172.21.15.124:0/3574998388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6524070430 con 0x7f652409ee90 2023-07-19T20:44:21.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.465+0000 7f6512ffd700 1 -- 172.21.15.124:0/3574998388 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65140038c0 con 0x7f652409ee90 2023-07-19T20:44:21.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.465+0000 7f6528be0700 1 -- 172.21.15.124:0/3574998388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6524148310 con 0x7f652409ee90 2023-07-19T20:44:21.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.465+0000 7f6512ffd700 1 -- 172.21.15.124:0/3574998388 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6514003d20 con 0x7f652409ee90 2023-07-19T20:44:21.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.465+0000 7f6512ffd700 1 -- 172.21.15.124:0/3574998388 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6514012890 con 0x7f652409ee90 2023-07-19T20:44:21.470 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.466+0000 7f6528be0700 1 -- 172.21.15.124:0/3574998388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6524067940 con 0x7f652409ee90 2023-07-19T20:44:21.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.468+0000 7f6512ffd700 1 -- 172.21.15.124:0/3574998388 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f6514017070 con 0x7f652409ee90 2023-07-19T20:44:21.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.553+0000 7f6528be0700 1 -- 172.21.15.124:0/3574998388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0413180f-4fcb-489b-88f3-41aa9da56f8b", "id": 3} v 0) v1 -- 0x7f652409e4b0 con 0x7f652409ee90 2023-07-19T20:44:21.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.559+0000 7f6512ffd700 1 -- 172.21.15.124:0/3574998388 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0413180f-4fcb-489b-88f3-41aa9da56f8b", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f65140125d0 con 0x7f652409ee90 2023-07-19T20:44:21.553 INFO:teuthology.orchestra.run.smithi124.stdout:3 2023-07-19T20:44:21.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.559+0000 7f6528be0700 1 -- 172.21.15.124:0/3574998388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f652409ee90 msgr2=0x7f65241d77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.559+0000 7f6528be0700 1 --2- 172.21.15.124:0/3574998388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f652409ee90 0x7f65241d77c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6514001380 tx=0x7f651400ca30 comp rx=0 tx=0).stop 2023-07-19T20:44:21.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.560+0000 7f6528be0700 1 -- 172.21.15.124:0/3574998388 shutdown_connections 2023-07-19T20:44:21.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.560+0000 7f6528be0700 1 --2- 172.21.15.124:0/3574998388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65240bc600 0x7f6524145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.560+0000 7f6528be0700 1 --2- 172.21.15.124:0/3574998388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f652409ee90 0x7f65241d77c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.560+0000 7f6528be0700 1 --2- 172.21.15.124:0/3574998388 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65240bbab0 0x7f6524070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.560+0000 7f6528be0700 1 -- 172.21.15.124:0/3574998388 >> 172.21.15.124:0/3574998388 conn(0x7f65240bd0b0 msgr2=0x7f65240b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:21.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.560+0000 7f6528be0700 1 -- 172.21.15.124:0/3574998388 shutdown_connections 2023-07-19T20:44:21.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.560+0000 7f6528be0700 1 -- 172.21.15.124:0/3574998388 wait complete. 2023-07-19T20:44:21.567 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new 502d6efe-acca-481d-b687-77abcb04d6e1 4 2023-07-19T20:44:21.675 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:21.682+0000 7f31b328c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-19T20:44:21.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.738+0000 7f45c6ec3700 1 Processor -- start 2023-07-19T20:44:21.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.738+0000 7f45c6ec3700 1 -- start start 2023-07-19T20:44:21.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c6ec3700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f45c00bb740 0x7f45c00bdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c6ec3700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f45c00bc830 0x7f45c00be430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c6ec3700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c014be90 con 0x7f45c009dc90 2023-07-19T20:44:21.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c6ec3700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c0072940 con 0x7f45c00bb740 2023-07-19T20:44:21.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c6ec3700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00bd150 con 0x7f45c00bc830 2023-07-19T20:44:21.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c5460700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f45c00bc830 0x7f45c00be430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c4c5f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f45c00bb740 0x7f45c00bdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c5460700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f45c00bc830 0x7f45c00be430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:57250/0 (socket says 172.21.15.124:57250) 2023-07-19T20:44:21.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c4c5f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f45c00bb740 0x7f45c00bdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54528/0 (socket says 172.21.15.124:54528) 2023-07-19T20:44:21.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c5460700 1 -- 172.21.15.124:0/1020861455 learned_addr learned my addr 172.21.15.124:0/1020861455 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:21.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c5460700 1 -- 172.21.15.124:0/1020861455 >> v2:172.21.15.124:3300/0 conn(0x7f45c00bb740 msgr2=0x7f45c00bdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:21.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c5460700 1 --2- 172.21.15.124:0/1020861455 >> v2:172.21.15.124:3300/0 conn(0x7f45c00bb740 0x7f45c00bdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c5460700 1 -- 172.21.15.124:0/1020861455 >> v1:172.21.15.117:6789/0 conn(0x7f45c009dc90 legacy=0x7f45c0148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c5460700 1 -- 172.21.15.124:0/1020861455 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c009e120 con 0x7f45c00bc830 2023-07-19T20:44:21.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.739+0000 7f45c4c5f700 1 --2- 172.21.15.124:0/1020861455 >> v2:172.21.15.124:3300/0 conn(0x7f45c00bb740 0x7f45c00bdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:21.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.740+0000 7f45c5460700 1 --2- 172.21.15.124:0/1020861455 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f45c00bc830 0x7f45c00be430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009e50 tx=0x7f45b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3f524d236b7c641 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:21.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.740+0000 7f45bf7fe700 1 -- 172.21.15.124:0/1020861455 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b800e070 con 0x7f45c00bc830 2023-07-19T20:44:21.736 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.740+0000 7f45bf7fe700 1 -- 172.21.15.124:0/1020861455 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b800b910 con 0x7f45c00bc830 2023-07-19T20:44:21.736 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.740+0000 7f45bf7fe700 1 -- 172.21.15.124:0/1020861455 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b800bcc0 con 0x7f45c00bc830 2023-07-19T20:44:21.736 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:21.740+0000 7f765b5f0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-19T20:44:21.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.740+0000 7f45c6ec3700 1 -- 172.21.15.124:0/1020861455 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f45c00bc830 msgr2=0x7f45c00be430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.740+0000 7f45c6ec3700 1 --2- 172.21.15.124:0/1020861455 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f45c00bc830 0x7f45c00be430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009e50 tx=0x7f45b800b330 comp rx=0 tx=0).stop 2023-07-19T20:44:21.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.740+0000 7f45c6ec3700 1 -- 172.21.15.124:0/1020861455 shutdown_connections 2023-07-19T20:44:21.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.740+0000 7f45c6ec3700 1 --2- 172.21.15.124:0/1020861455 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f45c00bc830 0x7f45c00be430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.740+0000 7f45c6ec3700 1 --2- 172.21.15.124:0/1020861455 >> v2:172.21.15.124:3300/0 conn(0x7f45c00bb740 0x7f45c00bdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.740+0000 7f45c6ec3700 1 -- 172.21.15.124:0/1020861455 >> 172.21.15.124:0/1020861455 conn(0x7f45c00a0660 msgr2=0x7f45c00a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:21.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.740+0000 7f45c6ec3700 1 -- 172.21.15.124:0/1020861455 shutdown_connections 2023-07-19T20:44:21.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.740+0000 7f45c6ec3700 1 -- 172.21.15.124:0/1020861455 wait complete. 2023-07-19T20:44:21.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.741+0000 7f45c6ec3700 1 Processor -- start 2023-07-19T20:44:21.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.741+0000 7f45c6ec3700 1 -- start start 2023-07-19T20:44:21.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.742+0000 7f45c6ec3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c009dc90 0x7f45c0145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.742+0000 7f45c6ec3700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45c00bb740 0x7f45c00b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.742+0000 7f45c6ec3700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f45c00bc830 0x7f45c00b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.742+0000 7f45c6ec3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c006d440 con 0x7f45c009dc90 2023-07-19T20:44:21.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.742+0000 7f45c6ec3700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c01e3860 con 0x7f45c00bb740 2023-07-19T20:44:21.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.742+0000 7f45c6ec3700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00b58f0 con 0x7f45c00bc830 2023-07-19T20:44:21.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.742+0000 7f45bffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45c00bb740 0x7f45c00b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.742+0000 7f45bffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45c00bb740 0x7f45c00b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54538/0 (socket says 172.21.15.124:54538) 2023-07-19T20:44:21.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.742+0000 7f45bffff700 1 -- 172.21.15.124:0/665949434 learned_addr learned my addr 172.21.15.124:0/665949434 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:21.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.742+0000 7f45c5460700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f45c00bc830 0x7f45c00b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.742+0000 7f45c4c5f700 1 --2- 172.21.15.124:0/665949434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c009dc90 0x7f45c0145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45bffff700 1 -- 172.21.15.124:0/665949434 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f45c00bc830 msgr2=0x7f45c00b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45bffff700 1 --2- 172.21.15.124:0/665949434 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f45c00bc830 0x7f45c00b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45bffff700 1 -- 172.21.15.124:0/665949434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c009dc90 msgr2=0x7f45c0145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45bffff700 1 --2- 172.21.15.124:0/665949434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c009dc90 0x7f45c0145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45bffff700 1 -- 172.21.15.124:0/665949434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b40094a0 con 0x7f45c00bb740 2023-07-19T20:44:21.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45c5460700 1 --2- 172.21.15.124:0/665949434 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f45c00bc830 0x7f45c00b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:21.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45c4c5f700 1 --2- 172.21.15.124:0/665949434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c009dc90 0x7f45c0145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:21.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45bffff700 1 --2- 172.21.15.124:0/665949434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45c00bb740 0x7f45c00b4b10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00c510 tx=0x7f45ac00c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:21.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45bd7fa700 1 -- 172.21.15.124:0/665949434 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0052d0 con 0x7f45c00bb740 2023-07-19T20:44:21.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45bd7fa700 1 -- 172.21.15.124:0/665949434 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac005430 con 0x7f45c00bb740 2023-07-19T20:44:21.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45c6ec3700 1 -- 172.21.15.124:0/665949434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b8009b30 con 0x7f45c00bb740 2023-07-19T20:44:21.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45bd7fa700 1 -- 172.21.15.124:0/665949434 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0038c0 con 0x7f45c00bb740 2023-07-19T20:44:21.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45c6ec3700 1 -- 172.21.15.124:0/665949434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c01e3de0 con 0x7f45c00bb740 2023-07-19T20:44:21.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45bd7fa700 1 -- 172.21.15.124:0/665949434 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f45ac003d20 con 0x7f45c00bb740 2023-07-19T20:44:21.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.743+0000 7f45bd7fa700 1 -- 172.21.15.124:0/665949434 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f45ac011da0 con 0x7f45c00bb740 2023-07-19T20:44:21.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.744+0000 7f45c6ec3700 1 -- 172.21.15.124:0/665949434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c0148370 con 0x7f45c00bb740 2023-07-19T20:44:21.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.746+0000 7f45bd7fa700 1 -- 172.21.15.124:0/665949434 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f45ac017070 con 0x7f45c00bb740 2023-07-19T20:44:21.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.830+0000 7f45c6ec3700 1 -- 172.21.15.124:0/665949434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd new", "uuid": "502d6efe-acca-481d-b687-77abcb04d6e1", "id": 4} v 0) v1 -- 0x7f45c01e4000 con 0x7f45c00bb740 2023-07-19T20:44:21.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.835+0000 7f45bd7fa700 1 -- 172.21.15.124:0/665949434 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "502d6efe-acca-481d-b687-77abcb04d6e1", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f45ac011590 con 0x7f45c00bb740 2023-07-19T20:44:21.832 INFO:teuthology.orchestra.run.smithi124.stdout:4 2023-07-19T20:44:21.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.836+0000 7f45c6ec3700 1 -- 172.21.15.124:0/665949434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45c00bb740 msgr2=0x7f45c00b4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.836+0000 7f45c6ec3700 1 --2- 172.21.15.124:0/665949434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45c00bb740 0x7f45c00b4b10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00c510 tx=0x7f45ac00c820 comp rx=0 tx=0).stop 2023-07-19T20:44:21.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.836+0000 7f45c6ec3700 1 -- 172.21.15.124:0/665949434 shutdown_connections 2023-07-19T20:44:21.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.836+0000 7f45c6ec3700 1 --2- 172.21.15.124:0/665949434 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f45c00bc830 0x7f45c00b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.836+0000 7f45c6ec3700 1 --2- 172.21.15.124:0/665949434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c009dc90 0x7f45c0145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.836+0000 7f45c6ec3700 1 --2- 172.21.15.124:0/665949434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45c00bb740 0x7f45c00b4b10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.836+0000 7f45c6ec3700 1 -- 172.21.15.124:0/665949434 >> 172.21.15.124:0/665949434 conn(0x7f45c00a0660 msgr2=0x7f45c00bdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:21.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.836+0000 7f45c6ec3700 1 -- 172.21.15.124:0/665949434 shutdown_connections 2023-07-19T20:44:21.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.836+0000 7f45c6ec3700 1 -- 172.21.15.124:0/665949434 wait complete. 2023-07-19T20:44:21.841 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new b61c5e81-f13c-400b-a487-1ee6eee91e52 5 2023-07-19T20:44:21.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.971+0000 7f6969759700 1 Processor -- start 2023-07-19T20:44:21.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.971+0000 7f6969759700 1 -- start start 2023-07-19T20:44:21.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.971+0000 7f6969759700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f69640b86b0 0x7f69640726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.971+0000 7f6969759700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f696406dc60 0x7f69640bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.971+0000 7f6969759700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696406e0a0 con 0x7f69640ba500 2023-07-19T20:44:21.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.972+0000 7f6969759700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69640bd1d0 con 0x7f696406dc60 2023-07-19T20:44:21.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.972+0000 7f6969759700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69640bd4b0 con 0x7f69640b86b0 2023-07-19T20:44:21.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.972+0000 7f695a7fc700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f69640b86b0 0x7f69640726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.972+0000 7f695a7fc700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f69640b86b0 0x7f69640726d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:57258/0 (socket says 172.21.15.124:57258) 2023-07-19T20:44:21.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.972+0000 7f69637fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f696406dc60 0x7f69640bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.972+0000 7f695a7fc700 1 -- 172.21.15.124:0/1594311385 learned_addr learned my addr 172.21.15.124:0/1594311385 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:21.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.972+0000 7f695a7fc700 1 -- 172.21.15.124:0/1594311385 >> v2:172.21.15.117:3300/0 conn(0x7f696406dc60 msgr2=0x7f69640bbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:21.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.972+0000 7f695a7fc700 1 --2- 172.21.15.124:0/1594311385 >> v2:172.21.15.117:3300/0 conn(0x7f696406dc60 0x7f69640bbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.972+0000 7f695a7fc700 1 -- 172.21.15.124:0/1594311385 >> v1:172.21.15.117:6789/0 conn(0x7f69640ba500 legacy=0x7f69640bb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.972+0000 7f695a7fc700 1 -- 172.21.15.124:0/1594311385 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696406d740 con 0x7f69640b86b0 2023-07-19T20:44:21.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.972+0000 7f695a7fc700 1 --2- 172.21.15.124:0/1594311385 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f69640b86b0 0x7f69640726d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f694c0098f0 tx=0x7f694c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4ba1f227bbf74a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:21.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.972+0000 7f69627fc700 1 -- 172.21.15.124:0/1594311385 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c011830 con 0x7f69640b86b0 2023-07-19T20:44:21.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.972+0000 7f69627fc700 1 -- 172.21.15.124:0/1594311385 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c011990 con 0x7f69640b86b0 2023-07-19T20:44:21.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.972+0000 7f69627fc700 1 -- 172.21.15.124:0/1594311385 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c011d20 con 0x7f69640b86b0 2023-07-19T20:44:21.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.973+0000 7f6969759700 1 -- 172.21.15.124:0/1594311385 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f69640b86b0 msgr2=0x7f69640726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.973+0000 7f6969759700 1 --2- 172.21.15.124:0/1594311385 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f69640b86b0 0x7f69640726d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f694c0098f0 tx=0x7f694c009c00 comp rx=0 tx=0).stop 2023-07-19T20:44:21.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.973+0000 7f6969759700 1 -- 172.21.15.124:0/1594311385 shutdown_connections 2023-07-19T20:44:21.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.973+0000 7f6969759700 1 --2- 172.21.15.124:0/1594311385 >> v2:172.21.15.117:3300/0 conn(0x7f696406dc60 0x7f69640bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.973+0000 7f6969759700 1 --2- 172.21.15.124:0/1594311385 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f69640b86b0 0x7f69640726d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.973+0000 7f6969759700 1 -- 172.21.15.124:0/1594311385 >> 172.21.15.124:0/1594311385 conn(0x7f696409f570 msgr2=0x7f696409f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:21.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.973+0000 7f6969759700 1 -- 172.21.15.124:0/1594311385 shutdown_connections 2023-07-19T20:44:21.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.973+0000 7f6969759700 1 -- 172.21.15.124:0/1594311385 wait complete. 2023-07-19T20:44:21.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.974+0000 7f6969759700 1 Processor -- start 2023-07-19T20:44:21.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.975+0000 7f6969759700 1 -- start start 2023-07-19T20:44:21.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f6969759700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f696406dc60 0x7f69641d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f6969759700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f69640b86b0 0x7f6964146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f6969759700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69640ba500 0x7f6964146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:21.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f6969759700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69641d1a10 con 0x7f69640ba500 2023-07-19T20:44:21.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f6969759700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69640a2600 con 0x7f69640b86b0 2023-07-19T20:44:21.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f6969759700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69641471d0 con 0x7f696406dc60 2023-07-19T20:44:21.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f6962ffd700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f696406dc60 0x7f69641d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f695a7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f69640b86b0 0x7f6964146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f695a7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f69640b86b0 0x7f6964146750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54548/0 (socket says 172.21.15.124:54548) 2023-07-19T20:44:21.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f695a7fc700 1 -- 172.21.15.124:0/399606860 learned_addr learned my addr 172.21.15.124:0/399606860 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:21.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f6962ffd700 1 --2- 172.21.15.124:0/399606860 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f696406dc60 0x7f69641d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:57266/0 (socket says 172.21.15.124:57266) 2023-07-19T20:44:21.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f69637fe700 1 --2- 172.21.15.124:0/399606860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69640ba500 0x7f6964146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:21.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f695a7fc700 1 -- 172.21.15.124:0/399606860 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f696406dc60 msgr2=0x7f69641d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f695a7fc700 1 --2- 172.21.15.124:0/399606860 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f696406dc60 0x7f69641d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f695a7fc700 1 -- 172.21.15.124:0/399606860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69640ba500 msgr2=0x7f6964146c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:21.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f695a7fc700 1 --2- 172.21.15.124:0/399606860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69640ba500 0x7f6964146c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:21.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f695a7fc700 1 -- 172.21.15.124:0/399606860 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c009550 con 0x7f69640b86b0 2023-07-19T20:44:21.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f6962ffd700 1 --2- 172.21.15.124:0/399606860 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f696406dc60 0x7f69641d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:21.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f69637fe700 1 --2- 172.21.15.124:0/399606860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69640ba500 0x7f6964146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:21.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.976+0000 7f695a7fc700 1 --2- 172.21.15.124:0/399606860 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f69640b86b0 0x7f6964146750 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f694c009c40 tx=0x7f694c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:21.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.977+0000 7f695bfff700 1 -- 172.21.15.124:0/399606860 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c004400 con 0x7f69640b86b0 2023-07-19T20:44:21.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.977+0000 7f695bfff700 1 -- 172.21.15.124:0/399606860 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c01f070 con 0x7f69640b86b0 2023-07-19T20:44:21.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.977+0000 7f695bfff700 1 -- 172.21.15.124:0/399606860 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c0038e0 con 0x7f69640b86b0 2023-07-19T20:44:21.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.977+0000 7f6969759700 1 -- 172.21.15.124:0/399606860 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69641d1d30 con 0x7f69640b86b0 2023-07-19T20:44:21.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.977+0000 7f6969759700 1 -- 172.21.15.124:0/399606860 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69640a0cf0 con 0x7f69640b86b0 2023-07-19T20:44:21.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.977+0000 7f695bfff700 1 -- 172.21.15.124:0/399606860 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f694c021030 con 0x7f69640b86b0 2023-07-19T20:44:21.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.977+0000 7f695bfff700 1 -- 172.21.15.124:0/399606860 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f694c01a450 con 0x7f69640b86b0 2023-07-19T20:44:21.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.979+0000 7f6969759700 1 -- 172.21.15.124:0/399606860 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6964067940 con 0x7f69640b86b0 2023-07-19T20:44:21.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:21.981+0000 7f695bfff700 1 -- 172.21.15.124:0/399606860 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f694c015020 con 0x7f69640b86b0 2023-07-19T20:44:22.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.074+0000 7f6969759700 1 -- 172.21.15.124:0/399606860 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b61c5e81-f13c-400b-a487-1ee6eee91e52", "id": 5} v 0) v1 -- 0x7f69640b7d50 con 0x7f69640b86b0 2023-07-19T20:44:22.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.082+0000 7f695bfff700 1 -- 172.21.15.124:0/399606860 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b61c5e81-f13c-400b-a487-1ee6eee91e52", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f694c003d40 con 0x7f69640b86b0 2023-07-19T20:44:22.076 INFO:teuthology.orchestra.run.smithi124.stdout:5 2023-07-19T20:44:22.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.083+0000 7f6969759700 1 -- 172.21.15.124:0/399606860 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f69640b86b0 msgr2=0x7f6964146750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.083+0000 7f6969759700 1 --2- 172.21.15.124:0/399606860 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f69640b86b0 0x7f6964146750 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f694c009c40 tx=0x7f694c004750 comp rx=0 tx=0).stop 2023-07-19T20:44:22.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.083+0000 7f6969759700 1 -- 172.21.15.124:0/399606860 shutdown_connections 2023-07-19T20:44:22.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.083+0000 7f6969759700 1 --2- 172.21.15.124:0/399606860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69640ba500 0x7f6964146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.083+0000 7f6969759700 1 --2- 172.21.15.124:0/399606860 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f696406dc60 0x7f69641d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.083+0000 7f6969759700 1 --2- 172.21.15.124:0/399606860 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f69640b86b0 0x7f6964146750 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.083+0000 7f6969759700 1 -- 172.21.15.124:0/399606860 >> 172.21.15.124:0/399606860 conn(0x7f696409f570 msgr2=0x7f696414aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:22.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.083+0000 7f6969759700 1 -- 172.21.15.124:0/399606860 shutdown_connections 2023-07-19T20:44:22.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.083+0000 7f6969759700 1 -- 172.21.15.124:0/399606860 wait complete. 2023-07-19T20:44:22.088 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new be4b9fa8-aee2-4782-87fd-be0d15345a2b 6 2023-07-19T20:44:22.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.217+0000 7fe17eb24700 1 Processor -- start 2023-07-19T20:44:22.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.217+0000 7fe17eb24700 1 -- start start 2023-07-19T20:44:22.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe17eb24700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe17806e770 0x7fe178072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe17eb24700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe17806eb40 0x7fe178142860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe17eb24700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1780ba430 con 0x7fe178142da0 2023-07-19T20:44:22.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe17eb24700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe178072b80 con 0x7fe17806e770 2023-07-19T20:44:22.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe17eb24700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17806f8c0 con 0x7fe17806eb40 2023-07-19T20:44:22.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe17c8c0700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe17806e770 0x7fe178072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe177fff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe17806eb40 0x7fe178142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe177fff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe17806eb40 0x7fe178142860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:57280/0 (socket says 172.21.15.124:57280) 2023-07-19T20:44:22.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe17c8c0700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe17806e770 0x7fe178072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54554/0 (socket says 172.21.15.124:54554) 2023-07-19T20:44:22.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe177fff700 1 -- 172.21.15.124:0/90517602 learned_addr learned my addr 172.21.15.124:0/90517602 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:22.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe177fff700 1 -- 172.21.15.124:0/90517602 >> v2:172.21.15.124:3300/0 conn(0x7fe17806e770 msgr2=0x7fe178072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:22.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe177fff700 1 --2- 172.21.15.124:0/90517602 >> v2:172.21.15.124:3300/0 conn(0x7fe17806e770 0x7fe178072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe177fff700 1 -- 172.21.15.124:0/90517602 >> v1:172.21.15.124:6789/0 conn(0x7fe178142da0 legacy=0x7fe1780ba8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe177fff700 1 -- 172.21.15.124:0/90517602 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1780b9d60 con 0x7fe17806eb40 2023-07-19T20:44:22.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe177fff700 1 --2- 172.21.15.124:0/90517602 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe17806eb40 0x7fe178142860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe1640098f0 tx=0x7fe164009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=323d70787650e32a server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:22.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe1777fe700 1 -- 172.21.15.124:0/90517602 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164011830 con 0x7fe17806eb40 2023-07-19T20:44:22.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe1777fe700 1 -- 172.21.15.124:0/90517602 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe164011990 con 0x7fe17806eb40 2023-07-19T20:44:22.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.218+0000 7fe1777fe700 1 -- 172.21.15.124:0/90517602 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164011d20 con 0x7fe17806eb40 2023-07-19T20:44:22.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.219+0000 7fe17eb24700 1 -- 172.21.15.124:0/90517602 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe17806eb40 msgr2=0x7fe178142860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.219+0000 7fe17eb24700 1 --2- 172.21.15.124:0/90517602 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe17806eb40 0x7fe178142860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe1640098f0 tx=0x7fe164009c00 comp rx=0 tx=0).stop 2023-07-19T20:44:22.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.219+0000 7fe17eb24700 1 -- 172.21.15.124:0/90517602 shutdown_connections 2023-07-19T20:44:22.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.219+0000 7fe17eb24700 1 --2- 172.21.15.124:0/90517602 >> v2:172.21.15.124:3300/0 conn(0x7fe17806e770 0x7fe178072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.219+0000 7fe17eb24700 1 --2- 172.21.15.124:0/90517602 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe17806eb40 0x7fe178142860 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.219+0000 7fe17eb24700 1 -- 172.21.15.124:0/90517602 >> 172.21.15.124:0/90517602 conn(0x7fe1780bea60 msgr2=0x7fe1780bee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:22.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.219+0000 7fe17eb24700 1 -- 172.21.15.124:0/90517602 shutdown_connections 2023-07-19T20:44:22.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.219+0000 7fe17eb24700 1 -- 172.21.15.124:0/90517602 wait complete. 2023-07-19T20:44:22.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.220+0000 7fe17eb24700 1 Processor -- start 2023-07-19T20:44:22.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.220+0000 7fe17eb24700 1 -- start start 2023-07-19T20:44:22.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe17eb24700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe17806e770 0x7fe17806cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe17eb24700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe17806eb40 0x7fe17806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe17eb24700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe178142da0 0x7fe17806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe17eb24700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17813e3f0 con 0x7fe17806e770 2023-07-19T20:44:22.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe17eb24700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe178147850 con 0x7fe17806eb40 2023-07-19T20:44:22.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe17eb24700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe178147b30 con 0x7fe178142da0 2023-07-19T20:44:22.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe177fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe17806eb40 0x7fe17806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe17d0c1700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe178142da0 0x7fe17806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe177fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe17806eb40 0x7fe17806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54556/0 (socket says 172.21.15.124:54556) 2023-07-19T20:44:22.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe177fff700 1 -- 172.21.15.124:0/1616317254 learned_addr learned my addr 172.21.15.124:0/1616317254 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:22.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe17c8c0700 1 --2- 172.21.15.124:0/1616317254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe17806e770 0x7fe17806cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe177fff700 1 -- 172.21.15.124:0/1616317254 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe178142da0 msgr2=0x7fe17806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe177fff700 1 --2- 172.21.15.124:0/1616317254 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe178142da0 0x7fe17806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe177fff700 1 -- 172.21.15.124:0/1616317254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe17806e770 msgr2=0x7fe17806cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe177fff700 1 --2- 172.21.15.124:0/1616317254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe17806e770 0x7fe17806cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.221+0000 7fe177fff700 1 -- 172.21.15.124:0/1616317254 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe164009550 con 0x7fe17806eb40 2023-07-19T20:44:22.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.222+0000 7fe177fff700 1 --2- 172.21.15.124:0/1616317254 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe17806eb40 0x7fe17806b8b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe164000c00 tx=0x7fe164004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:22.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.222+0000 7fe1757fa700 1 -- 172.21.15.124:0/1616317254 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164004400 con 0x7fe17806eb40 2023-07-19T20:44:22.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.222+0000 7fe1757fa700 1 -- 172.21.15.124:0/1616317254 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16401f070 con 0x7fe17806eb40 2023-07-19T20:44:22.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.222+0000 7fe17eb24700 1 -- 172.21.15.124:0/1616317254 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe178147e10 con 0x7fe17806eb40 2023-07-19T20:44:22.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.222+0000 7fe1757fa700 1 -- 172.21.15.124:0/1616317254 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1640038e0 con 0x7fe17806eb40 2023-07-19T20:44:22.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.222+0000 7fe17eb24700 1 -- 172.21.15.124:0/1616317254 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1781ce9e0 con 0x7fe17806eb40 2023-07-19T20:44:22.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.222+0000 7fe1757fa700 1 -- 172.21.15.124:0/1616317254 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe164021030 con 0x7fe17806eb40 2023-07-19T20:44:22.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.222+0000 7fe1757fa700 1 -- 172.21.15.124:0/1616317254 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fe164024430 con 0x7fe17806eb40 2023-07-19T20:44:22.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.223+0000 7fe17eb24700 1 -- 172.21.15.124:0/1616317254 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1780b9ff0 con 0x7fe17806eb40 2023-07-19T20:44:22.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.225+0000 7fe1757fa700 1 -- 172.21.15.124:0/1616317254 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fe164015020 con 0x7fe17806eb40 2023-07-19T20:44:22.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.308+0000 7fe17eb24700 1 -- 172.21.15.124:0/1616317254 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd new", "uuid": "be4b9fa8-aee2-4782-87fd-be0d15345a2b", "id": 6} v 0) v1 -- 0x7fe1780b7c10 con 0x7fe17806eb40 2023-07-19T20:44:22.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.316+0000 7fe1757fa700 1 -- 172.21.15.124:0/1616317254 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be4b9fa8-aee2-4782-87fd-be0d15345a2b", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe16401a450 con 0x7fe17806eb40 2023-07-19T20:44:22.311 INFO:teuthology.orchestra.run.smithi124.stdout:6 2023-07-19T20:44:22.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.317+0000 7fe17eb24700 1 -- 172.21.15.124:0/1616317254 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe17806eb40 msgr2=0x7fe17806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.317+0000 7fe17eb24700 1 --2- 172.21.15.124:0/1616317254 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe17806eb40 0x7fe17806b8b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe164000c00 tx=0x7fe164004750 comp rx=0 tx=0).stop 2023-07-19T20:44:22.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.317+0000 7fe17eb24700 1 -- 172.21.15.124:0/1616317254 shutdown_connections 2023-07-19T20:44:22.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.317+0000 7fe17eb24700 1 --2- 172.21.15.124:0/1616317254 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe178142da0 0x7fe17806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.317+0000 7fe17eb24700 1 --2- 172.21.15.124:0/1616317254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe17806e770 0x7fe17806cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.317+0000 7fe17eb24700 1 --2- 172.21.15.124:0/1616317254 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe17806eb40 0x7fe17806b8b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.317+0000 7fe17eb24700 1 -- 172.21.15.124:0/1616317254 >> 172.21.15.124:0/1616317254 conn(0x7fe1780bea60 msgr2=0x7fe1780bd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:22.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.317+0000 7fe17eb24700 1 -- 172.21.15.124:0/1616317254 shutdown_connections 2023-07-19T20:44:22.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.317+0000 7fe17eb24700 1 -- 172.21.15.124:0/1616317254 wait complete. 2023-07-19T20:44:22.322 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new 0da848ac-6f07-41b0-a967-204445959863 7 2023-07-19T20:44:22.348 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:22.355+0000 7f31b328c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-19T20:44:22.422 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:22.427+0000 7f31b328c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-19T20:44:22.435 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:22.441+0000 7f765b5f0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-19T20:44:22.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.450+0000 7f7537a57700 1 Processor -- start 2023-07-19T20:44:22.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.450+0000 7f7537a57700 1 -- start start 2023-07-19T20:44:22.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f7537a57700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7530144cc0 0x7f75300bf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f7537a57700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f753014a8c0 0x7f75300bd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f7537a57700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75300bc8b0 con 0x7f75300bea50 2023-07-19T20:44:22.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f7537a57700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75300c0a90 con 0x7f7530144cc0 2023-07-19T20:44:22.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f7537a57700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753014ad40 con 0x7f753014a8c0 2023-07-19T20:44:22.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f7535ff4700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f753014a8c0 0x7f75300bd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f7535ff4700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f753014a8c0 0x7f75300bd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54570/0 (socket says 172.21.15.124:54570) 2023-07-19T20:44:22.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f7535ff4700 1 -- 172.21.15.124:0/296826759 learned_addr learned my addr 172.21.15.124:0/296826759 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:22.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f75357f3700 1 --2- 172.21.15.124:0/296826759 >> v2:172.21.15.117:3300/0 conn(0x7f7530144cc0 0x7f75300bf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f7527fff700 1 -- 172.21.15.124:0/296826759 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610078280 0 0) 0x7f75300bc8b0 con 0x7f75300bea50 2023-07-19T20:44:22.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f7535ff4700 1 -- 172.21.15.124:0/296826759 >> v2:172.21.15.117:3300/0 conn(0x7f7530144cc0 msgr2=0x7f75300bf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:22.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f7535ff4700 1 --2- 172.21.15.124:0/296826759 >> v2:172.21.15.117:3300/0 conn(0x7f7530144cc0 0x7f75300bf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f7535ff4700 1 -- 172.21.15.124:0/296826759 >> v1:172.21.15.117:6789/0 conn(0x7f75300bea50 legacy=0x7f75300bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f7535ff4700 1 -- 172.21.15.124:0/296826759 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75300bdde0 con 0x7f753014a8c0 2023-07-19T20:44:22.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.451+0000 7f7535ff4700 1 --2- 172.21.15.124:0/296826759 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f753014a8c0 0x7f75300bd000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f75300b7cd0 tx=0x7f752800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e465df4226c5b6b server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:22.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.452+0000 7f7527fff700 1 -- 172.21.15.124:0/296826759 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752800e070 con 0x7f753014a8c0 2023-07-19T20:44:22.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.452+0000 7f7527fff700 1 -- 172.21.15.124:0/296826759 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752800b910 con 0x7f753014a8c0 2023-07-19T20:44:22.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.452+0000 7f7527fff700 1 -- 172.21.15.124:0/296826759 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752800bcc0 con 0x7f753014a8c0 2023-07-19T20:44:22.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.452+0000 7f7537a57700 1 -- 172.21.15.124:0/296826759 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f753014a8c0 msgr2=0x7f75300bd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.452+0000 7f7537a57700 1 --2- 172.21.15.124:0/296826759 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f753014a8c0 0x7f75300bd000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f75300b7cd0 tx=0x7f752800b330 comp rx=0 tx=0).stop 2023-07-19T20:44:22.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.452+0000 7f7537a57700 1 -- 172.21.15.124:0/296826759 shutdown_connections 2023-07-19T20:44:22.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.452+0000 7f7537a57700 1 --2- 172.21.15.124:0/296826759 >> v2:172.21.15.117:3300/0 conn(0x7f7530144cc0 0x7f75300bf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.452+0000 7f7537a57700 1 --2- 172.21.15.124:0/296826759 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f753014a8c0 0x7f75300bd000 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.452+0000 7f7537a57700 1 -- 172.21.15.124:0/296826759 >> 172.21.15.124:0/296826759 conn(0x7f75300a2880 msgr2=0x7f75300a2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:22.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.452+0000 7f7537a57700 1 -- 172.21.15.124:0/296826759 shutdown_connections 2023-07-19T20:44:22.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.452+0000 7f7537a57700 1 -- 172.21.15.124:0/296826759 wait complete. 2023-07-19T20:44:22.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.453+0000 7f7537a57700 1 Processor -- start 2023-07-19T20:44:22.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.453+0000 7f7537a57700 1 -- start start 2023-07-19T20:44:22.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7537a57700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75300bea50 0x7f75300a6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7537a57700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7530144cc0 0x7f75300b8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7537a57700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f753014a8c0 0x7f75301416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7537a57700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75300a6a80 con 0x7f75300bea50 2023-07-19T20:44:22.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7537a57700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75300ba8e0 con 0x7f7530144cc0 2023-07-19T20:44:22.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7537a57700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75300babc0 con 0x7f753014a8c0 2023-07-19T20:44:22.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7534ff2700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7530144cc0 0x7f75300b8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7535ff4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f753014a8c0 0x7f75301416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7535ff4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f753014a8c0 0x7f75301416e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:57296/0 (socket says 172.21.15.124:57296) 2023-07-19T20:44:22.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f75357f3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75300bea50 0x7f75300a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7535ff4700 1 -- 172.21.15.124:0/3443461070 learned_addr learned my addr 172.21.15.124:0/3443461070 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-07-19T20:44:22.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7535ff4700 1 -- 172.21.15.124:0/3443461070 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7530144cc0 msgr2=0x7f75300b8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7535ff4700 1 --2- 172.21.15.124:0/3443461070 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7530144cc0 0x7f75300b8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7535ff4700 1 -- 172.21.15.124:0/3443461070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75300bea50 msgr2=0x7f75300a6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7535ff4700 1 --2- 172.21.15.124:0/3443461070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75300bea50 0x7f75300a6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.454+0000 7f7535ff4700 1 -- 172.21.15.124:0/3443461070 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7528009b30 con 0x7f753014a8c0 2023-07-19T20:44:22.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.455+0000 7f7535ff4700 1 --2- 172.21.15.124:0/3443461070 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f753014a8c0 0x7f75301416e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f75300beea0 tx=0x7f7528004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:22.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.455+0000 7f7525ffb700 1 -- 172.21.15.124:0/3443461070 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528004840 con 0x7f753014a8c0 2023-07-19T20:44:22.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.455+0000 7f7525ffb700 1 -- 172.21.15.124:0/3443461070 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75280099b0 con 0x7f753014a8c0 2023-07-19T20:44:22.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.455+0000 7f7537a57700 1 -- 172.21.15.124:0/3443461070 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75300baea0 con 0x7f753014a8c0 2023-07-19T20:44:22.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.455+0000 7f7525ffb700 1 -- 172.21.15.124:0/3443461070 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752801b670 con 0x7f753014a8c0 2023-07-19T20:44:22.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.455+0000 7f7537a57700 1 -- 172.21.15.124:0/3443461070 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75300b9f30 con 0x7f753014a8c0 2023-07-19T20:44:22.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.455+0000 7f7525ffb700 1 -- 172.21.15.124:0/3443461070 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f752801bad0 con 0x7f753014a8c0 2023-07-19T20:44:22.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.455+0000 7f7525ffb700 1 -- 172.21.15.124:0/3443461070 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f75280123f0 con 0x7f753014a8c0 2023-07-19T20:44:22.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.456+0000 7f7537a57700 1 -- 172.21.15.124:0/3443461070 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75300b85e0 con 0x7f753014a8c0 2023-07-19T20:44:22.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.458+0000 7f7525ffb700 1 -- 172.21.15.124:0/3443461070 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f7528043b00 con 0x7f753014a8c0 2023-07-19T20:44:22.512 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:22.518+0000 7f765b5f0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-19T20:44:22.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.541+0000 7f7537a57700 1 -- 172.21.15.124:0/3443461070 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0da848ac-6f07-41b0-a967-204445959863", "id": 7} v 0) v1 -- 0x7f75300b8450 con 0x7f753014a8c0 2023-07-19T20:44:22.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.545+0000 7f7525ffb700 1 -- 172.21.15.124:0/3443461070 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0da848ac-6f07-41b0-a967-204445959863", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7528032070 con 0x7f753014a8c0 2023-07-19T20:44:22.539 INFO:teuthology.orchestra.run.smithi124.stdout:7 2023-07-19T20:44:22.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.546+0000 7f7537a57700 1 -- 172.21.15.124:0/3443461070 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f753014a8c0 msgr2=0x7f75301416e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.546+0000 7f7537a57700 1 --2- 172.21.15.124:0/3443461070 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f753014a8c0 0x7f75301416e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f75300beea0 tx=0x7f7528004ad0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.546+0000 7f7537a57700 1 -- 172.21.15.124:0/3443461070 shutdown_connections 2023-07-19T20:44:22.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.546+0000 7f7537a57700 1 --2- 172.21.15.124:0/3443461070 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f753014a8c0 0x7f75301416e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.546+0000 7f7537a57700 1 --2- 172.21.15.124:0/3443461070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75300bea50 0x7f75300a6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.546+0000 7f7537a57700 1 --2- 172.21.15.124:0/3443461070 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7530144cc0 0x7f75300b8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.546+0000 7f7537a57700 1 -- 172.21.15.124:0/3443461070 >> 172.21.15.124:0/3443461070 conn(0x7f75300a2880 msgr2=0x7f7530142aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:22.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.546+0000 7f7537a57700 1 -- 172.21.15.124:0/3443461070 shutdown_connections 2023-07-19T20:44:22.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-07-19T20:44:22.546+0000 7f7537a57700 1 -- 172.21.15.124:0/3443461070 wait complete. 2023-07-19T20:44:22.552 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-19T20:44:22.552 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-19T20:44:22.554 INFO:tasks.ceph.osd.0:Started 2023-07-19T20:44:22.555 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-19T20:44:22.555 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-19T20:44:22.556 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:22.562+0000 7f31b328c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-19T20:44:22.558 INFO:tasks.ceph.osd.1:Started 2023-07-19T20:44:22.558 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-19T20:44:22.558 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-19T20:44:22.560 INFO:tasks.ceph.osd.2:Started 2023-07-19T20:44:22.561 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-19T20:44:22.561 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-19T20:44:22.564 INFO:tasks.ceph.osd.3:Started 2023-07-19T20:44:22.565 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-19T20:44:22.565 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-19T20:44:22.567 INFO:tasks.ceph.osd.4:Started 2023-07-19T20:44:22.567 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-19T20:44:22.567 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-19T20:44:22.569 INFO:tasks.ceph.osd.5:Started 2023-07-19T20:44:22.570 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-19T20:44:22.570 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-19T20:44:22.572 INFO:tasks.ceph.osd.6:Started 2023-07-19T20:44:22.573 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-19T20:44:22.573 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-19T20:44:22.575 INFO:tasks.ceph.osd.7:Started 2023-07-19T20:44:22.576 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:22.661 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:22.666+0000 7f31b328c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-19T20:44:22.685 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:22.692+0000 7f765b5f0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-19T20:44:22.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.741+0000 7f9acdcc7700 1 Processor -- start 2023-07-19T20:44:22.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.741+0000 7f9acdcc7700 1 -- start start 2023-07-19T20:44:22.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.742+0000 7f9acdcc7700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9ac809ce10 0x7f9ac809f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.742+0000 7f9acdcc7700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ac8142720 0x7f9ac8148740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.742+0000 7f9acdcc7700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac80ba1e0 con 0x7f9ac80bbff0 2023-07-19T20:44:22.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.742+0000 7f9acdcc7700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac80bd2d0 con 0x7f9ac809ce10 2023-07-19T20:44:22.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.742+0000 7f9acdcc7700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac809d290 con 0x7f9ac8142720 2023-07-19T20:44:22.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.742+0000 7f9ac7fff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ac8142720 0x7f9ac8148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.742+0000 7f9ac6ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9ac809ce10 0x7f9ac809f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.742+0000 7f9ac7fff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ac8142720 0x7f9ac8148740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:45788/0 (socket says 172.21.15.117:45788) 2023-07-19T20:44:22.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.742+0000 7f9ac7fff700 1 -- 172.21.15.117:0/2107268803 learned_addr learned my addr 172.21.15.117:0/2107268803 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:22.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.743+0000 7f9ac7fff700 1 -- 172.21.15.117:0/2107268803 >> v2:172.21.15.124:3300/0 conn(0x7f9ac809ce10 msgr2=0x7f9ac809f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:22.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.743+0000 7f9ac7fff700 1 --2- 172.21.15.117:0/2107268803 >> v2:172.21.15.124:3300/0 conn(0x7f9ac809ce10 0x7f9ac809f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.743+0000 7f9ac7fff700 1 -- 172.21.15.117:0/2107268803 >> v1:172.21.15.124:6789/0 conn(0x7f9ac80bbff0 legacy=0x7f9ac814c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.743+0000 7f9ac7fff700 1 -- 172.21.15.117:0/2107268803 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac814bdb0 con 0x7f9ac8142720 2023-07-19T20:44:22.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.743+0000 7f9ac6ffd700 1 --2- 172.21.15.117:0/2107268803 >> v2:172.21.15.124:3300/0 conn(0x7f9ac809ce10 0x7f9ac809f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:22.739 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.743+0000 7f9ac7fff700 1 --2- 172.21.15.117:0/2107268803 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ac8142720 0x7f9ac8148740 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009e50 tx=0x7f9ac000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d91d2fadb1d9417e server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:22.739 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.743+0000 7f9ac67fc700 1 -- 172.21.15.117:0/2107268803 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac000e070 con 0x7f9ac8142720 2023-07-19T20:44:22.739 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.743+0000 7f9ac67fc700 1 -- 172.21.15.117:0/2107268803 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac000b910 con 0x7f9ac8142720 2023-07-19T20:44:22.739 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.743+0000 7f9ac67fc700 1 -- 172.21.15.117:0/2107268803 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac000bcc0 con 0x7f9ac8142720 2023-07-19T20:44:22.742 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.744+0000 7f9acdcc7700 1 -- 172.21.15.117:0/2107268803 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ac8142720 msgr2=0x7f9ac8148740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.742 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.744+0000 7f9acdcc7700 1 --2- 172.21.15.117:0/2107268803 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ac8142720 0x7f9ac8148740 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009e50 tx=0x7f9ac000b330 comp rx=0 tx=0).stop 2023-07-19T20:44:22.742 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.744+0000 7f9acdcc7700 1 -- 172.21.15.117:0/2107268803 shutdown_connections 2023-07-19T20:44:22.742 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.744+0000 7f9acdcc7700 1 --2- 172.21.15.117:0/2107268803 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ac8142720 0x7f9ac8148740 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.742 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.744+0000 7f9acdcc7700 1 --2- 172.21.15.117:0/2107268803 >> v2:172.21.15.124:3300/0 conn(0x7f9ac809ce10 0x7f9ac809f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.744+0000 7f9acdcc7700 1 -- 172.21.15.117:0/2107268803 >> 172.21.15.117:0/2107268803 conn(0x7f9ac80bd910 msgr2=0x7f9ac80bdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.744+0000 7f9acdcc7700 1 -- 172.21.15.117:0/2107268803 shutdown_connections 2023-07-19T20:44:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.744+0000 7f9acdcc7700 1 -- 172.21.15.117:0/2107268803 wait complete. 2023-07-19T20:44:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.745+0000 7f9acdcc7700 1 Processor -- start 2023-07-19T20:44:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.745+0000 7f9acdcc7700 1 -- start start 2023-07-19T20:44:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9acdcc7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ac809ce10 0x7f9ac80ba5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9acdcc7700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ac80bbff0 0x7f9ac80a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9acdcc7700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ac8142720 0x7f9ac81e15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:22.744 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9acdcc7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac814c150 con 0x7f9ac809ce10 2023-07-19T20:44:22.744 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9acdcc7700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80bab20 con 0x7f9ac8142720 2023-07-19T20:44:22.744 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9acdcc7700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80b7be0 con 0x7f9ac80bbff0 2023-07-19T20:44:22.744 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9ac6ffd700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ac80bbff0 0x7f9ac80a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.744 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9ac77fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ac809ce10 0x7f9ac80ba5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.744 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9ac7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ac8142720 0x7f9ac81e15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:22.744 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9ac6ffd700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ac80bbff0 0x7f9ac80a2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:45792/0 (socket says 172.21.15.117:45792) 2023-07-19T20:44:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9ac6ffd700 1 -- 172.21.15.117:0/2189333412 learned_addr learned my addr 172.21.15.117:0/2189333412 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9ac6ffd700 1 -- 172.21.15.117:0/2189333412 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ac8142720 msgr2=0x7f9ac81e15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9ac6ffd700 1 --2- 172.21.15.117:0/2189333412 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ac8142720 0x7f9ac81e15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9ac6ffd700 1 -- 172.21.15.117:0/2189333412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ac809ce10 msgr2=0x7f9ac80ba5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9ac6ffd700 1 --2- 172.21.15.117:0/2189333412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ac809ce10 0x7f9ac80ba5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9ac6ffd700 1 -- 172.21.15.117:0/2189333412 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc0094a0 con 0x7f9ac80bbff0 2023-07-19T20:44:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9ac77fe700 1 --2- 172.21.15.117:0/2189333412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ac809ce10 0x7f9ac80ba5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:22.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.746+0000 7f9ac6ffd700 1 --2- 172.21.15.117:0/2189333412 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ac80bbff0 0x7f9ac80a2d00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00ebe0 tx=0x7f9abc00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:22.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.747+0000 7f9aaffff700 1 -- 172.21.15.117:0/2189333412 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc00c850 con 0x7f9ac80bbff0 2023-07-19T20:44:22.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.747+0000 7f9aaffff700 1 -- 172.21.15.117:0/2189333412 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc00c9b0 con 0x7f9ac80bbff0 2023-07-19T20:44:22.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.747+0000 7f9acdcc7700 1 -- 172.21.15.117:0/2189333412 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac0009b30 con 0x7f9ac80bbff0 2023-07-19T20:44:22.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.747+0000 7f9aaffff700 1 -- 172.21.15.117:0/2189333412 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc00cd40 con 0x7f9ac80bbff0 2023-07-19T20:44:22.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.747+0000 7f9acdcc7700 1 -- 172.21.15.117:0/2189333412 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac80bb020 con 0x7f9ac80bbff0 2023-07-19T20:44:22.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.747+0000 7f9aaffff700 1 -- 172.21.15.117:0/2189333412 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9abc005d20 con 0x7f9ac80bbff0 2023-07-19T20:44:22.747 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.747+0000 7f9aaffff700 1 -- 172.21.15.117:0/2189333412 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9abc006840 con 0x7f9ac80bbff0 2023-07-19T20:44:22.747 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.748+0000 7f9acdcc7700 1 -- 172.21.15.117:0/2189333412 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac8067940 con 0x7f9ac80bbff0 2023-07-19T20:44:22.747 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.750+0000 7f9aaffff700 1 -- 172.21.15.117:0/2189333412 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f9abc021060 con 0x7f9ac80bbff0 2023-07-19T20:44:22.756 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:22.762+0000 7f765b5f0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-19T20:44:22.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.820+0000 7f9acdcc7700 1 -- 172.21.15.117:0/2189333412 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ac81496c0 con 0x7f9ac80bbff0 2023-07-19T20:44:22.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.820+0000 7f9aaffff700 1 -- 172.21.15.117:0/2189333412 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9abc029020 con 0x7f9ac80bbff0 2023-07-19T20:44:22.814 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:22.814 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":10,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:22.543491+0000","last_up_change":"0.000000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:22.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.821+0000 7f9acdcc7700 1 -- 172.21.15.117:0/2189333412 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ac80bbff0 msgr2=0x7f9ac80a2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:22.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.821+0000 7f9acdcc7700 1 --2- 172.21.15.117:0/2189333412 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ac80bbff0 0x7f9ac80a2d00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00ebe0 tx=0x7f9abc00eef0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.821+0000 7f9acdcc7700 1 -- 172.21.15.117:0/2189333412 shutdown_connections 2023-07-19T20:44:22.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.821+0000 7f9acdcc7700 1 --2- 172.21.15.117:0/2189333412 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ac8142720 0x7f9ac81e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.821+0000 7f9acdcc7700 1 --2- 172.21.15.117:0/2189333412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ac809ce10 0x7f9ac80ba5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.821+0000 7f9acdcc7700 1 --2- 172.21.15.117:0/2189333412 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ac80bbff0 0x7f9ac80a2d00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:22.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.821+0000 7f9acdcc7700 1 -- 172.21.15.117:0/2189333412 >> 172.21.15.117:0/2189333412 conn(0x7f9ac80bd910 msgr2=0x7f9ac806cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:22.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.821+0000 7f9acdcc7700 1 -- 172.21.15.117:0/2189333412 shutdown_connections 2023-07-19T20:44:22.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:22.822+0000 7f9acdcc7700 1 -- 172.21.15.117:0/2189333412 wait complete. 2023-07-19T20:44:22.827 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-19T20:44:22.827 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-19T20:44:22.849 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:22.855+0000 7f31b328c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-19T20:44:22.928 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:22.934+0000 7f31b328c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-19T20:44:22.935 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:22.941+0000 7f765b5f0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-19T20:44:23.007 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:23.013+0000 7f31b328c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-19T20:44:23.014 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:23.020+0000 7f765b5f0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-19T20:44:23.091 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:23.097+0000 7f765b5f0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-19T20:44:23.103 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:23.109+0000 7f31b328c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-19T20:44:23.171 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:23.177+0000 7f765b5f0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-19T20:44:23.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-07-19T20:44:23.179+0000 7fe83aeea640 -1 Falling back to public interface 2023-07-19T20:44:23.175 INFO:tasks.ceph.osd.4.smithi124.stderr:2023-07-19T20:44:23.181+0000 7f6858261640 -1 Falling back to public interface 2023-07-19T20:44:23.177 INFO:tasks.ceph.osd.5.smithi124.stderr:2023-07-19T20:44:23.181+0000 7f67de620640 -1 Falling back to public interface 2023-07-19T20:44:23.179 INFO:tasks.ceph.osd.4.smithi124.stderr:2023-07-19T20:44:23.181+0000 7f684f608700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-07-19T20:44:23.179 INFO:tasks.ceph.osd.5.smithi124.stderr:2023-07-19T20:44:23.181+0000 7f67d59c7700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2023-07-19T20:44:23.180 INFO:tasks.ceph.osd.5.smithi124.stderr:2023-07-19T20:44:23.181+0000 7f67d59c7700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6802/0: (98) Address already in use 2023-07-19T20:44:23.180 INFO:tasks.ceph.osd.6.smithi124.stderr:2023-07-19T20:44:23.186+0000 7f633d57d640 -1 Falling back to public interface 2023-07-19T20:44:23.181 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-07-19T20:44:23.188+0000 7f3ade5a2640 -1 Falling back to public interface 2023-07-19T20:44:23.198 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-07-19T20:44:23.204+0000 7fc9e4b22640 -1 Falling back to public interface 2023-07-19T20:44:23.198 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-07-19T20:44:23.205+0000 7fc2f93b0640 -1 Falling back to public interface 2023-07-19T20:44:23.204 INFO:tasks.ceph.osd.7.smithi124.stderr:2023-07-19T20:44:23.210+0000 7f130c516640 -1 Falling back to public interface 2023-07-19T20:44:23.284 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:23.291+0000 7f31b328c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-19T20:44:23.357 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:23.363+0000 7f765b5f0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-19T20:44:23.365 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:23.371+0000 7f31b328c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-19T20:44:23.438 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:23.444+0000 7f765b5f0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-19T20:44:23.633 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:23.651 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:23.658+0000 7f31b328c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-19T20:44:23.725 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:23.732+0000 7f31b328c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-19T20:44:23.726 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:23.732+0000 7f765b5f0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-19T20:44:23.756 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.753+0000 7f287775b700 1 Processor -- start 2023-07-19T20:44:23.757 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.754+0000 7f287775b700 1 -- start start 2023-07-19T20:44:23.757 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.754+0000 7f287775b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f28700bff90 0x7f28700bc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:23.757 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.754+0000 7f287775b700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28700c0360 0x7f28700bce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:23.757 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.754+0000 7f287775b700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28700a2ef0 con 0x7f28700bf6d0 2023-07-19T20:44:23.758 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.754+0000 7f287775b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287008b1d0 con 0x7f28700bff90 2023-07-19T20:44:23.758 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.754+0000 7f287775b700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28700bfbf0 con 0x7f28700c0360 2023-07-19T20:44:23.758 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.754+0000 7f28754f7700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f28700bff90 0x7f28700bc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:23.758 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.754+0000 7f28754f7700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f28700bff90 0x7f28700bc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33490/0 (socket says 172.21.15.117:33490) 2023-07-19T20:44:23.758 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.754+0000 7f28754f7700 1 -- 172.21.15.117:0/2338012518 learned_addr learned my addr 172.21.15.117:0/2338012518 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:23.759 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.754+0000 7f2875cf8700 1 --2- 172.21.15.117:0/2338012518 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28700c0360 0x7f28700bce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:23.759 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.755+0000 7f28754f7700 1 -- 172.21.15.117:0/2338012518 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28700c0360 msgr2=0x7f28700bce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:23.759 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.755+0000 7f28754f7700 1 --2- 172.21.15.117:0/2338012518 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28700c0360 0x7f28700bce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:23.760 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.755+0000 7f28754f7700 1 -- 172.21.15.117:0/2338012518 >> v1:172.21.15.124:6789/0 conn(0x7f28700bf6d0 legacy=0x7f287014ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:23.760 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.755+0000 7f28754f7700 1 -- 172.21.15.117:0/2338012518 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700a28a0 con 0x7f28700bff90 2023-07-19T20:44:23.760 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.755+0000 7f2875cf8700 1 --2- 172.21.15.117:0/2338012518 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28700c0360 0x7f28700bce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:23.761 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.755+0000 7f28754f7700 1 --2- 172.21.15.117:0/2338012518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700bff90 0x7f28700bc940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f286c0098f0 tx=0x7f286c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5695882a0be8398d server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:23.761 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.755+0000 7f2867fff700 1 -- 172.21.15.117:0/2338012518 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c00b8a0 con 0x7f28700bff90 2023-07-19T20:44:23.761 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.755+0000 7f2867fff700 1 -- 172.21.15.117:0/2338012518 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c00ba00 con 0x7f28700bff90 2023-07-19T20:44:23.761 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.755+0000 7f2867fff700 1 -- 172.21.15.117:0/2338012518 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c00bd90 con 0x7f28700bff90 2023-07-19T20:44:23.761 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.756+0000 7f287775b700 1 -- 172.21.15.117:0/2338012518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700bff90 msgr2=0x7f28700bc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:23.761 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.756+0000 7f287775b700 1 --2- 172.21.15.117:0/2338012518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700bff90 0x7f28700bc940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f286c0098f0 tx=0x7f286c009c00 comp rx=0 tx=0).stop 2023-07-19T20:44:23.762 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.756+0000 7f287775b700 1 -- 172.21.15.117:0/2338012518 shutdown_connections 2023-07-19T20:44:23.762 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.756+0000 7f287775b700 1 --2- 172.21.15.117:0/2338012518 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28700c0360 0x7f28700bce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:23.762 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.756+0000 7f287775b700 1 --2- 172.21.15.117:0/2338012518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700bff90 0x7f28700bc940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:23.762 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.756+0000 7f287775b700 1 -- 172.21.15.117:0/2338012518 >> 172.21.15.117:0/2338012518 conn(0x7f28700c0b20 msgr2=0x7f28700c0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:23.763 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.756+0000 7f287775b700 1 -- 172.21.15.117:0/2338012518 shutdown_connections 2023-07-19T20:44:23.763 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.756+0000 7f287775b700 1 -- 172.21.15.117:0/2338012518 wait complete. 2023-07-19T20:44:23.763 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.757+0000 7f287775b700 1 Processor -- start 2023-07-19T20:44:23.764 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.757+0000 7f287775b700 1 -- start start 2023-07-19T20:44:23.764 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f287775b700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28700bf6d0 0x7f28700b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:23.764 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f287775b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28700bff90 0x7f287014c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:23.764 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f287775b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700c0360 0x7f287013ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:23.765 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f287775b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287014e320 con 0x7f28700c0360 2023-07-19T20:44:23.765 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f287775b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287014c3d0 con 0x7f28700bff90 2023-07-19T20:44:23.765 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f287775b700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28700b77a0 con 0x7f28700bf6d0 2023-07-19T20:44:23.765 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f2875cf8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700c0360 0x7f287013ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:23.766 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f2875cf8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700c0360 0x7f287013ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33506/0 (socket says 172.21.15.117:33506) 2023-07-19T20:44:23.766 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f2875cf8700 1 -- 172.21.15.117:0/3109986422 learned_addr learned my addr 172.21.15.117:0/3109986422 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:23.766 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f28754f7700 1 --2- 172.21.15.117:0/3109986422 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28700bf6d0 0x7f28700b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:23.767 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f2874cf6700 1 --2- 172.21.15.117:0/3109986422 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28700bff90 0x7f287014c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:23.767 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f2875cf8700 1 -- 172.21.15.117:0/3109986422 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28700bf6d0 msgr2=0x7f28700b7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:23.767 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f2875cf8700 1 --2- 172.21.15.117:0/3109986422 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28700bf6d0 0x7f28700b7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:23.767 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f2875cf8700 1 -- 172.21.15.117:0/3109986422 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28700bff90 msgr2=0x7f287014c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:23.768 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f2875cf8700 1 --2- 172.21.15.117:0/3109986422 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28700bff90 0x7f287014c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:23.768 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f2875cf8700 1 -- 172.21.15.117:0/3109986422 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c009550 con 0x7f28700c0360 2023-07-19T20:44:23.768 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.758+0000 7f2875cf8700 1 --2- 172.21.15.117:0/3109986422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700c0360 0x7f287013ac20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2868007ea0 tx=0x7f286800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:23.768 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.759+0000 7f2865ffb700 1 -- 172.21.15.117:0/3109986422 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800dd20 con 0x7f28700c0360 2023-07-19T20:44:23.769 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.759+0000 7f2865ffb700 1 -- 172.21.15.117:0/3109986422 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286800f040 con 0x7f28700c0360 2023-07-19T20:44:23.769 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.759+0000 7f287775b700 1 -- 172.21.15.117:0/3109986422 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287014c0f0 con 0x7f28700c0360 2023-07-19T20:44:23.769 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.759+0000 7f2865ffb700 1 -- 172.21.15.117:0/3109986422 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868003c60 con 0x7f28700c0360 2023-07-19T20:44:23.769 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.759+0000 7f2865ffb700 1 -- 172.21.15.117:0/3109986422 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2868004330 con 0x7f28700c0360 2023-07-19T20:44:23.770 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.759+0000 7f287775b700 1 -- 172.21.15.117:0/3109986422 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287014e830 con 0x7f28700c0360 2023-07-19T20:44:23.770 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.759+0000 7f2865ffb700 1 -- 172.21.15.117:0/3109986422 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2868003dc0 con 0x7f28700c0360 2023-07-19T20:44:23.770 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.760+0000 7f287775b700 1 -- 172.21.15.117:0/3109986422 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2870074910 con 0x7f28700c0360 2023-07-19T20:44:23.770 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.762+0000 7f2865ffb700 1 -- 172.21.15.117:0/3109986422 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f2868024060 con 0x7f28700c0360 2023-07-19T20:44:23.798 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:23.805+0000 7f765b5f0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-19T20:44:23.825 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.831+0000 7f287775b700 1 -- 172.21.15.117:0/3109986422 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28700a32a0 con 0x7f28700c0360 2023-07-19T20:44:23.826 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.831+0000 7f2865ffb700 1 -- 172.21.15.117:0/3109986422 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f286801a070 con 0x7f28700c0360 2023-07-19T20:44:23.826 INFO:teuthology.misc.health.smithi117.stdout: 2023-07-19T20:44:23.826 INFO:teuthology.misc.health.smithi117.stdout:{"epoch":10,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:22.543491+0000","last_up_change":"0.000000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:23.827 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.832+0000 7f287775b700 1 -- 172.21.15.117:0/3109986422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700c0360 msgr2=0x7f287013ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:23.827 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.832+0000 7f287775b700 1 --2- 172.21.15.117:0/3109986422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700c0360 0x7f287013ac20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2868007ea0 tx=0x7f286800d3b0 comp rx=0 tx=0).stop 2023-07-19T20:44:23.827 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.832+0000 7f287775b700 1 -- 172.21.15.117:0/3109986422 shutdown_connections 2023-07-19T20:44:23.828 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.832+0000 7f287775b700 1 --2- 172.21.15.117:0/3109986422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700c0360 0x7f287013ac20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:23.828 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.832+0000 7f287775b700 1 --2- 172.21.15.117:0/3109986422 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28700bf6d0 0x7f28700b7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:23.828 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.832+0000 7f287775b700 1 --2- 172.21.15.117:0/3109986422 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28700bff90 0x7f287014c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:23.828 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.832+0000 7f287775b700 1 -- 172.21.15.117:0/3109986422 >> 172.21.15.117:0/3109986422 conn(0x7f28700c0b20 msgr2=0x7f2870143680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:23.828 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.832+0000 7f287775b700 1 -- 172.21.15.117:0/3109986422 shutdown_connections 2023-07-19T20:44:23.828 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:23.832+0000 7f287775b700 1 -- 172.21.15.117:0/3109986422 wait complete. 2023-07-19T20:44:23.836 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-19T20:44:24.237 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:24.244+0000 7f31b328c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-19T20:44:24.305 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:24.311+0000 7f765b5f0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-19T20:44:24.551 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:24.557+0000 7f31b328c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-19T20:44:24.620 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:24.626+0000 7f765b5f0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-19T20:44:24.693 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:24.700+0000 7f31b328c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-19T20:44:24.763 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:24.769+0000 7f765b5f0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-19T20:44:25.050 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:25.056+0000 7f31b328c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-19T20:44:25.119 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:25.126+0000 7f765b5f0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-19T20:44:25.197 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:25.204+0000 7f31b328c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-19T20:44:25.265 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:25.271+0000 7f765b5f0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-19T20:44:25.347 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:25.354+0000 7f31b328c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-19T20:44:25.416 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:25.422+0000 7f765b5f0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-19T20:44:25.658 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:25.665+0000 7f31b328c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-19T20:44:25.730 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-07-19T20:44:25.736+0000 7f765b5f0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-19T20:44:26.653 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-07-19T20:44:26.659+0000 7f3ade5a2640 -1 osd.2 0 log_to_monitors true 2023-07-19T20:44:26.676 INFO:tasks.ceph.osd.4.smithi124.stderr:2023-07-19T20:44:26.682+0000 7f6858261640 -1 osd.4 0 log_to_monitors true 2023-07-19T20:44:26.685 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:26.691+0000 7f31746a6700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-19T20:44:26.685 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-07-19T20:44:26.692+0000 7f31746a6700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-19T20:44:26.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-07-19T20:44:26.706+0000 7fe83aeea640 -1 osd.1 0 log_to_monitors true 2023-07-19T20:44:26.707 INFO:tasks.ceph.osd.6.smithi124.stderr:2023-07-19T20:44:26.712+0000 7f633d57d640 -1 osd.6 0 log_to_monitors true 2023-07-19T20:44:26.716 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-07-19T20:44:26.722+0000 7fc2f93b0640 -1 osd.0 0 log_to_monitors true 2023-07-19T20:44:26.718 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-07-19T20:44:26.724+0000 7fc9e4b22640 -1 osd.3 0 log_to_monitors true 2023-07-19T20:44:26.718 INFO:tasks.ceph.osd.5.smithi124.stderr:2023-07-19T20:44:26.725+0000 7f67de620640 -1 osd.5 0 log_to_monitors true 2023-07-19T20:44:26.720 INFO:tasks.ceph.osd.7.smithi124.stderr:2023-07-19T20:44:26.727+0000 7f130c516640 -1 osd.7 0 log_to_monitors true 2023-07-19T20:44:29.056 INFO:tasks.ceph.osd.4.smithi124.stderr:2023-07-19T20:44:29.061+0000 7f684be01700 -1 osd.4 0 waiting for initial osdmap 2023-07-19T20:44:29.087 INFO:tasks.ceph.osd.4.smithi124.stderr:2023-07-19T20:44:29.093+0000 7f68441dc700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-19T20:44:29.108 INFO:tasks.ceph.osd.6.smithi124.stderr:2023-07-19T20:44:29.114+0000 7f633111d700 -1 osd.6 0 waiting for initial osdmap 2023-07-19T20:44:29.171 INFO:tasks.ceph.osd.6.smithi124.stderr:2023-07-19T20:44:29.178+0000 7f63294f8700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-19T20:44:29.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-07-19T20:44:29.361+0000 7fe82ea8a700 -1 osd.1 0 waiting for initial osdmap 2023-07-19T20:44:29.400 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-07-19T20:44:29.406+0000 7f3ad2142700 -1 osd.2 0 waiting for initial osdmap 2023-07-19T20:44:29.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-07-19T20:44:29.472+0000 7fe826e65700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-19T20:44:29.478 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-07-19T20:44:29.485+0000 7f3aca51d700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-19T20:44:30.008 INFO:tasks.ceph.osd.5.smithi124.stderr:2023-07-19T20:44:30.014+0000 7f67d21c0700 -1 osd.5 0 waiting for initial osdmap 2023-07-19T20:44:30.017 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-07-19T20:44:30.024+0000 7fc9d86c2700 -1 osd.3 0 waiting for initial osdmap 2023-07-19T20:44:30.019 INFO:tasks.ceph.osd.5.smithi124.stderr:2023-07-19T20:44:30.026+0000 7f67ca59b700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-19T20:44:30.024 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-07-19T20:44:30.031+0000 7fc2ecf50700 -1 osd.0 0 waiting for initial osdmap 2023-07-19T20:44:30.025 INFO:tasks.ceph.osd.7.smithi124.stderr:2023-07-19T20:44:30.032+0000 7f13000b6700 -1 osd.7 0 waiting for initial osdmap 2023-07-19T20:44:30.028 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-07-19T20:44:30.035+0000 7fc9d0a9d700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-19T20:44:30.041 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-07-19T20:44:30.048+0000 7fc2e532b700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-19T20:44:30.045 INFO:tasks.ceph.osd.7.smithi124.stderr:2023-07-19T20:44:30.052+0000 7f12f8491700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-19T20:44:30.644 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:30.773 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.780+0000 7f86e4b01700 1 Processor -- start 2023-07-19T20:44:30.774 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.780+0000 7f86e4b01700 1 -- start start 2023-07-19T20:44:30.775 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.780+0000 7f86e4b01700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f86e00bf6d0 0x7f86e0153150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:30.775 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.780+0000 7f86e4b01700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f86e00bd050 0x7f86e01556a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:30.775 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.780+0000 7f86e4b01700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e00a2ef0 con 0x7f86e00bff90 2023-07-19T20:44:30.775 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86e4b01700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e008b1d0 con 0x7f86e00bd050 2023-07-19T20:44:30.775 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86e4b01700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00bfbf0 con 0x7f86e00bf6d0 2023-07-19T20:44:30.776 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86de59c700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f86e00bff90 0x7f86e00bc940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:43928/0 (socket says 172.21.15.117:43928) 2023-07-19T20:44:30.776 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86de59c700 1 -- 172.21.15.117:0/1709406599 learned_addr learned my addr 172.21.15.117:0/1709406599 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:30.776 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86ded9d700 1 --2- 172.21.15.117:0/1709406599 >> v2:172.21.15.124:3300/0 conn(0x7f86e00bd050 0x7f86e01556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:30.776 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86ddd9b700 1 --2- 172.21.15.117:0/1709406599 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f86e00bf6d0 0x7f86e0153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:30.776 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86dd59a700 1 -- 172.21.15.117:0/1709406599 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086218624 0 0) 0x7f86e00a2ef0 con 0x7f86e00bff90 2023-07-19T20:44:30.777 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86dd59a700 1 -- 172.21.15.117:0/1709406599 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c80035b0 con 0x7f86e00bff90 2023-07-19T20:44:30.777 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86dd59a700 1 -- 172.21.15.117:0/1709406599 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 103217327 0 0) 0x7f86c80035b0 con 0x7f86e00bff90 2023-07-19T20:44:30.777 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86ded9d700 1 -- 172.21.15.117:0/1709406599 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f86e00bf6d0 msgr2=0x7f86e0153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:30.778 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86ded9d700 1 --2- 172.21.15.117:0/1709406599 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f86e00bf6d0 0x7f86e0153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:30.778 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86ded9d700 1 -- 172.21.15.117:0/1709406599 >> v1:172.21.15.117:6789/0 conn(0x7f86e00bff90 legacy=0x7f86e00bc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:30.779 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86ded9d700 1 -- 172.21.15.117:0/1709406599 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e00a28a0 con 0x7f86e00bd050 2023-07-19T20:44:30.779 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86ddd9b700 1 --2- 172.21.15.117:0/1709406599 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f86e00bf6d0 0x7f86e0153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:30.779 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86ded9d700 1 --2- 172.21.15.117:0/1709406599 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f86e00bd050 0x7f86e01556a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009d90 tx=0x7f86d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9a83c99c1a824bd server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:30.780 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86dd59a700 1 -- 172.21.15.117:0/1709406599 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800e070 con 0x7f86e00bd050 2023-07-19T20:44:30.780 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86dd59a700 1 -- 172.21.15.117:0/1709406599 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d8003a20 con 0x7f86e00bd050 2023-07-19T20:44:30.780 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.781+0000 7f86dd59a700 1 -- 172.21.15.117:0/1709406599 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0001670 con 0x7f86e00bd050 2023-07-19T20:44:30.784 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.782+0000 7f86e4b01700 1 -- 172.21.15.117:0/1709406599 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f86e00bd050 msgr2=0x7f86e01556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:30.786 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.782+0000 7f86e4b01700 1 --2- 172.21.15.117:0/1709406599 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f86e00bd050 0x7f86e01556a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009d90 tx=0x7f86d800b330 comp rx=0 tx=0).stop 2023-07-19T20:44:30.786 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.782+0000 7f86e4b01700 1 -- 172.21.15.117:0/1709406599 shutdown_connections 2023-07-19T20:44:30.786 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.782+0000 7f86e4b01700 1 --2- 172.21.15.117:0/1709406599 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f86e00bd050 0x7f86e01556a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:30.787 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.782+0000 7f86e4b01700 1 --2- 172.21.15.117:0/1709406599 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f86e00bf6d0 0x7f86e0153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:30.787 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.782+0000 7f86e4b01700 1 -- 172.21.15.117:0/1709406599 >> 172.21.15.117:0/1709406599 conn(0x7f86e00c0b20 msgr2=0x7f86e00c0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:30.787 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.782+0000 7f86e4b01700 1 -- 172.21.15.117:0/1709406599 shutdown_connections 2023-07-19T20:44:30.787 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.782+0000 7f86e4b01700 1 -- 172.21.15.117:0/1709406599 wait complete. 2023-07-19T20:44:30.788 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.783+0000 7f86e4b01700 1 Processor -- start 2023-07-19T20:44:30.788 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.783+0000 7f86e4b01700 1 -- start start 2023-07-19T20:44:30.788 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86e4b01700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f86e00bd050 0x7f86e01e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:30.789 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86e4b01700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86e00bf6d0 0x7f86e00a6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:30.789 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86e4b01700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f86e00bff90 0x7f86e00a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:30.789 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86e4b01700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e01e3f80 con 0x7f86e00bf6d0 2023-07-19T20:44:30.789 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86e4b01700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00a6a90 con 0x7f86e00bd050 2023-07-19T20:44:30.790 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86e4b01700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00a5f30 con 0x7f86e00bff90 2023-07-19T20:44:30.790 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86ddd9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86e00bf6d0 0x7f86e00a6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:30.790 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86ddd9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86e00bf6d0 0x7f86e00a6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33630/0 (socket says 172.21.15.117:33630) 2023-07-19T20:44:30.790 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86ddd9b700 1 -- 172.21.15.117:0/1573880035 learned_addr learned my addr 172.21.15.117:0/1573880035 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:30.791 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86de59c700 1 --2- 172.21.15.117:0/1573880035 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f86e00bd050 0x7f86e01e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:30.791 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86ded9d700 1 --2- 172.21.15.117:0/1573880035 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f86e00bff90 0x7f86e00a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:30.791 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86ddd9b700 1 -- 172.21.15.117:0/1573880035 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f86e00bff90 msgr2=0x7f86e00a5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:30.791 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86ddd9b700 1 --2- 172.21.15.117:0/1573880035 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f86e00bff90 0x7f86e00a5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:30.792 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86ddd9b700 1 -- 172.21.15.117:0/1573880035 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f86e00bd050 msgr2=0x7f86e01e3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:30.792 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86ddd9b700 1 --2- 172.21.15.117:0/1573880035 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f86e00bd050 0x7f86e01e3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:30.792 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.784+0000 7f86ddd9b700 1 -- 172.21.15.117:0/1573880035 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d40094a0 con 0x7f86e00bf6d0 2023-07-19T20:44:30.792 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.785+0000 7f86ddd9b700 1 --2- 172.21.15.117:0/1573880035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86e00bf6d0 0x7f86e00a6550 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f86d400ebb0 tx=0x7f86d400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:30.793 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.785+0000 7f86ceffd700 1 -- 172.21.15.117:0/1573880035 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d400c850 con 0x7f86e00bf6d0 2023-07-19T20:44:30.793 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.785+0000 7f86ceffd700 1 -- 172.21.15.117:0/1573880035 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d400c9b0 con 0x7f86e00bf6d0 2023-07-19T20:44:30.793 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.785+0000 7f86e4b01700 1 -- 172.21.15.117:0/1573880035 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d8009a70 con 0x7f86e00bf6d0 2023-07-19T20:44:30.793 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.785+0000 7f86ceffd700 1 -- 172.21.15.117:0/1573880035 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d400cd40 con 0x7f86e00bf6d0 2023-07-19T20:44:30.793 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.785+0000 7f86e4b01700 1 -- 172.21.15.117:0/1573880035 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e01e4160 con 0x7f86e00bf6d0 2023-07-19T20:44:30.794 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.786+0000 7f86e4b01700 1 -- 172.21.15.117:0/1573880035 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e004e840 con 0x7f86e00bf6d0 2023-07-19T20:44:30.794 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.786+0000 7f86ceffd700 1 -- 172.21.15.117:0/1573880035 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 4) v1 ==== 88145+0+0 (secure 0 0 0) 0x7f86d4013470 con 0x7f86e00bf6d0 2023-07-19T20:44:30.794 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.786+0000 7f86ceffd700 1 --2- 172.21.15.117:0/1573880035 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f86c006a5d0 0x7f86c006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:30.794 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.787+0000 7f86ceffd700 1 -- 172.21.15.117:0/1573880035 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f86d4088770 con 0x7f86e00bf6d0 2023-07-19T20:44:30.794 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.787+0000 7f86de59c700 1 --2- 172.21.15.117:0/1573880035 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f86c006a5d0 0x7f86c006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:30.795 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.787+0000 7f86de59c700 1 --2- 172.21.15.117:0/1573880035 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f86c006a5d0 0x7f86c006ca80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86d0000f60 tx=0x7f86d0001e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:30.795 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.791+0000 7f86ceffd700 1 -- 172.21.15.117:0/1573880035 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f86d4054280 con 0x7f86e00bf6d0 2023-07-19T20:44:30.971 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.976+0000 7f86e4b01700 1 -- 172.21.15.117:0/1573880035 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86e0074910 con 0x7f86e00bf6d0 2023-07-19T20:44:30.971 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.977+0000 7f86ceffd700 1 -- 172.21.15.117:0/1573880035 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10584 (secure 0 0 0) 0x7f86d40578a0 con 0x7f86e00bf6d0 2023-07-19T20:44:30.972 INFO:teuthology.misc.health.smithi117.stdout: 2023-07-19T20:44:30.972 INFO:teuthology.misc.health.smithi117.stdout:{"epoch":14,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:30.104224+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:30.974 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.979+0000 7f86e4b01700 1 -- 172.21.15.117:0/1573880035 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f86c006a5d0 msgr2=0x7f86c006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:30.974 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.979+0000 7f86e4b01700 1 --2- 172.21.15.117:0/1573880035 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f86c006a5d0 0x7f86c006ca80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86d0000f60 tx=0x7f86d0001e00 comp rx=0 tx=0).stop 2023-07-19T20:44:30.974 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.979+0000 7f86e4b01700 1 -- 172.21.15.117:0/1573880035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86e00bf6d0 msgr2=0x7f86e00a6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:30.975 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.979+0000 7f86e4b01700 1 --2- 172.21.15.117:0/1573880035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86e00bf6d0 0x7f86e00a6550 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f86d400ebb0 tx=0x7f86d400eec0 comp rx=0 tx=0).stop 2023-07-19T20:44:30.975 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.979+0000 7f86e4b01700 1 -- 172.21.15.117:0/1573880035 shutdown_connections 2023-07-19T20:44:30.975 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.979+0000 7f86e4b01700 1 --2- 172.21.15.117:0/1573880035 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f86c006a5d0 0x7f86c006ca80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:30.975 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.979+0000 7f86e4b01700 1 --2- 172.21.15.117:0/1573880035 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f86e00bff90 0x7f86e00a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:30.975 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.979+0000 7f86e4b01700 1 --2- 172.21.15.117:0/1573880035 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f86e00bd050 0x7f86e01e3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:30.975 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.979+0000 7f86e4b01700 1 --2- 172.21.15.117:0/1573880035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86e00bf6d0 0x7f86e00a6550 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:30.976 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.979+0000 7f86e4b01700 1 -- 172.21.15.117:0/1573880035 >> 172.21.15.117:0/1573880035 conn(0x7f86e00c0b20 msgr2=0x7f86e0142cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:30.976 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.979+0000 7f86e4b01700 1 -- 172.21.15.117:0/1573880035 shutdown_connections 2023-07-19T20:44:30.976 INFO:teuthology.misc.health.smithi117.stderr:2023-07-19T20:44:30.979+0000 7f86e4b01700 1 -- 172.21.15.117:0/1573880035 wait complete. 2023-07-19T20:44:30.984 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-19T20:44:30.985 INFO:tasks.ceph:Creating RBD pool 2023-07-19T20:44:30.985 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-19T20:44:31.107 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.114+0000 7f2386e27700 1 Processor -- start 2023-07-19T20:44:31.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.114+0000 7f2386e27700 1 -- start start 2023-07-19T20:44:31.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.114+0000 7f2386e27700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f238014ddd0 0x7f23800b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:31.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.114+0000 7f2386e27700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23800bd540 con 0x7f23800baa60 2023-07-19T20:44:31.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.114+0000 7f2386e27700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23800b8d70 con 0x7f23800bca00 2023-07-19T20:44:31.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.114+0000 7f2386e27700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2380144ea0 con 0x7f238014ddd0 2023-07-19T20:44:31.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.114+0000 7f2384bc3700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f23800baa60 0x7f2380144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:43944/0 (socket says 172.21.15.117:43944) 2023-07-19T20:44:31.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.114+0000 7f2384bc3700 1 -- 172.21.15.117:0/204877501 learned_addr learned my addr 172.21.15.117:0/204877501 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:31.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.115+0000 7f23853c4700 1 --2- 172.21.15.117:0/204877501 >> v2:172.21.15.124:3300/0 conn(0x7f238014ddd0 0x7f23800b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:31.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.115+0000 7f237f7fe700 1 -- 172.21.15.117:0/204877501 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518042208 0 0) 0x7f23800bd540 con 0x7f23800baa60 2023-07-19T20:44:31.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.115+0000 7f237f7fe700 1 -- 172.21.15.117:0/204877501 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23700035b0 con 0x7f23800baa60 2023-07-19T20:44:31.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.115+0000 7f237f7fe700 1 -- 172.21.15.117:0/204877501 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 703871736 0 0) 0x7f23700035b0 con 0x7f23800baa60 2023-07-19T20:44:31.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.115+0000 7f23853c4700 1 -- 172.21.15.117:0/204877501 >> v1:172.21.15.124:6789/0 conn(0x7f23800bca00 legacy=0x7f2380153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:31.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.115+0000 7f23853c4700 1 -- 172.21.15.117:0/204877501 >> v1:172.21.15.117:6789/0 conn(0x7f23800baa60 legacy=0x7f2380144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:31.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.115+0000 7f23853c4700 1 -- 172.21.15.117:0/204877501 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23800b8fe0 con 0x7f238014ddd0 2023-07-19T20:44:31.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.115+0000 7f23853c4700 1 --2- 172.21.15.117:0/204877501 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f238014ddd0 0x7f23800b7f30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2378009dc0 tx=0x7f237800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37374737bf6cfa20 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:31.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.115+0000 7f237f7fe700 1 -- 172.21.15.117:0/204877501 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237800e070 con 0x7f238014ddd0 2023-07-19T20:44:31.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.115+0000 7f237f7fe700 1 -- 172.21.15.117:0/204877501 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2378003a20 con 0x7f238014ddd0 2023-07-19T20:44:31.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.115+0000 7f237f7fe700 1 -- 172.21.15.117:0/204877501 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374001670 con 0x7f238014ddd0 2023-07-19T20:44:31.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.116+0000 7f2386e27700 1 -- 172.21.15.117:0/204877501 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f238014ddd0 msgr2=0x7f23800b7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:31.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.116+0000 7f2386e27700 1 --2- 172.21.15.117:0/204877501 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f238014ddd0 0x7f23800b7f30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2378009dc0 tx=0x7f237800b330 comp rx=0 tx=0).stop 2023-07-19T20:44:31.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.116+0000 7f2386e27700 1 -- 172.21.15.117:0/204877501 shutdown_connections 2023-07-19T20:44:31.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.116+0000 7f2386e27700 1 --2- 172.21.15.117:0/204877501 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f238014ddd0 0x7f23800b7f30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:31.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.116+0000 7f2386e27700 1 -- 172.21.15.117:0/204877501 >> 172.21.15.117:0/204877501 conn(0x7f2380071c90 msgr2=0x7f2380072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:31.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.116+0000 7f2386e27700 1 -- 172.21.15.117:0/204877501 shutdown_connections 2023-07-19T20:44:31.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.116+0000 7f2386e27700 1 -- 172.21.15.117:0/204877501 wait complete. 2023-07-19T20:44:31.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.117+0000 7f2386e27700 1 Processor -- start 2023-07-19T20:44:31.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.117+0000 7f2386e27700 1 -- start start 2023-07-19T20:44:31.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f2386e27700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23800baa60 0x7f23800b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:31.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f2386e27700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f23800bca00 0x7f23801e0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:31.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f2386e27700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f238014ddd0 0x7f23801e3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:31.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f2386e27700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23800b7220 con 0x7f238014ddd0 2023-07-19T20:44:31.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f2386e27700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23800c0270 con 0x7f23800baa60 2023-07-19T20:44:31.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f2386e27700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23800c0fb0 con 0x7f23800bca00 2023-07-19T20:44:31.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f23853c4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f238014ddd0 0x7f23801e3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:31.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f23853c4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f238014ddd0 0x7f23801e3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33642/0 (socket says 172.21.15.117:33642) 2023-07-19T20:44:31.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f23853c4700 1 -- 172.21.15.117:0/2954060540 learned_addr learned my addr 172.21.15.117:0/2954060540 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:31.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f2384bc3700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23800baa60 0x7f23800b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:31.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f237ffff700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f23800bca00 0x7f23801e0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:31.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f23853c4700 1 -- 172.21.15.117:0/2954060540 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f23800bca00 msgr2=0x7f23801e0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:31.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f23853c4700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f23800bca00 0x7f23801e0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:31.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f23853c4700 1 -- 172.21.15.117:0/2954060540 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23800baa60 msgr2=0x7f23800b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:31.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f23853c4700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23800baa60 0x7f23800b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:31.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f23853c4700 1 -- 172.21.15.117:0/2954060540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2378009a70 con 0x7f238014ddd0 2023-07-19T20:44:31.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f2384bc3700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23800baa60 0x7f23800b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:31.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f23853c4700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f238014ddd0 0x7f23801e3580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2378015040 tx=0x7f2378004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:31.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f237d7fa700 1 -- 172.21.15.117:0/2954060540 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378004670 con 0x7f238014ddd0 2023-07-19T20:44:31.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f2386e27700 1 -- 172.21.15.117:0/2954060540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238014a130 con 0x7f238014ddd0 2023-07-19T20:44:31.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f237d7fa700 1 -- 172.21.15.117:0/2954060540 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23780047d0 con 0x7f238014ddd0 2023-07-19T20:44:31.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f237d7fa700 1 -- 172.21.15.117:0/2954060540 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378012690 con 0x7f238014ddd0 2023-07-19T20:44:31.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.118+0000 7f2386e27700 1 -- 172.21.15.117:0/2954060540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23801e0400 con 0x7f238014ddd0 2023-07-19T20:44:31.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.119+0000 7f2386e27700 1 -- 172.21.15.117:0/2954060540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23800b9800 con 0x7f238014ddd0 2023-07-19T20:44:31.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.120+0000 7f237d7fa700 1 -- 172.21.15.117:0/2954060540 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 4) v1 ==== 88145+0+0 (secure 0 0 0) 0x7f23780127f0 con 0x7f238014ddd0 2023-07-19T20:44:31.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.120+0000 7f237d7fa700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f236406a5d0 0x7f236406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:31.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.120+0000 7f237d7fa700 1 -- 172.21.15.117:0/2954060540 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f2378089e00 con 0x7f238014ddd0 2023-07-19T20:44:31.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.120+0000 7f2384bc3700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f236406a5d0 0x7f236406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:31.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.120+0000 7f2384bc3700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f236406a5d0 0x7f236406ca80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2374007a90 tx=0x7f2374009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:31.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.124+0000 7f237d7fa700 1 -- 172.21.15.117:0/2954060540 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2378055920 con 0x7f238014ddd0 2023-07-19T20:44:31.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:31.307+0000 7f2386e27700 1 -- 172.21.15.117:0/2954060540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f23801e0590 con 0x7f238014ddd0 2023-07-19T20:44:32.108 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.115+0000 7f237d7fa700 1 -- 172.21.15.117:0/2954060540 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f2378058f40 con 0x7f238014ddd0 2023-07-19T20:44:32.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.118+0000 7f2386e27700 1 -- 172.21.15.117:0/2954060540 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f236406a5d0 msgr2=0x7f236406ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:32.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.118+0000 7f2386e27700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f236406a5d0 0x7f236406ca80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2374007a90 tx=0x7f2374009040 comp rx=0 tx=0).stop 2023-07-19T20:44:32.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.118+0000 7f2386e27700 1 -- 172.21.15.117:0/2954060540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f238014ddd0 msgr2=0x7f23801e3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:32.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.118+0000 7f2386e27700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f238014ddd0 0x7f23801e3580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2378015040 tx=0x7f2378004ad0 comp rx=0 tx=0).stop 2023-07-19T20:44:32.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.118+0000 7f2386e27700 1 -- 172.21.15.117:0/2954060540 shutdown_connections 2023-07-19T20:44:32.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.118+0000 7f2386e27700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f236406a5d0 0x7f236406ca80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:32.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.118+0000 7f2386e27700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f238014ddd0 0x7f23801e3580 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:32.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.118+0000 7f2386e27700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23800baa60 0x7f23800b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:32.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.118+0000 7f2386e27700 1 --2- 172.21.15.117:0/2954060540 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f23800bca00 0x7f23801e0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:32.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.118+0000 7f2386e27700 1 -- 172.21.15.117:0/2954060540 >> 172.21.15.117:0/2954060540 conn(0x7f2380071c90 msgr2=0x7f238014d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:32.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.118+0000 7f2386e27700 1 -- 172.21.15.117:0/2954060540 shutdown_connections 2023-07-19T20:44:32.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.118+0000 7f2386e27700 1 -- 172.21.15.117:0/2954060540 wait complete. 2023-07-19T20:44:32.113 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'rbd' created 2023-07-19T20:44:32.126 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-19T20:44:32.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.261+0000 7f4eb63f1700 1 Processor -- start 2023-07-19T20:44:32.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.261+0000 7f4eb63f1700 1 -- start start 2023-07-19T20:44:32.260 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.262+0000 7f4eb63f1700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4eb00728b0 0x7f4eb014e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:32.260 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.262+0000 7f4eb63f1700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4eb00bd920 0x7f4eb00bdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:32.260 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.262+0000 7f4eb63f1700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb00bce10 con 0x7f4eb0144ec0 2023-07-19T20:44:32.261 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.262+0000 7f4eb63f1700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb014ea90 con 0x7f4eb00728b0 2023-07-19T20:44:32.261 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.262+0000 7f4eb63f1700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb014efc0 con 0x7f4eb00bd920 2023-07-19T20:44:32.261 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.262+0000 7f4eb498e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4eb00bd920 0x7f4eb00bdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:32.261 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.262+0000 7f4eaf7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4eb00728b0 0x7f4eb014e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:32.261 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.262+0000 7f4eaf7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4eb00728b0 0x7f4eb014e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:55504/0 (socket says 172.21.15.117:55504) 2023-07-19T20:44:32.261 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.262+0000 7f4eb498e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4eb00bd920 0x7f4eb00bdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:46514/0 (socket says 172.21.15.117:46514) 2023-07-19T20:44:32.261 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.262+0000 7f4eaf7fe700 1 -- 172.21.15.117:0/504156050 learned_addr learned my addr 172.21.15.117:0/504156050 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:32.262 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.262+0000 7f4eaffff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f4eb0144ec0 0x7f4eb014b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.117:58624/0 (socket says 172.21.15.117:58624) 2023-07-19T20:44:32.262 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.263+0000 7f4eb498e700 1 -- 172.21.15.117:0/504156050 >> v2:172.21.15.124:3300/0 conn(0x7f4eb00728b0 msgr2=0x7f4eb014e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:32.262 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.263+0000 7f4eb498e700 1 --2- 172.21.15.117:0/504156050 >> v2:172.21.15.124:3300/0 conn(0x7f4eb00728b0 0x7f4eb014e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:32.262 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.263+0000 7f4eb498e700 1 -- 172.21.15.117:0/504156050 >> v1:172.21.15.124:6789/0 conn(0x7f4eb0144ec0 legacy=0x7f4eb014b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:32.262 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.263+0000 7f4eb498e700 1 -- 172.21.15.117:0/504156050 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb0145290 con 0x7f4eb00bd920 2023-07-19T20:44:32.262 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.263+0000 7f4eb498e700 1 --2- 172.21.15.117:0/504156050 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4eb00bd920 0x7f4eb00bdd50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009d90 tx=0x7f4ea800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25d463711e483bc4 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:32.262 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.263+0000 7f4eaeffd700 1 -- 172.21.15.117:0/504156050 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea800e070 con 0x7f4eb00bd920 2023-07-19T20:44:32.263 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.263+0000 7f4eaeffd700 1 -- 172.21.15.117:0/504156050 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea800bb20 con 0x7f4eb00bd920 2023-07-19T20:44:32.263 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.263+0000 7f4eaeffd700 1 -- 172.21.15.117:0/504156050 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8012430 con 0x7f4eb00bd920 2023-07-19T20:44:32.263 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.264+0000 7f4eb63f1700 1 -- 172.21.15.117:0/504156050 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4eb00bd920 msgr2=0x7f4eb00bdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:32.263 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.264+0000 7f4eb63f1700 1 --2- 172.21.15.117:0/504156050 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4eb00bd920 0x7f4eb00bdd50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009d90 tx=0x7f4ea800b330 comp rx=0 tx=0).stop 2023-07-19T20:44:32.263 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.264+0000 7f4eb63f1700 1 -- 172.21.15.117:0/504156050 shutdown_connections 2023-07-19T20:44:32.263 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.264+0000 7f4eb63f1700 1 --2- 172.21.15.117:0/504156050 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4eb00bd920 0x7f4eb00bdd50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:32.263 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.264+0000 7f4eb63f1700 1 --2- 172.21.15.117:0/504156050 >> v2:172.21.15.124:3300/0 conn(0x7f4eb00728b0 0x7f4eb014e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:32.263 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.264+0000 7f4eb63f1700 1 -- 172.21.15.117:0/504156050 >> 172.21.15.117:0/504156050 conn(0x7f4eb00a0660 msgr2=0x7f4eb00a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:32.264 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.264+0000 7f4eb63f1700 1 -- 172.21.15.117:0/504156050 shutdown_connections 2023-07-19T20:44:32.264 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.264+0000 7f4eb63f1700 1 -- 172.21.15.117:0/504156050 wait complete. 2023-07-19T20:44:32.264 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.265+0000 7f4eb63f1700 1 Processor -- start 2023-07-19T20:44:32.264 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.265+0000 7f4eb63f1700 1 -- start start 2023-07-19T20:44:32.264 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.265+0000 7f4eb63f1700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4eb00728b0 0x7f4eb01d7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:32.264 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.265+0000 7f4eb63f1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eb00bd920 0x7f4eb01e0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:32.264 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.265+0000 7f4eb63f1700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4eb0144ec0 0x7f4eb01e11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:32.265 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.265+0000 7f4eb63f1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb01d75c0 con 0x7f4eb00bd920 2023-07-19T20:44:32.265 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.265+0000 7f4eb63f1700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb01e07f0 con 0x7f4eb00728b0 2023-07-19T20:44:32.265 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.265+0000 7f4eb63f1700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb00bc310 con 0x7f4eb0144ec0 2023-07-19T20:44:32.265 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eaf7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eb00bd920 0x7f4eb01e0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:32.265 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eaf7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eb00bd920 0x7f4eb01e0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35676/0 (socket says 172.21.15.117:35676) 2023-07-19T20:44:32.265 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eaf7fe700 1 -- 172.21.15.117:0/2331339683 learned_addr learned my addr 172.21.15.117:0/2331339683 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:32.265 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eaffff700 1 --2- 172.21.15.117:0/2331339683 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4eb00728b0 0x7f4eb01d7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:32.265 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eb498e700 1 --2- 172.21.15.117:0/2331339683 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4eb0144ec0 0x7f4eb01e11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:32.266 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eaf7fe700 1 -- 172.21.15.117:0/2331339683 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4eb0144ec0 msgr2=0x7f4eb01e11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:32.266 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eaf7fe700 1 --2- 172.21.15.117:0/2331339683 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4eb0144ec0 0x7f4eb01e11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:32.266 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eaf7fe700 1 -- 172.21.15.117:0/2331339683 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4eb00728b0 msgr2=0x7f4eb01d7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:32.266 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eaf7fe700 1 --2- 172.21.15.117:0/2331339683 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4eb00728b0 0x7f4eb01d7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:32.266 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eaf7fe700 1 -- 172.21.15.117:0/2331339683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea8009a70 con 0x7f4eb00bd920 2023-07-19T20:44:32.266 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eaf7fe700 1 --2- 172.21.15.117:0/2331339683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eb00bd920 0x7f4eb01e0c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000e980 tx=0x7f4ea000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:32.266 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eacff9700 1 -- 172.21.15.117:0/2331339683 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000c690 con 0x7f4eb00bd920 2023-07-19T20:44:32.267 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eacff9700 1 -- 172.21.15.117:0/2331339683 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea000c7f0 con 0x7f4eb00bd920 2023-07-19T20:44:32.267 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eb63f1700 1 -- 172.21.15.117:0/2331339683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb006ccc0 con 0x7f4eb00bd920 2023-07-19T20:44:32.267 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eacff9700 1 -- 172.21.15.117:0/2331339683 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000cb60 con 0x7f4eb00bd920 2023-07-19T20:44:32.267 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.266+0000 7f4eb63f1700 1 -- 172.21.15.117:0/2331339683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb01d7940 con 0x7f4eb00bd920 2023-07-19T20:44:32.268 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.267+0000 7f4eb63f1700 1 -- 172.21.15.117:0/2331339683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb01e0ad0 con 0x7f4eb00bd920 2023-07-19T20:44:32.268 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.268+0000 7f4eacff9700 1 -- 172.21.15.117:0/2331339683 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 4) v1 ==== 88145+0+0 (secure 0 0 0) 0x7f4ea000ccc0 con 0x7f4eb00bd920 2023-07-19T20:44:32.268 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.268+0000 7f4eacff9700 1 --2- 172.21.15.117:0/2331339683 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4e9c06a5d0 0x7f4e9c06ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:32.268 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.268+0000 7f4eacff9700 1 -- 172.21.15.117:0/2331339683 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f4ea0088550 con 0x7f4eb00bd920 2023-07-19T20:44:32.268 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.268+0000 7f4eaffff700 1 --2- 172.21.15.117:0/2331339683 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4e9c06a5d0 0x7f4e9c06ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:32.269 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.268+0000 7f4eaffff700 1 --2- 172.21.15.117:0/2331339683 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4e9c06a5d0 0x7f4e9c06ca80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4000f60 tx=0x7f4ea4007ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:32.269 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.273+0000 7f4eacff9700 1 -- 172.21.15.117:0/2331339683 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f4ea0053e20 con 0x7f4eb00bd920 2023-07-19T20:44:32.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:32.458+0000 7f4eb63f1700 1 -- 172.21.15.117:0/2331339683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4eb01e0930 con 0x7f4eb00bd920 2023-07-19T20:44:33.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.119+0000 7f4eacff9700 1 -- 172.21.15.117:0/2331339683 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4eb01e0930 con 0x7f4eb00bd920 2023-07-19T20:44:33.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.123+0000 7f4eb63f1700 1 -- 172.21.15.117:0/2331339683 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4e9c06a5d0 msgr2=0x7f4e9c06ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:33.119 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.123+0000 7f4eb63f1700 1 --2- 172.21.15.117:0/2331339683 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4e9c06a5d0 0x7f4e9c06ca80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4000f60 tx=0x7f4ea4007ed0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.119 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.123+0000 7f4eb63f1700 1 -- 172.21.15.117:0/2331339683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eb00bd920 msgr2=0x7f4eb01e0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:33.119 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.123+0000 7f4eb63f1700 1 --2- 172.21.15.117:0/2331339683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eb00bd920 0x7f4eb01e0c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000e980 tx=0x7f4ea000ec90 comp rx=0 tx=0).stop 2023-07-19T20:44:33.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.123+0000 7f4eb63f1700 1 -- 172.21.15.117:0/2331339683 shutdown_connections 2023-07-19T20:44:33.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.123+0000 7f4eb63f1700 1 --2- 172.21.15.117:0/2331339683 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4e9c06a5d0 0x7f4e9c06ca80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.123+0000 7f4eb63f1700 1 --2- 172.21.15.117:0/2331339683 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4eb0144ec0 0x7f4eb01e11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.123+0000 7f4eb63f1700 1 --2- 172.21.15.117:0/2331339683 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4eb00728b0 0x7f4eb01d7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.123+0000 7f4eb63f1700 1 --2- 172.21.15.117:0/2331339683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eb00bd920 0x7f4eb01e0c80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.123+0000 7f4eb63f1700 1 -- 172.21.15.117:0/2331339683 >> 172.21.15.117:0/2331339683 conn(0x7f4eb00a0660 msgr2=0x7f4eb009e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:33.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.124+0000 7f4eb63f1700 1 -- 172.21.15.117:0/2331339683 shutdown_connections 2023-07-19T20:44:33.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.124+0000 7f4eb63f1700 1 -- 172.21.15.117:0/2331339683 wait complete. 2023-07-19T20:44:33.121 INFO:teuthology.orchestra.run.smithi117.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-19T20:44:33.132 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-19T20:44:33.133 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-19T20:44:33.133 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-19T20:44:33.135 INFO:tasks.ceph.mds.a:Started 2023-07-19T20:44:33.135 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-19T20:44:33.135 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-19T20:44:33.142 INFO:tasks.ceph.mds.c:Started 2023-07-19T20:44:33.143 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-19T20:44:33.143 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-19T20:44:33.146 INFO:tasks.ceph.mds.b:Started 2023-07-19T20:44:33.147 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-19T20:44:33.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:33.232 INFO:tasks.ceph.mds.a.smithi117.stdout:starting mds.a at 2023-07-19T20:44:33.233 INFO:tasks.ceph.mds.b.smithi124.stdout:starting mds.b at 2023-07-19T20:44:33.233 INFO:tasks.ceph.mds.c.smithi117.stdout:starting mds.c at 2023-07-19T20:44:33.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.300+0000 7efe53f24700 1 Processor -- start 2023-07-19T20:44:33.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.300+0000 7efe53f24700 1 -- start start 2023-07-19T20:44:33.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe53f24700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe4c071be0 0x7efe4c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:33.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe53f24700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efe4c0b8da0 0x7efe4c0b9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:33.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe53f24700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4c0729d0 con 0x7efe4c0bacb0 2023-07-19T20:44:33.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe53f24700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4c0715e0 con 0x7efe4c0b8da0 2023-07-19T20:44:33.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe53f24700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0717c0 con 0x7efe4c071be0 2023-07-19T20:44:33.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe524c1700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efe4c0b8da0 0x7efe4c0b9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:33.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe524c1700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efe4c0b8da0 0x7efe4c0b9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35734/0 (socket says 172.21.15.117:35734) 2023-07-19T20:44:33.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe524c1700 1 -- 172.21.15.117:0/2449217644 learned_addr learned my addr 172.21.15.117:0/2449217644 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:33.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe514bf700 1 --2- 172.21.15.117:0/2449217644 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe4c071be0 0x7efe4c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:33.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe50cbe700 1 -- 172.21.15.117:0/2449217644 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715373046 0 0) 0x7efe4c0729d0 con 0x7efe4c0bacb0 2023-07-19T20:44:33.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe514bf700 1 -- 172.21.15.117:0/2449217644 >> v2:172.21.15.117:3300/0 conn(0x7efe4c0b8da0 msgr2=0x7efe4c0b9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:33.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe514bf700 1 --2- 172.21.15.117:0/2449217644 >> v2:172.21.15.117:3300/0 conn(0x7efe4c0b8da0 0x7efe4c0b9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe514bf700 1 -- 172.21.15.117:0/2449217644 >> v1:172.21.15.124:6789/0 conn(0x7efe4c0bacb0 legacy=0x7efe4c1446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:33.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe514bf700 1 -- 172.21.15.117:0/2449217644 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c0b9740 con 0x7efe4c071be0 2023-07-19T20:44:33.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe524c1700 1 --2- 172.21.15.117:0/2449217644 >> v2:172.21.15.117:3300/0 conn(0x7efe4c0b8da0 0x7efe4c0b9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:33.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe514bf700 1 --2- 172.21.15.117:0/2449217644 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe4c071be0 0x7efe4c0702f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efe3c009840 tx=0x7efe3c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aff9777a8642fa9b server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:33.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.301+0000 7efe50cbe700 1 -- 172.21.15.117:0/2449217644 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c011830 con 0x7efe4c071be0 2023-07-19T20:44:33.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.302+0000 7efe50cbe700 1 -- 172.21.15.117:0/2449217644 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3c011990 con 0x7efe4c071be0 2023-07-19T20:44:33.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.302+0000 7efe50cbe700 1 -- 172.21.15.117:0/2449217644 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c011d20 con 0x7efe4c071be0 2023-07-19T20:44:33.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.302+0000 7efe53f24700 1 -- 172.21.15.117:0/2449217644 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe4c071be0 msgr2=0x7efe4c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:33.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.302+0000 7efe53f24700 1 --2- 172.21.15.117:0/2449217644 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe4c071be0 0x7efe4c0702f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efe3c009840 tx=0x7efe3c009b50 comp rx=0 tx=0).stop 2023-07-19T20:44:33.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.302+0000 7efe53f24700 1 -- 172.21.15.117:0/2449217644 shutdown_connections 2023-07-19T20:44:33.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.302+0000 7efe53f24700 1 --2- 172.21.15.117:0/2449217644 >> v2:172.21.15.117:3300/0 conn(0x7efe4c0b8da0 0x7efe4c0b9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.302+0000 7efe53f24700 1 --2- 172.21.15.117:0/2449217644 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe4c071be0 0x7efe4c0702f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.302+0000 7efe53f24700 1 -- 172.21.15.117:0/2449217644 >> 172.21.15.117:0/2449217644 conn(0x7efe4c0be4b0 msgr2=0x7efe4c0ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.302+0000 7efe53f24700 1 -- 172.21.15.117:0/2449217644 shutdown_connections 2023-07-19T20:44:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.302+0000 7efe53f24700 1 -- 172.21.15.117:0/2449217644 wait complete. 2023-07-19T20:44:33.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.303+0000 7efe53f24700 1 Processor -- start 2023-07-19T20:44:33.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.303+0000 7efe53f24700 1 -- start start 2023-07-19T20:44:33.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe53f24700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe4c071be0 0x7efe4c1d3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:33.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe53f24700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe4c0b8da0 0x7efe4c06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:33.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe53f24700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe4c0bacb0 0x7efe4c1e0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:33.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe53f24700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c1d3750 con 0x7efe4c0bacb0 2023-07-19T20:44:33.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe53f24700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c06e420 con 0x7efe4c0b8da0 2023-07-19T20:44:33.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe53f24700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0b73c0 con 0x7efe4c071be0 2023-07-19T20:44:33.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe524c1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe4c0bacb0 0x7efe4c1e0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe524c1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe4c0bacb0 0x7efe4c1e0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35750/0 (socket says 172.21.15.117:35750) 2023-07-19T20:44:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe524c1700 1 -- 172.21.15.117:0/3192767578 learned_addr learned my addr 172.21.15.117:0/3192767578 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe51cc0700 1 --2- 172.21.15.117:0/3192767578 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe4c071be0 0x7efe4c1d3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe514bf700 1 --2- 172.21.15.117:0/3192767578 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe4c0b8da0 0x7efe4c06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe524c1700 1 -- 172.21.15.117:0/3192767578 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe4c071be0 msgr2=0x7efe4c1d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe524c1700 1 --2- 172.21.15.117:0/3192767578 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe4c071be0 0x7efe4c1d3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe524c1700 1 -- 172.21.15.117:0/3192767578 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe4c0b8da0 msgr2=0x7efe4c06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:33.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe524c1700 1 --2- 172.21.15.117:0/3192767578 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe4c0b8da0 0x7efe4c06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe524c1700 1 -- 172.21.15.117:0/3192767578 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe44009b30 con 0x7efe4c0bacb0 2023-07-19T20:44:33.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.304+0000 7efe524c1700 1 --2- 172.21.15.117:0/3192767578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe4c0bacb0 0x7efe4c1e0840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efe4400efc0 tx=0x7efe44009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:33.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.305+0000 7efe427fc700 1 -- 172.21.15.117:0/3192767578 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe44018070 con 0x7efe4c0bacb0 2023-07-19T20:44:33.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.305+0000 7efe427fc700 1 -- 172.21.15.117:0/3192767578 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4400f040 con 0x7efe4c0bacb0 2023-07-19T20:44:33.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.305+0000 7efe53f24700 1 -- 172.21.15.117:0/3192767578 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c0094a0 con 0x7efe4c0bacb0 2023-07-19T20:44:33.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.305+0000 7efe427fc700 1 -- 172.21.15.117:0/3192767578 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe44003c40 con 0x7efe4c0bacb0 2023-07-19T20:44:33.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.305+0000 7efe53f24700 1 -- 172.21.15.117:0/3192767578 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4c0b78f0 con 0x7efe4c0bacb0 2023-07-19T20:44:33.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.306+0000 7efe53f24700 1 -- 172.21.15.117:0/3192767578 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4c067940 con 0x7efe4c0bacb0 2023-07-19T20:44:33.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.306+0000 7efe427fc700 1 -- 172.21.15.117:0/3192767578 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 4) v1 ==== 88145+0+0 (secure 0 0 0) 0x7efe4400c9e0 con 0x7efe4c0bacb0 2023-07-19T20:44:33.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.306+0000 7efe427fc700 1 --2- 172.21.15.117:0/3192767578 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7efe3006a5d0 0x7efe3006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:33.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.306+0000 7efe427fc700 1 -- 172.21.15.117:0/3192767578 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efe44088880 con 0x7efe4c0bacb0 2023-07-19T20:44:33.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.306+0000 7efe51cc0700 1 --2- 172.21.15.117:0/3192767578 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7efe3006a5d0 0x7efe3006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:33.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.307+0000 7efe51cc0700 1 --2- 172.21.15.117:0/3192767578 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7efe3006a5d0 0x7efe3006ca80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe48000f60 tx=0x7efe48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:33.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.311+0000 7efe427fc700 1 -- 172.21.15.117:0/3192767578 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7efe44054140 con 0x7efe4c0bacb0 2023-07-19T20:44:33.503 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.510+0000 7efe53f24700 1 -- 172.21.15.117:0/3192767578 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe4c0b4940 con 0x7efe4c0bacb0 2023-07-19T20:44:33.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.511+0000 7efe427fc700 1 -- 172.21.15.117:0/3192767578 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14281 (secure 0 0 0) 0x7efe44057760 con 0x7efe4c0bacb0 2023-07-19T20:44:33.505 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:33.505 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":17,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:33.112738+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:33.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.513+0000 7efe53f24700 1 -- 172.21.15.117:0/3192767578 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7efe3006a5d0 msgr2=0x7efe3006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:33.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.513+0000 7efe53f24700 1 --2- 172.21.15.117:0/3192767578 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7efe3006a5d0 0x7efe3006ca80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe48000f60 tx=0x7efe48009040 comp rx=0 tx=0).stop 2023-07-19T20:44:33.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.513+0000 7efe53f24700 1 -- 172.21.15.117:0/3192767578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe4c0bacb0 msgr2=0x7efe4c1e0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:33.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.513+0000 7efe53f24700 1 --2- 172.21.15.117:0/3192767578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe4c0bacb0 0x7efe4c1e0840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efe4400efc0 tx=0x7efe44009f90 comp rx=0 tx=0).stop 2023-07-19T20:44:33.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.513+0000 7efe53f24700 1 -- 172.21.15.117:0/3192767578 shutdown_connections 2023-07-19T20:44:33.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.513+0000 7efe53f24700 1 --2- 172.21.15.117:0/3192767578 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7efe3006a5d0 0x7efe3006ca80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.513+0000 7efe53f24700 1 --2- 172.21.15.117:0/3192767578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe4c0bacb0 0x7efe4c1e0840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.513+0000 7efe53f24700 1 --2- 172.21.15.117:0/3192767578 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe4c071be0 0x7efe4c1d3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.513+0000 7efe53f24700 1 --2- 172.21.15.117:0/3192767578 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe4c0b8da0 0x7efe4c06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.513+0000 7efe53f24700 1 -- 172.21.15.117:0/3192767578 >> 172.21.15.117:0/3192767578 conn(0x7efe4c0be4b0 msgr2=0x7efe4c0b9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:33.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.513+0000 7efe53f24700 1 -- 172.21.15.117:0/3192767578 shutdown_connections 2023-07-19T20:44:33.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.513+0000 7efe53f24700 1 -- 172.21.15.117:0/3192767578 wait complete. 2023-07-19T20:44:33.520 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-19T20:44:31.325778+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-19T20:44:31.728215+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-19T20:44:33.520 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-19T20:44:33.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.653+0000 7f67437f4700 1 Processor -- start 2023-07-19T20:44:33.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.654+0000 7f67437f4700 1 -- start start 2023-07-19T20:44:33.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.654+0000 7f67437f4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f673c06a560 0x7f673c0a0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:33.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.654+0000 7f67437f4700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f673c0a0eb0 0x7f673c0baa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:33.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.654+0000 7f67437f4700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673c0b8490 con 0x7f673c0a2b60 2023-07-19T20:44:33.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.654+0000 7f67437f4700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c0bcda0 con 0x7f673c0a0eb0 2023-07-19T20:44:33.650 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.654+0000 7f67437f4700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0b9ab0 con 0x7f673c06a560 2023-07-19T20:44:33.650 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.654+0000 7f6741590700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f673c06a560 0x7f673c0a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:33.650 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.654+0000 7f6741d91700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f673c0a0eb0 0x7f673c0baa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:33.650 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.654+0000 7f6740d8f700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f673c0a2b60 0x7f673c0ba2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.117:58660/0 (socket says 172.21.15.117:58660) 2023-07-19T20:44:33.650 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.654+0000 7f6741590700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f673c06a560 0x7f673c0a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:46596/0 (socket says 172.21.15.117:46596) 2023-07-19T20:44:33.650 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.654+0000 7f6740d8f700 1 -- 172.21.15.117:0/1130399162 learned_addr learned my addr 172.21.15.117:0/1130399162 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:33.650 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.655+0000 7f6741d91700 1 -- 172.21.15.117:0/1130399162 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f673c06a560 msgr2=0x7f673c0a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:33.651 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.655+0000 7f6741d91700 1 --2- 172.21.15.117:0/1130399162 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f673c06a560 0x7f673c0a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.651 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.655+0000 7f6741d91700 1 -- 172.21.15.117:0/1130399162 >> v1:172.21.15.124:6789/0 conn(0x7f673c0a2b60 legacy=0x7f673c0ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:33.651 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.655+0000 7f6741d91700 1 -- 172.21.15.117:0/1130399162 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673c0b9560 con 0x7f673c0a0eb0 2023-07-19T20:44:33.651 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.655+0000 7f6733fff700 1 -- 172.21.15.117:0/1130399162 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829760585 0 0) 0x7f673c0b8490 con 0x7f673c0a2b60 2023-07-19T20:44:33.652 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.655+0000 7f6741590700 1 --2- 172.21.15.117:0/1130399162 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f673c06a560 0x7f673c0a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:33.652 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.655+0000 7f6741d91700 1 --2- 172.21.15.117:0/1130399162 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f673c0a0eb0 0x7f673c0baa00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6734009d90 tx=0x7f673400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c7088962e92c17 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:33.652 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.655+0000 7f6733fff700 1 -- 172.21.15.117:0/1130399162 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400e070 con 0x7f673c0a0eb0 2023-07-19T20:44:33.652 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.655+0000 7f6733fff700 1 -- 172.21.15.117:0/1130399162 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673400bb20 con 0x7f673c0a0eb0 2023-07-19T20:44:33.652 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.655+0000 7f6733fff700 1 -- 172.21.15.117:0/1130399162 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6734012430 con 0x7f673c0a0eb0 2023-07-19T20:44:33.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.656+0000 7f67437f4700 1 -- 172.21.15.117:0/1130399162 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f673c0a0eb0 msgr2=0x7f673c0baa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:33.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.656+0000 7f67437f4700 1 --2- 172.21.15.117:0/1130399162 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f673c0a0eb0 0x7f673c0baa00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6734009d90 tx=0x7f673400b330 comp rx=0 tx=0).stop 2023-07-19T20:44:33.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.656+0000 7f67437f4700 1 -- 172.21.15.117:0/1130399162 shutdown_connections 2023-07-19T20:44:33.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.656+0000 7f67437f4700 1 --2- 172.21.15.117:0/1130399162 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f673c0a0eb0 0x7f673c0baa00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.656+0000 7f67437f4700 1 --2- 172.21.15.117:0/1130399162 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f673c06a560 0x7f673c0a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.656+0000 7f67437f4700 1 -- 172.21.15.117:0/1130399162 >> 172.21.15.117:0/1130399162 conn(0x7f673c09f570 msgr2=0x7f673c09f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:33.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.656+0000 7f67437f4700 1 -- 172.21.15.117:0/1130399162 shutdown_connections 2023-07-19T20:44:33.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.656+0000 7f67437f4700 1 -- 172.21.15.117:0/1130399162 wait complete. 2023-07-19T20:44:33.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.657+0000 7f67437f4700 1 Processor -- start 2023-07-19T20:44:33.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.657+0000 7f67437f4700 1 -- start start 2023-07-19T20:44:33.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.657+0000 7f67437f4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f673c06a560 0x7f673c1dfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:33.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.657+0000 7f67437f4700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f673c0a0eb0 0x7f673c1e3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:33.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.657+0000 7f67437f4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f673c0a2b60 0x7f673c1cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:33.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.657+0000 7f67437f4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c1cc850 con 0x7f673c06a560 2023-07-19T20:44:33.658 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.657+0000 7f67437f4700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0b7a40 con 0x7f673c0a0eb0 2023-07-19T20:44:33.658 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.657+0000 7f67437f4700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0bd4e0 con 0x7f673c0a2b60 2023-07-19T20:44:33.658 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.657+0000 7f6741590700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f673c06a560 0x7f673c1dfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:33.658 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f6741590700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f673c06a560 0x7f673c1dfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35762/0 (socket says 172.21.15.117:35762) 2023-07-19T20:44:33.658 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f6741590700 1 -- 172.21.15.117:0/3975704189 learned_addr learned my addr 172.21.15.117:0/3975704189 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:33.658 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f6740d8f700 1 --2- 172.21.15.117:0/3975704189 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f673c0a0eb0 0x7f673c1e3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:33.658 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f6741d91700 1 --2- 172.21.15.117:0/3975704189 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f673c0a2b60 0x7f673c1cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:33.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f6741590700 1 -- 172.21.15.117:0/3975704189 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f673c0a2b60 msgr2=0x7f673c1cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:33.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f6741590700 1 --2- 172.21.15.117:0/3975704189 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f673c0a2b60 0x7f673c1cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f6741590700 1 -- 172.21.15.117:0/3975704189 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f673c0a0eb0 msgr2=0x7f673c1e3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:33.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f6741590700 1 --2- 172.21.15.117:0/3975704189 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f673c0a0eb0 0x7f673c1e3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f6741590700 1 -- 172.21.15.117:0/3975704189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c0094a0 con 0x7f673c06a560 2023-07-19T20:44:33.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f6741590700 1 --2- 172.21.15.117:0/3975704189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f673c06a560 0x7f673c1dfbf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f672c00ec10 tx=0x7f672c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:33.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f6731ffb700 1 -- 172.21.15.117:0/3975704189 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c009760 con 0x7f673c06a560 2023-07-19T20:44:33.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f6731ffb700 1 -- 172.21.15.117:0/3975704189 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c00c850 con 0x7f673c06a560 2023-07-19T20:44:33.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f67437f4700 1 -- 172.21.15.117:0/3975704189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6734009a70 con 0x7f673c06a560 2023-07-19T20:44:33.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f6731ffb700 1 -- 172.21.15.117:0/3975704189 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c00cbe0 con 0x7f673c06a560 2023-07-19T20:44:33.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.658+0000 7f67437f4700 1 -- 172.21.15.117:0/3975704189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673c1d2ef0 con 0x7f673c06a560 2023-07-19T20:44:33.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.659+0000 7f67437f4700 1 -- 172.21.15.117:0/3975704189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673c0bd620 con 0x7f673c06a560 2023-07-19T20:44:33.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.660+0000 7f6731ffb700 1 -- 172.21.15.117:0/3975704189 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 4) v1 ==== 88145+0+0 (secure 0 0 0) 0x7f672c00cd40 con 0x7f673c06a560 2023-07-19T20:44:33.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.660+0000 7f6731ffb700 1 --2- 172.21.15.117:0/3975704189 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f672006a600 0x7f672006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:33.661 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.660+0000 7f6731ffb700 1 -- 172.21.15.117:0/3975704189 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f672c0884e0 con 0x7f673c06a560 2023-07-19T20:44:33.661 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.660+0000 7f6740d8f700 1 --2- 172.21.15.117:0/3975704189 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f672006a600 0x7f672006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:33.661 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.660+0000 7f6740d8f700 1 --2- 172.21.15.117:0/3975704189 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f672006a600 0x7f672006cab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f673c1e0d00 tx=0x7f6738007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:33.661 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.664+0000 7f6731ffb700 1 -- 172.21.15.117:0/3975704189 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f672c053da0 con 0x7f673c06a560 2023-07-19T20:44:33.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.853+0000 7f67437f4700 1 -- 172.21.15.117:0/3975704189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f673c067940 con 0x7f673c06a560 2023-07-19T20:44:33.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.853+0000 7f6731ffb700 1 -- 172.21.15.117:0/3975704189 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f672c0573c0 con 0x7f673c06a560 2023-07-19T20:44:33.850 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 8 2023-07-19T20:44:33.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.855+0000 7f67437f4700 1 -- 172.21.15.117:0/3975704189 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f672006a600 msgr2=0x7f672006cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:33.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.855+0000 7f67437f4700 1 --2- 172.21.15.117:0/3975704189 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f672006a600 0x7f672006cab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f673c1e0d00 tx=0x7f6738007de0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.855+0000 7f67437f4700 1 -- 172.21.15.117:0/3975704189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f673c06a560 msgr2=0x7f673c1dfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:33.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.855+0000 7f67437f4700 1 --2- 172.21.15.117:0/3975704189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f673c06a560 0x7f673c1dfbf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f672c00ec10 tx=0x7f672c00ef20 comp rx=0 tx=0).stop 2023-07-19T20:44:33.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.855+0000 7f67437f4700 1 -- 172.21.15.117:0/3975704189 shutdown_connections 2023-07-19T20:44:33.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.855+0000 7f67437f4700 1 --2- 172.21.15.117:0/3975704189 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f672006a600 0x7f672006cab0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.855+0000 7f67437f4700 1 --2- 172.21.15.117:0/3975704189 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f673c0a2b60 0x7f673c1cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.855+0000 7f67437f4700 1 --2- 172.21.15.117:0/3975704189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f673c06a560 0x7f673c1dfbf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.855+0000 7f67437f4700 1 --2- 172.21.15.117:0/3975704189 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f673c0a0eb0 0x7f673c1e3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:33.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.855+0000 7f67437f4700 1 -- 172.21.15.117:0/3975704189 >> 172.21.15.117:0/3975704189 conn(0x7f673c09f570 msgr2=0x7f673c1d50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:33.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.855+0000 7f67437f4700 1 -- 172.21.15.117:0/3975704189 shutdown_connections 2023-07-19T20:44:33.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.855+0000 7f67437f4700 1 -- 172.21.15.117:0/3975704189 wait complete. 2023-07-19T20:44:33.863 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-19T20:44:33.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.997+0000 7f3059e7c700 1 Processor -- start 2023-07-19T20:44:33.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.997+0000 7f3059e7c700 1 -- start start 2023-07-19T20:44:33.997 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.997+0000 7f3059e7c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f30540ba7f0 0x7f305414a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:33.998 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.997+0000 7f3059e7c700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f30540b8d80 0x7f30541550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:33.998 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.997+0000 7f3059e7c700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30540b9210 con 0x7f305414e930 2023-07-19T20:44:33.999 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.997+0000 7f3059e7c700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30540b44f0 con 0x7f30540ba7f0 2023-07-19T20:44:34.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.997+0000 7f3059e7c700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305414e4a0 con 0x7f30540b8d80 2023-07-19T20:44:34.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.998+0000 7f3053fff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f30540b8d80 0x7f30541550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.998+0000 7f3053fff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f30540b8d80 0x7f30541550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:46620/0 (socket says 172.21.15.117:46620) 2023-07-19T20:44:34.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.998+0000 7f3053fff700 1 -- 172.21.15.117:0/804846138 learned_addr learned my addr 172.21.15.117:0/804846138 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:34.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.998+0000 7f30537fe700 1 --2- 172.21.15.117:0/804846138 >> v2:172.21.15.124:3300/0 conn(0x7f30540ba7f0 0x7f305414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.998+0000 7f3053fff700 1 -- 172.21.15.117:0/804846138 >> v2:172.21.15.124:3300/0 conn(0x7f30540ba7f0 msgr2=0x7f305414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:34.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.998+0000 7f3053fff700 1 --2- 172.21.15.117:0/804846138 >> v2:172.21.15.124:3300/0 conn(0x7f30540ba7f0 0x7f305414a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.998+0000 7f3053fff700 1 -- 172.21.15.117:0/804846138 >> v1:172.21.15.124:6789/0 conn(0x7f305414e930 legacy=0x7f30540b8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:34.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.998+0000 7f3053fff700 1 -- 172.21.15.117:0/804846138 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3054144e60 con 0x7f30540b8d80 2023-07-19T20:44:34.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.998+0000 7f3053fff700 1 --2- 172.21.15.117:0/804846138 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f30540b8d80 0x7f30541550b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f304c009e50 tx=0x7f304c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d3414d597b9f4a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:34.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.998+0000 7f30527fc700 1 -- 172.21.15.117:0/804846138 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00e070 con 0x7f30540b8d80 2023-07-19T20:44:34.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.998+0000 7f30527fc700 1 -- 172.21.15.117:0/804846138 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c003a20 con 0x7f30540b8d80 2023-07-19T20:44:34.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.998+0000 7f30527fc700 1 -- 172.21.15.117:0/804846138 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c003dd0 con 0x7f30540b8d80 2023-07-19T20:44:34.003 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.999+0000 7f3059e7c700 1 -- 172.21.15.117:0/804846138 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f30540b8d80 msgr2=0x7f30541550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.003 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.999+0000 7f3059e7c700 1 --2- 172.21.15.117:0/804846138 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f30540b8d80 0x7f30541550b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f304c009e50 tx=0x7f304c00b330 comp rx=0 tx=0).stop 2023-07-19T20:44:34.003 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.999+0000 7f3059e7c700 1 -- 172.21.15.117:0/804846138 shutdown_connections 2023-07-19T20:44:34.003 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.999+0000 7f3059e7c700 1 --2- 172.21.15.117:0/804846138 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f30540b8d80 0x7f30541550b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.004 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.999+0000 7f3059e7c700 1 --2- 172.21.15.117:0/804846138 >> v2:172.21.15.124:3300/0 conn(0x7f30540ba7f0 0x7f305414a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.004 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.999+0000 7f3059e7c700 1 -- 172.21.15.117:0/804846138 >> 172.21.15.117:0/804846138 conn(0x7f3054071c90 msgr2=0x7f3054072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:34.004 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.999+0000 7f3059e7c700 1 -- 172.21.15.117:0/804846138 shutdown_connections 2023-07-19T20:44:34.005 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:33.999+0000 7f3059e7c700 1 -- 172.21.15.117:0/804846138 wait complete. 2023-07-19T20:44:34.005 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.000+0000 7f3059e7c700 1 Processor -- start 2023-07-19T20:44:34.005 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.000+0000 7f3059e7c700 1 -- start start 2023-07-19T20:44:34.005 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3059e7c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f30540b8d80 0x7f3054144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3059e7c700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f30540ba7f0 0x7f30541e3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3059e7c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305414e930 0x7f30540a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3059e7c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3054146ae0 con 0x7f305414e930 2023-07-19T20:44:34.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3059e7c700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3054148220 con 0x7f30540b8d80 2023-07-19T20:44:34.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3059e7c700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3054147740 con 0x7f30540ba7f0 2023-07-19T20:44:34.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3053fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305414e930 0x7f30540a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f30537fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f30540b8d80 0x7f3054144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3052ffd700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f30540ba7f0 0x7f30541e3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3053fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305414e930 0x7f30540a6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35788/0 (socket says 172.21.15.117:35788) 2023-07-19T20:44:34.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f30537fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f30540b8d80 0x7f3054144530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:55626/0 (socket says 172.21.15.117:55626) 2023-07-19T20:44:34.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3053fff700 1 -- 172.21.15.117:0/4052916351 learned_addr learned my addr 172.21.15.117:0/4052916351 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:34.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3053fff700 1 -- 172.21.15.117:0/4052916351 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f30540ba7f0 msgr2=0x7f30541e3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3053fff700 1 --2- 172.21.15.117:0/4052916351 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f30540ba7f0 0x7f30541e3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3053fff700 1 -- 172.21.15.117:0/4052916351 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f30540b8d80 msgr2=0x7f3054144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3053fff700 1 --2- 172.21.15.117:0/4052916351 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f30540b8d80 0x7f3054144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3053fff700 1 -- 172.21.15.117:0/4052916351 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c009b30 con 0x7f305414e930 2023-07-19T20:44:34.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3052ffd700 1 --2- 172.21.15.117:0/4052916351 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f30540ba7f0 0x7f30541e3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:34.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.001+0000 7f3053fff700 1 --2- 172.21.15.117:0/4052916351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305414e930 0x7f30540a6300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f304c015040 tx=0x7f304c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:34.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.002+0000 7f303bfff700 1 -- 172.21.15.117:0/4052916351 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c004440 con 0x7f305414e930 2023-07-19T20:44:34.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.002+0000 7f303bfff700 1 -- 172.21.15.117:0/4052916351 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c0045c0 con 0x7f305414e930 2023-07-19T20:44:34.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.002+0000 7f3059e7c700 1 -- 172.21.15.117:0/4052916351 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3054147a20 con 0x7f305414e930 2023-07-19T20:44:34.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.002+0000 7f303bfff700 1 -- 172.21.15.117:0/4052916351 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c004970 con 0x7f305414e930 2023-07-19T20:44:34.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.002+0000 7f3059e7c700 1 -- 172.21.15.117:0/4052916351 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30541417c0 con 0x7f305414e930 2023-07-19T20:44:34.012 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.002+0000 7f3059e7c700 1 -- 172.21.15.117:0/4052916351 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3054148070 con 0x7f305414e930 2023-07-19T20:44:34.012 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.003+0000 7f303bfff700 1 -- 172.21.15.117:0/4052916351 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 4) v1 ==== 88145+0+0 (secure 0 0 0) 0x7f304c025450 con 0x7f305414e930 2023-07-19T20:44:34.012 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.004+0000 7f303bfff700 1 --2- 172.21.15.117:0/4052916351 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f304006a5d0 0x7f304006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.012 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.004+0000 7f303bfff700 1 -- 172.21.15.117:0/4052916351 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f304c08a190 con 0x7f305414e930 2023-07-19T20:44:34.012 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.004+0000 7f30537fe700 1 --2- 172.21.15.117:0/4052916351 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f304006a5d0 0x7f304006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.012 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.004+0000 7f30537fe700 1 --2- 172.21.15.117:0/4052916351 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f304006a5d0 0x7f304006ca80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3044006b20 tx=0x7f3044008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:34.013 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.008+0000 7f303bfff700 1 -- 172.21.15.117:0/4052916351 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f304c055b30 con 0x7f305414e930 2023-07-19T20:44:34.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.197+0000 7f3059e7c700 1 -- 172.21.15.117:0/4052916351 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30540ba0c0 con 0x7f305414e930 2023-07-19T20:44:34.191 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.197+0000 7f303bfff700 1 -- 172.21.15.117:0/4052916351 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f304c059150 con 0x7f305414e930 2023-07-19T20:44:34.191 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2023-07-19T20:44:34.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.199+0000 7f3059e7c700 1 -- 172.21.15.117:0/4052916351 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f304006a5d0 msgr2=0x7f304006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.199+0000 7f3059e7c700 1 --2- 172.21.15.117:0/4052916351 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f304006a5d0 0x7f304006ca80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3044006b20 tx=0x7f3044008040 comp rx=0 tx=0).stop 2023-07-19T20:44:34.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.199+0000 7f3059e7c700 1 -- 172.21.15.117:0/4052916351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305414e930 msgr2=0x7f30540a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.199+0000 7f3059e7c700 1 --2- 172.21.15.117:0/4052916351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305414e930 0x7f30540a6300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f304c015040 tx=0x7f304c004ad0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.199+0000 7f3059e7c700 1 -- 172.21.15.117:0/4052916351 shutdown_connections 2023-07-19T20:44:34.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.199+0000 7f3059e7c700 1 --2- 172.21.15.117:0/4052916351 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f304006a5d0 0x7f304006ca80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.199+0000 7f3059e7c700 1 --2- 172.21.15.117:0/4052916351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305414e930 0x7f30540a6300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.199+0000 7f3059e7c700 1 --2- 172.21.15.117:0/4052916351 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f30540b8d80 0x7f3054144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.199+0000 7f3059e7c700 1 --2- 172.21.15.117:0/4052916351 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f30540ba7f0 0x7f30541e3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.199+0000 7f3059e7c700 1 -- 172.21.15.117:0/4052916351 >> 172.21.15.117:0/4052916351 conn(0x7f3054071c90 msgr2=0x7f3054149500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:34.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.199+0000 7f3059e7c700 1 -- 172.21.15.117:0/4052916351 shutdown_connections 2023-07-19T20:44:34.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.199+0000 7f3059e7c700 1 -- 172.21.15.117:0/4052916351 wait complete. 2023-07-19T20:44:34.205 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-19T20:44:34.336 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.334+0000 7f107337f700 1 Processor -- start 2023-07-19T20:44:34.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.334+0000 7f107337f700 1 -- start start 2023-07-19T20:44:34.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107337f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f106c0bacb0 0x7f106c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107337f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f106c071be0 0x7f106c1446a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107337f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f106c144be0 0x7f106c0b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107337f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106c0715e0 con 0x7f106c071be0 2023-07-19T20:44:34.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107337f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106c0729d0 con 0x7f106c0bacb0 2023-07-19T20:44:34.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107337f700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0717c0 con 0x7f106c144be0 2023-07-19T20:44:34.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107091a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f106c071be0 0x7f106c1446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107091a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f106c071be0 0x7f106c1446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35802/0 (socket says 172.21.15.117:35802) 2023-07-19T20:44:34.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107091a700 1 -- 172.21.15.117:0/3769344595 learned_addr learned my addr 172.21.15.117:0/3769344595 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:34.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107111b700 1 --2- 172.21.15.117:0/3769344595 >> v2:172.21.15.124:3300/0 conn(0x7f106c0bacb0 0x7f106c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107191c700 1 --2- 172.21.15.117:0/3769344595 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f106c144be0 0x7f106c0b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107091a700 1 -- 172.21.15.117:0/3769344595 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f106c144be0 msgr2=0x7f106c0b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:34.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107091a700 1 --2- 172.21.15.117:0/3769344595 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f106c144be0 0x7f106c0b8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107091a700 1 -- 172.21.15.117:0/3769344595 >> v2:172.21.15.124:3300/0 conn(0x7f106c0bacb0 msgr2=0x7f106c0702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:34.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107091a700 1 --2- 172.21.15.117:0/3769344595 >> v2:172.21.15.124:3300/0 conn(0x7f106c0bacb0 0x7f106c0702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107091a700 1 -- 172.21.15.117:0/3769344595 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c072130 con 0x7f106c071be0 2023-07-19T20:44:34.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107191c700 1 --2- 172.21.15.117:0/3769344595 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f106c144be0 0x7f106c0b8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:34.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f107091a700 1 --2- 172.21.15.117:0/3769344595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f106c071be0 0x7f106c1446a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f106c072d40 tx=0x7f1068009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf342a3596d9c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:34.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f1063fff700 1 -- 172.21.15.117:0/3769344595 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068011830 con 0x7f106c071be0 2023-07-19T20:44:34.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f1063fff700 1 -- 172.21.15.117:0/3769344595 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1068011990 con 0x7f106c071be0 2023-07-19T20:44:34.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.335+0000 7f1063fff700 1 -- 172.21.15.117:0/3769344595 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068011d20 con 0x7f106c071be0 2023-07-19T20:44:34.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.336+0000 7f107337f700 1 -- 172.21.15.117:0/3769344595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f106c071be0 msgr2=0x7f106c1446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.336+0000 7f107337f700 1 --2- 172.21.15.117:0/3769344595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f106c071be0 0x7f106c1446a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f106c072d40 tx=0x7f1068009bd0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.336+0000 7f107337f700 1 -- 172.21.15.117:0/3769344595 shutdown_connections 2023-07-19T20:44:34.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.336+0000 7f107337f700 1 --2- 172.21.15.117:0/3769344595 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f106c144be0 0x7f106c0b8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.336+0000 7f107337f700 1 --2- 172.21.15.117:0/3769344595 >> v2:172.21.15.124:3300/0 conn(0x7f106c0bacb0 0x7f106c0702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.336+0000 7f107337f700 1 --2- 172.21.15.117:0/3769344595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f106c071be0 0x7f106c1446a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.336+0000 7f107337f700 1 -- 172.21.15.117:0/3769344595 >> 172.21.15.117:0/3769344595 conn(0x7f106c0be4b0 msgr2=0x7f106c0ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:34.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.336+0000 7f107337f700 1 -- 172.21.15.117:0/3769344595 shutdown_connections 2023-07-19T20:44:34.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.336+0000 7f107337f700 1 -- 172.21.15.117:0/3769344595 wait complete. 2023-07-19T20:44:34.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.337+0000 7f107337f700 1 Processor -- start 2023-07-19T20:44:34.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.337+0000 7f107337f700 1 -- start start 2023-07-19T20:44:34.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107337f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f106c071be0 0x7f106c13bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107337f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f106c0bacb0 0x7f106c147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107337f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106c144be0 0x7f106c1481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107337f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c13b9b0 con 0x7f106c071be0 2023-07-19T20:44:34.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107337f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c14a760 con 0x7f106c144be0 2023-07-19T20:44:34.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107337f700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c13bc00 con 0x7f106c0bacb0 2023-07-19T20:44:34.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107111b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f106c071be0 0x7f106c13bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107111b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f106c071be0 0x7f106c13bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35812/0 (socket says 172.21.15.117:35812) 2023-07-19T20:44:34.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107111b700 1 -- 172.21.15.117:0/1937601633 learned_addr learned my addr 172.21.15.117:0/1937601633 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:34.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107091a700 1 --2- 172.21.15.117:0/1937601633 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f106c0bacb0 0x7f106c147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107191c700 1 --2- 172.21.15.117:0/1937601633 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106c144be0 0x7f106c1481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107111b700 1 -- 172.21.15.117:0/1937601633 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f106c0bacb0 msgr2=0x7f106c147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107111b700 1 --2- 172.21.15.117:0/1937601633 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f106c0bacb0 0x7f106c147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107111b700 1 -- 172.21.15.117:0/1937601633 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106c144be0 msgr2=0x7f106c1481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107111b700 1 --2- 172.21.15.117:0/1937601633 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106c144be0 0x7f106c1481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107111b700 1 -- 172.21.15.117:0/1937601633 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1068009550 con 0x7f106c071be0 2023-07-19T20:44:34.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f107111b700 1 --2- 172.21.15.117:0/1937601633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f106c071be0 0x7f106c13bf90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f105c00e9e0 tx=0x7f105c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:34.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.338+0000 7f1061ffb700 1 -- 172.21.15.117:0/1937601633 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c009710 con 0x7f106c071be0 2023-07-19T20:44:34.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.339+0000 7f1061ffb700 1 -- 172.21.15.117:0/1937601633 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c00ee80 con 0x7f106c071be0 2023-07-19T20:44:34.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.339+0000 7f107337f700 1 -- 172.21.15.117:0/1937601633 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c14a9b0 con 0x7f106c071be0 2023-07-19T20:44:34.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.339+0000 7f1061ffb700 1 -- 172.21.15.117:0/1937601633 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c00ca50 con 0x7f106c071be0 2023-07-19T20:44:34.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.339+0000 7f107337f700 1 -- 172.21.15.117:0/1937601633 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106c141bf0 con 0x7f106c071be0 2023-07-19T20:44:34.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.340+0000 7f107337f700 1 -- 172.21.15.117:0/1937601633 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106c067940 con 0x7f106c071be0 2023-07-19T20:44:34.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.340+0000 7f1061ffb700 1 -- 172.21.15.117:0/1937601633 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 4) v1 ==== 88145+0+0 (secure 0 0 0) 0x7f105c00cbb0 con 0x7f106c071be0 2023-07-19T20:44:34.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.340+0000 7f1061ffb700 1 --2- 172.21.15.117:0/1937601633 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f105006a5d0 0x7f105006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.341+0000 7f1061ffb700 1 -- 172.21.15.117:0/1937601633 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f105c088640 con 0x7f106c071be0 2023-07-19T20:44:34.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.341+0000 7f107091a700 1 --2- 172.21.15.117:0/1937601633 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f105006a5d0 0x7f105006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.341+0000 7f107091a700 1 --2- 172.21.15.117:0/1937601633 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f105006a5d0 0x7f105006ca80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f106c072d40 tx=0x7f1068008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:34.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.345+0000 7f1061ffb700 1 -- 172.21.15.117:0/1937601633 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f105c053e60 con 0x7f106c071be0 2023-07-19T20:44:34.567 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.574+0000 7f107337f700 1 -- 172.21.15.117:0/1937601633 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f106c0b9d00 con 0x7f106c071be0 2023-07-19T20:44:34.573 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.574+0000 7f1061ffb700 1 -- 172.21.15.117:0/1937601633 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2774 (secure 0 0 0) 0x7f105c017af0 con 0x7f106c071be0 2023-07-19T20:44:34.573 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:34.574 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6833/1121968339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":1121968339},{"type":"v1","addr":"172.21.15.124:6833","nonce":1121968339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3740070710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3740070710},{"type":"v1","addr":"172.21.15.117:6835","nonce":3740070710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/479216080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":479216080},{"type":"v1","addr":"172.21.15.117:6837","nonce":479216080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-19T20:44:34.574 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.576+0000 7f107337f700 1 -- 172.21.15.117:0/1937601633 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f105006a5d0 msgr2=0x7f105006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.576+0000 7f107337f700 1 --2- 172.21.15.117:0/1937601633 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f105006a5d0 0x7f105006ca80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f106c072d40 tx=0x7f1068008030 comp rx=0 tx=0).stop 2023-07-19T20:44:34.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.577+0000 7f107337f700 1 -- 172.21.15.117:0/1937601633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f106c071be0 msgr2=0x7f106c13bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.577+0000 7f107337f700 1 --2- 172.21.15.117:0/1937601633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f106c071be0 0x7f106c13bf90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f105c00e9e0 tx=0x7f105c00ecf0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.577+0000 7f107337f700 1 -- 172.21.15.117:0/1937601633 shutdown_connections 2023-07-19T20:44:34.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.577+0000 7f107337f700 1 --2- 172.21.15.117:0/1937601633 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f105006a5d0 0x7f105006ca80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.577+0000 7f107337f700 1 --2- 172.21.15.117:0/1937601633 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106c144be0 0x7f106c1481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.576 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.577+0000 7f107337f700 1 --2- 172.21.15.117:0/1937601633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f106c071be0 0x7f106c13bf90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.576 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.577+0000 7f107337f700 1 --2- 172.21.15.117:0/1937601633 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f106c0bacb0 0x7f106c147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.576 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.577+0000 7f107337f700 1 -- 172.21.15.117:0/1937601633 >> 172.21.15.117:0/1937601633 conn(0x7f106c0be4b0 msgr2=0x7f106c0b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:34.576 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.577+0000 7f107337f700 1 -- 172.21.15.117:0/1937601633 shutdown_connections 2023-07-19T20:44:34.576 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.577+0000 7f107337f700 1 -- 172.21.15.117:0/1937601633 wait complete. 2023-07-19T20:44:34.576 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 3 2023-07-19T20:44:34.582 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:34.706 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.713+0000 7f83d1ec9700 1 Processor -- start 2023-07-19T20:44:34.707 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.713+0000 7f83d1ec9700 1 -- start start 2023-07-19T20:44:34.708 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.714+0000 7f83d1ec9700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f83cc0bb430 0x7f83cc0b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.708 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.714+0000 7f83d1ec9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f83cc0bb890 0x7f83cc0b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.708 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.714+0000 7f83d1ec9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83cc0ba580 con 0x7f83cc148280 2023-07-19T20:44:34.708 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.714+0000 7f83d1ec9700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83cc148650 con 0x7f83cc0bb430 2023-07-19T20:44:34.708 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.714+0000 7f83d1ec9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc0b95f0 con 0x7f83cc0bb890 2023-07-19T20:44:34.709 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.714+0000 7f83cb7fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f83cc148280 0x7f83cc0bd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:53140/0 (socket says 172.21.15.117:53140) 2023-07-19T20:44:34.709 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.714+0000 7f83cb7fe700 1 -- 172.21.15.117:0/1476880105 learned_addr learned my addr 172.21.15.117:0/1476880105 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:34.709 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.714+0000 7f83caffd700 1 --2- 172.21.15.117:0/1476880105 >> v2:172.21.15.124:3300/0 conn(0x7f83cc0bb430 0x7f83cc0b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.709 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.714+0000 7f83cbfff700 1 --2- 172.21.15.117:0/1476880105 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f83cc0bb890 0x7f83cc0b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.709 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.714+0000 7f83caffd700 1 -- 172.21.15.117:0/1476880105 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f83cc0bb890 msgr2=0x7f83cc0b9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:34.709 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.714+0000 7f83caffd700 1 --2- 172.21.15.117:0/1476880105 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f83cc0bb890 0x7f83cc0b9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.709 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.714+0000 7f83caffd700 1 -- 172.21.15.117:0/1476880105 >> v1:172.21.15.117:6789/0 conn(0x7f83cc148280 legacy=0x7f83cc0bd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.709 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.714+0000 7f83caffd700 1 -- 172.21.15.117:0/1476880105 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc0bdad0 con 0x7f83cc0bb430 2023-07-19T20:44:34.710 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.714+0000 7f83caffd700 1 --2- 172.21.15.117:0/1476880105 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc0bb430 0x7f83cc0b9a10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009840 tx=0x7f83c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a7d2a8435193ac server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:34.711 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.716+0000 7f83ca7fc700 1 -- 172.21.15.117:0/1476880105 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0011830 con 0x7f83cc0bb430 2023-07-19T20:44:34.711 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.716+0000 7f83ca7fc700 1 -- 172.21.15.117:0/1476880105 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c0011990 con 0x7f83cc0bb430 2023-07-19T20:44:34.711 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.716+0000 7f83ca7fc700 1 -- 172.21.15.117:0/1476880105 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0011d20 con 0x7f83cc0bb430 2023-07-19T20:44:34.711 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.716+0000 7f83d1ec9700 1 -- 172.21.15.117:0/1476880105 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc0bb430 msgr2=0x7f83cc0b9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.711 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.716+0000 7f83d1ec9700 1 --2- 172.21.15.117:0/1476880105 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc0bb430 0x7f83cc0b9a10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009840 tx=0x7f83c0009b50 comp rx=0 tx=0).stop 2023-07-19T20:44:34.711 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.716+0000 7f83d1ec9700 1 -- 172.21.15.117:0/1476880105 shutdown_connections 2023-07-19T20:44:34.712 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.716+0000 7f83d1ec9700 1 --2- 172.21.15.117:0/1476880105 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f83cc0bb890 0x7f83cc0b9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.712 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.716+0000 7f83d1ec9700 1 --2- 172.21.15.117:0/1476880105 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc0bb430 0x7f83cc0b9a10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.712 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.716+0000 7f83d1ec9700 1 -- 172.21.15.117:0/1476880105 >> 172.21.15.117:0/1476880105 conn(0x7f83cc0a0660 msgr2=0x7f83cc0a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:34.712 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.716+0000 7f83d1ec9700 1 -- 172.21.15.117:0/1476880105 shutdown_connections 2023-07-19T20:44:34.712 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.716+0000 7f83d1ec9700 1 -- 172.21.15.117:0/1476880105 wait complete. 2023-07-19T20:44:34.712 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.717+0000 7f83d1ec9700 1 Processor -- start 2023-07-19T20:44:34.712 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.718+0000 7f83d1ec9700 1 -- start start 2023-07-19T20:44:34.714 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.718+0000 7f83d1ec9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc0bb430 0x7f83cc145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.714 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.718+0000 7f83d1ec9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f83cc0bb890 0x7f83cc147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.718+0000 7f83d1ec9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc148280 0x7f83cc1d67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.718+0000 7f83d1ec9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc0b8bd0 con 0x7f83cc0bb430 2023-07-19T20:44:34.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.718+0000 7f83d1ec9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc1d6320 con 0x7f83cc148280 2023-07-19T20:44:34.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.718+0000 7f83d1ec9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc1464d0 con 0x7f83cc0bb890 2023-07-19T20:44:34.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.718+0000 7f83cb7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc0bb430 0x7f83cc145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.718+0000 7f83cb7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc0bb430 0x7f83cc145f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35820/0 (socket says 172.21.15.117:35820) 2023-07-19T20:44:34.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.718+0000 7f83cb7fe700 1 -- 172.21.15.117:0/2299415671 learned_addr learned my addr 172.21.15.117:0/2299415671 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:34.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.718+0000 7f83caffd700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f83cc0bb890 0x7f83cc147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.718+0000 7f83cbfff700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc148280 0x7f83cc1d67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.719+0000 7f83cb7fe700 1 -- 172.21.15.117:0/2299415671 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f83cc0bb890 msgr2=0x7f83cc147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.719+0000 7f83cb7fe700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f83cc0bb890 0x7f83cc147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.719+0000 7f83cb7fe700 1 -- 172.21.15.117:0/2299415671 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc148280 msgr2=0x7f83cc1d67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.719+0000 7f83cb7fe700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc148280 0x7f83cc1d67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.719+0000 7f83cb7fe700 1 -- 172.21.15.117:0/2299415671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c00094a0 con 0x7f83cc0bb430 2023-07-19T20:44:34.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.719+0000 7f83cbfff700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc148280 0x7f83cc1d67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:34.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.719+0000 7f83cb7fe700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc0bb430 0x7f83cc145f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c4e0 tx=0x7f83bc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:34.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.719+0000 7f83b3fff700 1 -- 172.21.15.117:0/2299415671 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc005d70 con 0x7f83cc0bb430 2023-07-19T20:44:34.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.719+0000 7f83b3fff700 1 -- 172.21.15.117:0/2299415671 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc0070d0 con 0x7f83cc0bb430 2023-07-19T20:44:34.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.719+0000 7f83d1ec9700 1 -- 172.21.15.117:0/2299415671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83cc06d850 con 0x7f83cc0bb430 2023-07-19T20:44:34.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.719+0000 7f83b3fff700 1 -- 172.21.15.117:0/2299415671 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc007440 con 0x7f83cc0bb430 2023-07-19T20:44:34.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.719+0000 7f83d1ec9700 1 -- 172.21.15.117:0/2299415671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83cc147790 con 0x7f83cc0bb430 2023-07-19T20:44:34.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.720+0000 7f83d1ec9700 1 -- 172.21.15.117:0/2299415671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83cc0b9330 con 0x7f83cc0bb430 2023-07-19T20:44:34.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.720+0000 7f83b3fff700 1 -- 172.21.15.117:0/2299415671 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f83bc0075a0 con 0x7f83cc0bb430 2023-07-19T20:44:34.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.721+0000 7f83b3fff700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f83b806a660 0x7f83b806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:34.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.721+0000 7f83caffd700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f83b806a660 0x7f83b806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:34.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.721+0000 7f83b3fff700 1 -- 172.21.15.117:0/2299415671 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f83bc087960 con 0x7f83cc0bb430 2023-07-19T20:44:34.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.721+0000 7f83caffd700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f83b806a660 0x7f83b806cb10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f83c0000c00 tx=0x7f83c0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:34.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.725+0000 7f83b3fff700 1 -- 172.21.15.117:0/2299415671 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f83bc04c2c0 con 0x7f83cc0bb430 2023-07-19T20:44:34.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.914+0000 7f83d1ec9700 1 -- 172.21.15.117:0/2299415671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83cc0bc300 con 0x7f83cc0bb430 2023-07-19T20:44:34.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.915+0000 7f83b3fff700 1 -- 172.21.15.117:0/2299415671 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14255 (secure 0 0 0) 0x7f83bc017090 con 0x7f83cc0bb430 2023-07-19T20:44:34.912 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":18,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:34.117518+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:34.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.917+0000 7f83d1ec9700 1 -- 172.21.15.117:0/2299415671 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f83b806a660 msgr2=0x7f83b806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.917+0000 7f83d1ec9700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f83b806a660 0x7f83b806cb10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f83c0000c00 tx=0x7f83c0008030 comp rx=0 tx=0).stop 2023-07-19T20:44:34.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.917+0000 7f83d1ec9700 1 -- 172.21.15.117:0/2299415671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc0bb430 msgr2=0x7f83cc145f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:34.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.917+0000 7f83d1ec9700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc0bb430 0x7f83cc145f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c4e0 tx=0x7f83bc00c7f0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.917+0000 7f83d1ec9700 1 -- 172.21.15.117:0/2299415671 shutdown_connections 2023-07-19T20:44:34.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.917+0000 7f83d1ec9700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f83b806a660 0x7f83b806cb10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.917+0000 7f83d1ec9700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc148280 0x7f83cc1d67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.917+0000 7f83d1ec9700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc0bb430 0x7f83cc145f90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.917+0000 7f83d1ec9700 1 --2- 172.21.15.117:0/2299415671 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f83cc0bb890 0x7f83cc147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:34.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.917+0000 7f83d1ec9700 1 -- 172.21.15.117:0/2299415671 >> 172.21.15.117:0/2299415671 conn(0x7f83cc0a0660 msgr2=0x7f83cc0a3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:34.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.917+0000 7f83d1ec9700 1 -- 172.21.15.117:0/2299415671 shutdown_connections 2023-07-19T20:44:34.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:34.917+0000 7f83d1ec9700 1 -- 172.21.15.117:0/2299415671 wait complete. 2023-07-19T20:44:34.923 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-19T20:44:31.325778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-19T20:44:31.728215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-19T20:44:34.924 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-19T20:44:35.048 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.054+0000 7fafdc313700 1 Processor -- start 2023-07-19T20:44:35.048 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.054+0000 7fafdc313700 1 -- start start 2023-07-19T20:44:35.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.055+0000 7fafdc313700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fafd4144b60 0x7fafd406c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.055+0000 7fafdc313700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd4144f30 con 0x7fafd40b9800 2023-07-19T20:44:35.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.055+0000 7fafdc313700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd406ee80 con 0x7fafd414ae50 2023-07-19T20:44:35.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.055+0000 7fafdc313700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd406cb80 con 0x7fafd4144b60 2023-07-19T20:44:35.051 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.055+0000 7fafda0af700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fafd4144b60 0x7fafd406c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.051 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.055+0000 7fafd98ae700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fafd40b9800 0x7fafd406e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:53154/0 (socket says 172.21.15.117:53154) 2023-07-19T20:44:35.051 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.055+0000 7fafd98ae700 1 -- 172.21.15.117:0/225070212 learned_addr learned my addr 172.21.15.117:0/225070212 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:35.051 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.055+0000 7fafda0af700 1 -- 172.21.15.117:0/225070212 >> v1:172.21.15.124:6789/0 conn(0x7fafd414ae50 legacy=0x7fafd414b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:35.051 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.055+0000 7fafda0af700 1 -- 172.21.15.117:0/225070212 >> v1:172.21.15.117:6789/0 conn(0x7fafd40b9800 legacy=0x7fafd406e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.051 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.055+0000 7fafda0af700 1 -- 172.21.15.117:0/225070212 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd406ce60 con 0x7fafd4144b60 2023-07-19T20:44:35.051 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.056+0000 7fafda0af700 1 --2- 172.21.15.117:0/225070212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd4144b60 0x7fafd406c580 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009840 tx=0x7fafc4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3107ec413a5a51c server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:35.052 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.056+0000 7fafd90ad700 1 -- 172.21.15.117:0/225070212 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4004230 con 0x7fafd4144b60 2023-07-19T20:44:35.052 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.056+0000 7fafd90ad700 1 -- 172.21.15.117:0/225070212 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4004390 con 0x7fafd4144b60 2023-07-19T20:44:35.052 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.056+0000 7fafd90ad700 1 -- 172.21.15.117:0/225070212 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc40036a0 con 0x7fafd4144b60 2023-07-19T20:44:35.052 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.056+0000 7fafdc313700 1 -- 172.21.15.117:0/225070212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd4144b60 msgr2=0x7fafd406c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.052 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.056+0000 7fafdc313700 1 --2- 172.21.15.117:0/225070212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd4144b60 0x7fafd406c580 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009840 tx=0x7fafc4009b50 comp rx=0 tx=0).stop 2023-07-19T20:44:35.052 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.056+0000 7fafdc313700 1 -- 172.21.15.117:0/225070212 shutdown_connections 2023-07-19T20:44:35.052 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.056+0000 7fafdc313700 1 --2- 172.21.15.117:0/225070212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd4144b60 0x7fafd406c580 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.053 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.056+0000 7fafdc313700 1 -- 172.21.15.117:0/225070212 >> 172.21.15.117:0/225070212 conn(0x7fafd40be9c0 msgr2=0x7fafd40bed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:35.053 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.056+0000 7fafdc313700 1 -- 172.21.15.117:0/225070212 shutdown_connections 2023-07-19T20:44:35.053 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.056+0000 7fafdc313700 1 -- 172.21.15.117:0/225070212 wait complete. 2023-07-19T20:44:35.055 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.057+0000 7fafdc313700 1 Processor -- start 2023-07-19T20:44:35.055 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.057+0000 7fafdc313700 1 -- start start 2023-07-19T20:44:35.056 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafdc313700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fafd40b9800 0x7fafd41d7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.056 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafdc313700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd4144b60 0x7fafd41e3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.056 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafdc313700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fafd414ae50 0x7fafd41e3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.057 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafdc313700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40b6660 con 0x7fafd4144b60 2023-07-19T20:44:35.057 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafdc313700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd41d7d70 con 0x7fafd414ae50 2023-07-19T20:44:35.057 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafdc313700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40b8920 con 0x7fafd40b9800 2023-07-19T20:44:35.057 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafd98ae700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd4144b60 0x7fafd41e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.057 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafd98ae700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd4144b60 0x7fafd41e3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35828/0 (socket says 172.21.15.117:35828) 2023-07-19T20:44:35.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafd98ae700 1 -- 172.21.15.117:0/2693624248 learned_addr learned my addr 172.21.15.117:0/2693624248 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:35.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafda0af700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fafd40b9800 0x7fafd41d7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafda8b0700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fafd414ae50 0x7fafd41e3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafd98ae700 1 -- 172.21.15.117:0/2693624248 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fafd40b9800 msgr2=0x7fafd41d7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafd98ae700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fafd40b9800 0x7fafd41d7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafd98ae700 1 -- 172.21.15.117:0/2693624248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fafd414ae50 msgr2=0x7fafd41e3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafd98ae700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fafd414ae50 0x7fafd41e3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.059 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafd98ae700 1 -- 172.21.15.117:0/2693624248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40094a0 con 0x7fafd4144b60 2023-07-19T20:44:35.059 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.058+0000 7fafda8b0700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fafd414ae50 0x7fafd41e3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:35.059 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.059+0000 7fafd98ae700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd4144b60 0x7fafd41e3950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fafd000c500 tx=0x7fafd000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:35.059 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.059+0000 7fafcaffd700 1 -- 172.21.15.117:0/2693624248 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0005d70 con 0x7fafd4144b60 2023-07-19T20:44:35.059 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.059+0000 7fafcaffd700 1 -- 172.21.15.117:0/2693624248 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd00070d0 con 0x7fafd4144b60 2023-07-19T20:44:35.059 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.059+0000 7fafdc313700 1 -- 172.21.15.117:0/2693624248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd40b5cc0 con 0x7fafd4144b60 2023-07-19T20:44:35.059 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.059+0000 7fafcaffd700 1 -- 172.21.15.117:0/2693624248 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0007460 con 0x7fafd4144b60 2023-07-19T20:44:35.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.059+0000 7fafdc313700 1 -- 172.21.15.117:0/2693624248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd40b6280 con 0x7fafd4144b60 2023-07-19T20:44:35.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.060+0000 7fafdc313700 1 -- 172.21.15.117:0/2693624248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd4074890 con 0x7fafd4144b60 2023-07-19T20:44:35.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.060+0000 7fafcaffd700 1 -- 172.21.15.117:0/2693624248 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fafd00075c0 con 0x7fafd4144b60 2023-07-19T20:44:35.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.061+0000 7fafcaffd700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fafb806a690 0x7fafb806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.061+0000 7fafda0af700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fafb806a690 0x7fafb806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.061+0000 7fafcaffd700 1 -- 172.21.15.117:0/2693624248 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fafd0087b00 con 0x7fafd4144b60 2023-07-19T20:44:35.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.061+0000 7fafda0af700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fafb806a690 0x7fafb806cb40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fafc40090b0 tx=0x7fafc401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:35.061 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.065+0000 7fafcaffd700 1 -- 172.21.15.117:0/2693624248 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fafd00532e0 con 0x7fafd4144b60 2023-07-19T20:44:35.247 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.253+0000 7fafdc313700 1 -- 172.21.15.117:0/2693624248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fafd40b67a0 con 0x7fafd4144b60 2023-07-19T20:44:35.247 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.253+0000 7fafcaffd700 1 -- 172.21.15.117:0/2693624248 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fafd40b67a0 con 0x7fafd4144b60 2023-07-19T20:44:35.247 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 8 2023-07-19T20:44:35.249 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.256+0000 7fafdc313700 1 -- 172.21.15.117:0/2693624248 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fafb806a690 msgr2=0x7fafb806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.249 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.256+0000 7fafdc313700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fafb806a690 0x7fafb806cb40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fafc40090b0 tx=0x7fafc401c040 comp rx=0 tx=0).stop 2023-07-19T20:44:35.250 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.256+0000 7fafdc313700 1 -- 172.21.15.117:0/2693624248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd4144b60 msgr2=0x7fafd41e3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.250 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.256+0000 7fafdc313700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd4144b60 0x7fafd41e3950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fafd000c500 tx=0x7fafd000c810 comp rx=0 tx=0).stop 2023-07-19T20:44:35.250 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.256+0000 7fafdc313700 1 -- 172.21.15.117:0/2693624248 shutdown_connections 2023-07-19T20:44:35.250 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.256+0000 7fafdc313700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fafb806a690 0x7fafb806cb40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.250 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.256+0000 7fafdc313700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fafd414ae50 0x7fafd41e3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.250 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.256+0000 7fafdc313700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fafd40b9800 0x7fafd41d7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.250 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.256+0000 7fafdc313700 1 --2- 172.21.15.117:0/2693624248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd4144b60 0x7fafd41e3950 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.251 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.256+0000 7fafdc313700 1 -- 172.21.15.117:0/2693624248 >> 172.21.15.117:0/2693624248 conn(0x7fafd40be9c0 msgr2=0x7fafd4070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:35.251 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.256+0000 7fafdc313700 1 -- 172.21.15.117:0/2693624248 shutdown_connections 2023-07-19T20:44:35.251 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.256+0000 7fafdc313700 1 -- 172.21.15.117:0/2693624248 wait complete. 2023-07-19T20:44:35.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-19T20:44:35.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.392+0000 7f19d50c4700 1 Processor -- start 2023-07-19T20:44:35.387 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.392+0000 7f19d50c4700 1 -- start start 2023-07-19T20:44:35.389 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.393+0000 7f19d50c4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f19d006a560 0x7f19d00a0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.389 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.393+0000 7f19d50c4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f19d00a2b60 0x7f19d00ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.389 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.393+0000 7f19d50c4700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d00b8490 con 0x7f19d00a0eb0 2023-07-19T20:44:35.389 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.393+0000 7f19d50c4700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d00bcda0 con 0x7f19d006a560 2023-07-19T20:44:35.390 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.393+0000 7f19d50c4700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00b9ab0 con 0x7f19d00a2b60 2023-07-19T20:44:35.390 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.393+0000 7f19ced9d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f19d006a560 0x7f19d00a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.390 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.393+0000 7f19cf59e700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f19d00a0eb0 0x7f19d00ba830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:53156/0 (socket says 172.21.15.117:53156) 2023-07-19T20:44:35.391 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.393+0000 7f19cf59e700 1 -- 172.21.15.117:0/945048343 learned_addr learned my addr 172.21.15.117:0/945048343 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:35.391 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.393+0000 7f19ce59c700 1 --2- 172.21.15.117:0/945048343 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f19d00a2b60 0x7f19d00ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.391 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19ced9d700 1 -- 172.21.15.117:0/945048343 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f19d00a2b60 msgr2=0x7f19d00ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:35.392 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19ced9d700 1 --2- 172.21.15.117:0/945048343 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f19d00a2b60 0x7f19d00ba2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.392 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19ced9d700 1 -- 172.21.15.117:0/945048343 >> v1:172.21.15.117:6789/0 conn(0x7f19d00a0eb0 legacy=0x7f19d00ba830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.392 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19cdd9b700 1 -- 172.21.15.117:0/945048343 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889646745 0 0) 0x7f19d00b8490 con 0x7f19d00a0eb0 2023-07-19T20:44:35.392 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19ced9d700 1 -- 172.21.15.117:0/945048343 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d00b9560 con 0x7f19d006a560 2023-07-19T20:44:35.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19ce59c700 1 --2- 172.21.15.117:0/945048343 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f19d00a2b60 0x7f19d00ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:35.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19ced9d700 1 --2- 172.21.15.117:0/945048343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d006a560 0x7f19d00a0970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009840 tx=0x7f19c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dacf26f140d2473e server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:35.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19cdd9b700 1 -- 172.21.15.117:0/945048343 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4011830 con 0x7f19d006a560 2023-07-19T20:44:35.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19cdd9b700 1 -- 172.21.15.117:0/945048343 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c4011990 con 0x7f19d006a560 2023-07-19T20:44:35.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19cdd9b700 1 -- 172.21.15.117:0/945048343 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4011d20 con 0x7f19d006a560 2023-07-19T20:44:35.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19d50c4700 1 -- 172.21.15.117:0/945048343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d006a560 msgr2=0x7f19d00a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19d50c4700 1 --2- 172.21.15.117:0/945048343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d006a560 0x7f19d00a0970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009840 tx=0x7f19c4009b50 comp rx=0 tx=0).stop 2023-07-19T20:44:35.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19d50c4700 1 -- 172.21.15.117:0/945048343 shutdown_connections 2023-07-19T20:44:35.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19d50c4700 1 --2- 172.21.15.117:0/945048343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d006a560 0x7f19d00a0970 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19d50c4700 1 --2- 172.21.15.117:0/945048343 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f19d00a2b60 0x7f19d00ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19d50c4700 1 -- 172.21.15.117:0/945048343 >> 172.21.15.117:0/945048343 conn(0x7f19d009f570 msgr2=0x7f19d009f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:35.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19d50c4700 1 -- 172.21.15.117:0/945048343 shutdown_connections 2023-07-19T20:44:35.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.394+0000 7f19d50c4700 1 -- 172.21.15.117:0/945048343 wait complete. 2023-07-19T20:44:35.399 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.396+0000 7f19d50c4700 1 Processor -- start 2023-07-19T20:44:35.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.396+0000 7f19d50c4700 1 -- start start 2023-07-19T20:44:35.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.396+0000 7f19d50c4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d006a560 0x7f19d00bdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.396+0000 7f19d50c4700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f19d00a0eb0 0x7f19d01ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.396+0000 7f19d50c4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f19d00a2b60 0x7f19d01ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.396+0000 7f19d50c4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d01cde10 con 0x7f19d006a560 2023-07-19T20:44:35.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.396+0000 7f19d50c4700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00be090 con 0x7f19d00a0eb0 2023-07-19T20:44:35.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.396+0000 7f19d50c4700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d01cecb0 con 0x7f19d00a2b60 2023-07-19T20:44:35.401 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19ced9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d006a560 0x7f19d00bdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.401 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19ced9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d006a560 0x7f19d00bdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35838/0 (socket says 172.21.15.117:35838) 2023-07-19T20:44:35.401 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19ced9d700 1 -- 172.21.15.117:0/3082887397 learned_addr learned my addr 172.21.15.117:0/3082887397 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:35.401 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19cf59e700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f19d00a2b60 0x7f19d01ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.401 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19ce59c700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f19d00a0eb0 0x7f19d01ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.401 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19ced9d700 1 -- 172.21.15.117:0/3082887397 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f19d00a2b60 msgr2=0x7f19d01ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19ced9d700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f19d00a2b60 0x7f19d01ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19ced9d700 1 -- 172.21.15.117:0/3082887397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f19d00a0eb0 msgr2=0x7f19d01ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19ced9d700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f19d00a0eb0 0x7f19d01ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19ced9d700 1 -- 172.21.15.117:0/3082887397 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c40094a0 con 0x7f19d006a560 2023-07-19T20:44:35.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19ce59c700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f19d00a0eb0 0x7f19d01ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:35.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19ced9d700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d006a560 0x7f19d00bdb50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f19c4014040 tx=0x7f19c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:35.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19b77fe700 1 -- 172.21.15.117:0/3082887397 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c40045f0 con 0x7f19d006a560 2023-07-19T20:44:35.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19b77fe700 1 -- 172.21.15.117:0/3082887397 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c401e070 con 0x7f19d006a560 2023-07-19T20:44:35.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19d50c4700 1 -- 172.21.15.117:0/3082887397 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d01cd1c0 con 0x7f19d006a560 2023-07-19T20:44:35.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19b77fe700 1 -- 172.21.15.117:0/3082887397 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4003aa0 con 0x7f19d006a560 2023-07-19T20:44:35.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.397+0000 7f19d50c4700 1 -- 172.21.15.117:0/3082887397 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d01e0470 con 0x7f19d006a560 2023-07-19T20:44:35.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.398+0000 7f19d50c4700 1 -- 172.21.15.117:0/3082887397 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d0067940 con 0x7f19d006a560 2023-07-19T20:44:35.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.398+0000 7f19b77fe700 1 -- 172.21.15.117:0/3082887397 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f19c4003c00 con 0x7f19d006a560 2023-07-19T20:44:35.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.399+0000 7f19b77fe700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f19bc06a660 0x7f19bc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.404 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.399+0000 7f19b77fe700 1 -- 172.21.15.117:0/3082887397 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f19c4089a10 con 0x7f19d006a560 2023-07-19T20:44:35.404 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.399+0000 7f19ce59c700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f19bc06a660 0x7f19bc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.404 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.399+0000 7f19ce59c700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f19bc06a660 0x7f19bc06cb10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19d00bb080 tx=0x7f19c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:35.404 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.403+0000 7f19b77fe700 1 -- 172.21.15.117:0/3082887397 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f19c40551f0 con 0x7f19d006a560 2023-07-19T20:44:35.581 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.588+0000 7f19d50c4700 1 -- 172.21.15.117:0/3082887397 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19d00b8900 con 0x7f19d006a560 2023-07-19T20:44:35.582 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.588+0000 7f19b77fe700 1 -- 172.21.15.117:0/3082887397 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19d00b8900 con 0x7f19d006a560 2023-07-19T20:44:35.582 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2023-07-19T20:44:35.583 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.590+0000 7f19d50c4700 1 -- 172.21.15.117:0/3082887397 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f19bc06a660 msgr2=0x7f19bc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.584 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.590+0000 7f19d50c4700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f19bc06a660 0x7f19bc06cb10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19d00bb080 tx=0x7f19c0008040 comp rx=0 tx=0).stop 2023-07-19T20:44:35.584 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.590+0000 7f19d50c4700 1 -- 172.21.15.117:0/3082887397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d006a560 msgr2=0x7f19d00bdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.584 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.590+0000 7f19d50c4700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d006a560 0x7f19d00bdb50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f19c4014040 tx=0x7f19c4004750 comp rx=0 tx=0).stop 2023-07-19T20:44:35.584 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.590+0000 7f19d50c4700 1 -- 172.21.15.117:0/3082887397 shutdown_connections 2023-07-19T20:44:35.584 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.590+0000 7f19d50c4700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f19bc06a660 0x7f19bc06cb10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.584 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.590+0000 7f19d50c4700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f19d00a2b60 0x7f19d01ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.584 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.590+0000 7f19d50c4700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d006a560 0x7f19d00bdb50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.585 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.590+0000 7f19d50c4700 1 --2- 172.21.15.117:0/3082887397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f19d00a0eb0 0x7f19d01ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.585 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.590+0000 7f19d50c4700 1 -- 172.21.15.117:0/3082887397 >> 172.21.15.117:0/3082887397 conn(0x7f19d009f570 msgr2=0x7f19d01d5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:35.585 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.590+0000 7f19d50c4700 1 -- 172.21.15.117:0/3082887397 shutdown_connections 2023-07-19T20:44:35.585 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.590+0000 7f19d50c4700 1 -- 172.21.15.117:0/3082887397 wait complete. 2023-07-19T20:44:35.595 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-19T20:44:35.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.722+0000 7f885f3b4700 1 Processor -- start 2023-07-19T20:44:35.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.723+0000 7f885f3b4700 1 -- start start 2023-07-19T20:44:35.723 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.723+0000 7f885f3b4700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f88581449d0 0x7f88580bae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.723+0000 7f885f3b4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f88580713f0 0x7f8858071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.723+0000 7f885f3b4700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8858070f60 con 0x7f885814a7a0 2023-07-19T20:44:35.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.723+0000 7f885f3b4700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88580bf7a0 con 0x7f88580713f0 2023-07-19T20:44:35.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.723+0000 7f885f3b4700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885814aff0 con 0x7f88581449d0 2023-07-19T20:44:35.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.723+0000 7f885c94f700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f885814a7a0 0x7f88580bf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:53164/0 (socket says 172.21.15.117:53164) 2023-07-19T20:44:35.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.723+0000 7f885c94f700 1 -- 172.21.15.117:0/3196165474 learned_addr learned my addr 172.21.15.117:0/3196165474 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:35.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.723+0000 7f885d951700 1 --2- 172.21.15.117:0/3196165474 >> v2:172.21.15.117:3300/0 conn(0x7f88580713f0 0x7f8858071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.724+0000 7f884bfff700 1 -- 172.21.15.117:0/3196165474 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020310674 0 0) 0x7f8858070f60 con 0x7f885814a7a0 2023-07-19T20:44:35.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.724+0000 7f885d150700 1 --2- 172.21.15.117:0/3196165474 >> v2:172.21.15.124:3300/0 conn(0x7f88581449d0 0x7f88580bae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.724+0000 7f884bfff700 1 -- 172.21.15.117:0/3196165474 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88440035b0 con 0x7f885814a7a0 2023-07-19T20:44:35.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.724+0000 7f885d951700 1 -- 172.21.15.117:0/3196165474 >> v2:172.21.15.124:3300/0 conn(0x7f88581449d0 msgr2=0x7f88580bae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:35.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.724+0000 7f885d951700 1 --2- 172.21.15.117:0/3196165474 >> v2:172.21.15.124:3300/0 conn(0x7f88581449d0 0x7f88580bae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.724+0000 7f885d951700 1 -- 172.21.15.117:0/3196165474 >> v1:172.21.15.117:6789/0 conn(0x7f885814a7a0 legacy=0x7f88580bf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.724+0000 7f885d951700 1 -- 172.21.15.117:0/3196165474 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885814b2d0 con 0x7f88580713f0 2023-07-19T20:44:35.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.724+0000 7f885d951700 1 --2- 172.21.15.117:0/3196165474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88580713f0 0x7f8858071810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f88580704f0 tx=0x7f885000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56284616838324fa server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:35.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.724+0000 7f884bfff700 1 -- 172.21.15.117:0/3196165474 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885000e070 con 0x7f88580713f0 2023-07-19T20:44:35.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.724+0000 7f884bfff700 1 -- 172.21.15.117:0/3196165474 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885000bb20 con 0x7f88580713f0 2023-07-19T20:44:35.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.724+0000 7f884bfff700 1 -- 172.21.15.117:0/3196165474 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850012430 con 0x7f88580713f0 2023-07-19T20:44:35.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.724+0000 7f885f3b4700 1 -- 172.21.15.117:0/3196165474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88580713f0 msgr2=0x7f8858071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.724+0000 7f885f3b4700 1 --2- 172.21.15.117:0/3196165474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88580713f0 0x7f8858071810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f88580704f0 tx=0x7f885000b330 comp rx=0 tx=0).stop 2023-07-19T20:44:35.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.725+0000 7f885f3b4700 1 -- 172.21.15.117:0/3196165474 shutdown_connections 2023-07-19T20:44:35.730 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.725+0000 7f885f3b4700 1 --2- 172.21.15.117:0/3196165474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88580713f0 0x7f8858071810 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.730 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.725+0000 7f885f3b4700 1 --2- 172.21.15.117:0/3196165474 >> v2:172.21.15.124:3300/0 conn(0x7f88581449d0 0x7f88580bae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.730 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.725+0000 7f885f3b4700 1 -- 172.21.15.117:0/3196165474 >> 172.21.15.117:0/3196165474 conn(0x7f88580a1250 msgr2=0x7f88580be980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:35.731 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.725+0000 7f885f3b4700 1 -- 172.21.15.117:0/3196165474 shutdown_connections 2023-07-19T20:44:35.731 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.725+0000 7f885f3b4700 1 -- 172.21.15.117:0/3196165474 wait complete. 2023-07-19T20:44:35.731 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.726+0000 7f885f3b4700 1 Processor -- start 2023-07-19T20:44:35.731 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.726+0000 7f885f3b4700 1 -- start start 2023-07-19T20:44:35.732 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.726+0000 7f885f3b4700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88580713f0 0x7f8858149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.732 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.726+0000 7f885f3b4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88581449d0 0x7f88581404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.726+0000 7f885f3b4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f885814a7a0 0x7f885813cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.726+0000 7f885f3b4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581e0570 con 0x7f88581449d0 2023-07-19T20:44:35.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.726+0000 7f885f3b4700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885814a370 con 0x7f88580713f0 2023-07-19T20:44:35.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.726+0000 7f885f3b4700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88581409f0 con 0x7f885814a7a0 2023-07-19T20:44:35.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.726+0000 7f885c94f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88581449d0 0x7f88581404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.726+0000 7f885c94f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88581449d0 0x7f88581404b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35846/0 (socket says 172.21.15.117:35846) 2023-07-19T20:44:35.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.726+0000 7f885c94f700 1 -- 172.21.15.117:0/2704112387 learned_addr learned my addr 172.21.15.117:0/2704112387 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:35.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.727+0000 7f885d150700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88580713f0 0x7f8858149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.727+0000 7f885d951700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f885814a7a0 0x7f885813cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.727+0000 7f885c94f700 1 -- 172.21.15.117:0/2704112387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f885814a7a0 msgr2=0x7f885813cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.727+0000 7f885c94f700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f885814a7a0 0x7f885813cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.727+0000 7f885c94f700 1 -- 172.21.15.117:0/2704112387 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88580713f0 msgr2=0x7f8858149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.727+0000 7f885c94f700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88580713f0 0x7f8858149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.727+0000 7f885c94f700 1 -- 172.21.15.117:0/2704112387 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8850009a70 con 0x7f88581449d0 2023-07-19T20:44:35.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.727+0000 7f885d150700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88580713f0 0x7f8858149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:35.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.727+0000 7f885c94f700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88581449d0 0x7f88581404b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f885400c700 tx=0x7f885400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:35.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.727+0000 7f8849ffb700 1 -- 172.21.15.117:0/2704112387 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854005d70 con 0x7f88581449d0 2023-07-19T20:44:35.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.727+0000 7f8849ffb700 1 -- 172.21.15.117:0/2704112387 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88540070d0 con 0x7f88581449d0 2023-07-19T20:44:35.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.727+0000 7f885f3b4700 1 -- 172.21.15.117:0/2704112387 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88581dfbd0 con 0x7f88581449d0 2023-07-19T20:44:35.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.727+0000 7f8849ffb700 1 -- 172.21.15.117:0/2704112387 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854007460 con 0x7f88581449d0 2023-07-19T20:44:35.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.727+0000 7f885f3b4700 1 -- 172.21.15.117:0/2704112387 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88581e0190 con 0x7f88581449d0 2023-07-19T20:44:35.739 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.728+0000 7f885f3b4700 1 -- 172.21.15.117:0/2704112387 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8858074890 con 0x7f88581449d0 2023-07-19T20:44:35.739 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.728+0000 7f8849ffb700 1 -- 172.21.15.117:0/2704112387 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f88540075c0 con 0x7f88581449d0 2023-07-19T20:44:35.739 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.729+0000 7f8849ffb700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f883c06a660 0x7f883c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:35.739 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.729+0000 7f8849ffb700 1 -- 172.21.15.117:0/2704112387 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8854087d60 con 0x7f88581449d0 2023-07-19T20:44:35.740 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.729+0000 7f885d150700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f883c06a660 0x7f883c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:35.740 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.729+0000 7f885d150700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f883c06a660 0x7f883c06cb10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f884c00aa50 tx=0x7f884c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:35.740 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.733+0000 7f8849ffb700 1 -- 172.21.15.117:0/2704112387 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f88540534c0 con 0x7f88581449d0 2023-07-19T20:44:35.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.921+0000 7f885f3b4700 1 -- 172.21.15.117:0/2704112387 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8858072580 con 0x7f88581449d0 2023-07-19T20:44:35.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.921+0000 7f8849ffb700 1 -- 172.21.15.117:0/2704112387 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8854017090 con 0x7f88581449d0 2023-07-19T20:44:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:35.915 INFO:teuthology.orchestra.run.smithi117.stdout:[ 2023-07-19T20:44:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:44:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "poolnum": 1, 2023-07-19T20:44:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "poolname": "rbd" 2023-07-19T20:44:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:44:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:44:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "poolnum": 2, 2023-07-19T20:44:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "poolname": ".mgr" 2023-07-19T20:44:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:44:35.917 INFO:teuthology.orchestra.run.smithi117.stdout:] 2023-07-19T20:44:35.919 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.923+0000 7f885f3b4700 1 -- 172.21.15.117:0/2704112387 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f883c06a660 msgr2=0x7f883c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.919 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.923+0000 7f885f3b4700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f883c06a660 0x7f883c06cb10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f884c00aa50 tx=0x7f884c008040 comp rx=0 tx=0).stop 2023-07-19T20:44:35.919 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.923+0000 7f885f3b4700 1 -- 172.21.15.117:0/2704112387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88581449d0 msgr2=0x7f88581404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:35.919 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.923+0000 7f885f3b4700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88581449d0 0x7f88581404b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f885400c700 tx=0x7f885400cac0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.919 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.923+0000 7f885f3b4700 1 -- 172.21.15.117:0/2704112387 shutdown_connections 2023-07-19T20:44:35.920 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.923+0000 7f885f3b4700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f883c06a660 0x7f883c06cb10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.920 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.923+0000 7f885f3b4700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f885814a7a0 0x7f885813cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.920 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.923+0000 7f885f3b4700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88580713f0 0x7f8858149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.920 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.923+0000 7f885f3b4700 1 --2- 172.21.15.117:0/2704112387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88581449d0 0x7f88581404b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:35.920 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.923+0000 7f885f3b4700 1 -- 172.21.15.117:0/2704112387 >> 172.21.15.117:0/2704112387 conn(0x7f88580a1250 msgr2=0x7f8858144010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:35.920 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.923+0000 7f885f3b4700 1 -- 172.21.15.117:0/2704112387 shutdown_connections 2023-07-19T20:44:35.920 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:35.923+0000 7f885f3b4700 1 -- 172.21.15.117:0/2704112387 wait complete. 2023-07-19T20:44:35.931 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-19T20:44:35.932 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-19T20:44:36.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.064+0000 7f2977e5c700 1 Processor -- start 2023-07-19T20:44:36.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.065+0000 7f2977e5c700 1 -- start start 2023-07-19T20:44:36.061 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.065+0000 7f2977e5c700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29700c03e0 0x7f29700c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:36.061 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.065+0000 7f2977e5c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29700beb30 0x7f29700bcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:36.061 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.065+0000 7f2977e5c700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29700c1440 con 0x7f29700bcff0 2023-07-19T20:44:36.061 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.065+0000 7f2977e5c700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29700c1720 con 0x7f29700beb30 2023-07-19T20:44:36.061 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.065+0000 7f2977e5c700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29700bbca0 con 0x7f29700c03e0 2023-07-19T20:44:36.061 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.065+0000 7f29753f7700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29700beb30 0x7f29700bcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:36.062 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.065+0000 7f29753f7700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29700beb30 0x7f29700bcab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35854/0 (socket says 172.21.15.117:35854) 2023-07-19T20:44:36.062 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.065+0000 7f29753f7700 1 -- 172.21.15.117:0/947509040 learned_addr learned my addr 172.21.15.117:0/947509040 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:36.062 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.066+0000 7f2975bf8700 1 --2- 172.21.15.117:0/947509040 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29700c03e0 0x7f29700c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:36.062 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.066+0000 7f29753f7700 1 -- 172.21.15.117:0/947509040 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29700c03e0 msgr2=0x7f29700c07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:36.062 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.066+0000 7f29753f7700 1 --2- 172.21.15.117:0/947509040 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29700c03e0 0x7f29700c07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:36.062 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.066+0000 7f29753f7700 1 -- 172.21.15.117:0/947509040 >> v1:172.21.15.124:6789/0 conn(0x7f29700bcff0 legacy=0x7f297014e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:36.062 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.066+0000 7f29753f7700 1 -- 172.21.15.117:0/947509040 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29700bf8d0 con 0x7f29700beb30 2023-07-19T20:44:36.063 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.066+0000 7f29753f7700 1 --2- 172.21.15.117:0/947509040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29700beb30 0x7f29700bcab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f296c0098f0 tx=0x7f296c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959a6b18c373253a server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:36.063 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.066+0000 7f2974bf6700 1 -- 172.21.15.117:0/947509040 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c011830 con 0x7f29700beb30 2023-07-19T20:44:36.063 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.066+0000 7f2974bf6700 1 -- 172.21.15.117:0/947509040 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296c011990 con 0x7f29700beb30 2023-07-19T20:44:36.063 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.066+0000 7f2974bf6700 1 -- 172.21.15.117:0/947509040 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c011d20 con 0x7f29700beb30 2023-07-19T20:44:36.063 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.066+0000 7f2977e5c700 1 -- 172.21.15.117:0/947509040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29700beb30 msgr2=0x7f29700bcab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:36.063 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.067+0000 7f2977e5c700 1 --2- 172.21.15.117:0/947509040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29700beb30 0x7f29700bcab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f296c0098f0 tx=0x7f296c009c00 comp rx=0 tx=0).stop 2023-07-19T20:44:36.064 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.067+0000 7f2977e5c700 1 -- 172.21.15.117:0/947509040 shutdown_connections 2023-07-19T20:44:36.064 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.067+0000 7f2977e5c700 1 --2- 172.21.15.117:0/947509040 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29700c03e0 0x7f29700c07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:36.065 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.067+0000 7f2977e5c700 1 --2- 172.21.15.117:0/947509040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29700beb30 0x7f29700bcab0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:36.065 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.067+0000 7f2977e5c700 1 -- 172.21.15.117:0/947509040 >> 172.21.15.117:0/947509040 conn(0x7f29700a3490 msgr2=0x7f29700c0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:36.065 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.067+0000 7f2977e5c700 1 -- 172.21.15.117:0/947509040 shutdown_connections 2023-07-19T20:44:36.065 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.067+0000 7f2977e5c700 1 -- 172.21.15.117:0/947509040 wait complete. 2023-07-19T20:44:36.068 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.068+0000 7f2977e5c700 1 Processor -- start 2023-07-19T20:44:36.068 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.068+0000 7f2977e5c700 1 -- start start 2023-07-19T20:44:36.068 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.068+0000 7f2977e5c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29700bcff0 0x7f29700ba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:36.068 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.068+0000 7f2977e5c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29700beb30 0x7f2970145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:36.068 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.068+0000 7f2977e5c700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29700c03e0 0x7f2970147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:36.068 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.068+0000 7f2977e5c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700bad30 con 0x7f29700bcff0 2023-07-19T20:44:36.068 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.068+0000 7f2977e5c700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29701e0580 con 0x7f29700beb30 2023-07-19T20:44:36.069 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.068+0000 7f2977e5c700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2970147df0 con 0x7f29700c03e0 2023-07-19T20:44:36.069 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.068+0000 7f2975bf8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29700bcff0 0x7f29700ba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:36.069 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.068+0000 7f2975bf8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29700bcff0 0x7f29700ba7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35862/0 (socket says 172.21.15.117:35862) 2023-07-19T20:44:36.069 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.068+0000 7f2975bf8700 1 -- 172.21.15.117:0/3150902093 learned_addr learned my addr 172.21.15.117:0/3150902093 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:36.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.068+0000 7f29753f7700 1 --2- 172.21.15.117:0/3150902093 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29700beb30 0x7f2970145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:36.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.069+0000 7f29763f9700 1 --2- 172.21.15.117:0/3150902093 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29700c03e0 0x7f2970147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:36.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.069+0000 7f2975bf8700 1 -- 172.21.15.117:0/3150902093 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29700c03e0 msgr2=0x7f2970147350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:36.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.069+0000 7f2975bf8700 1 --2- 172.21.15.117:0/3150902093 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29700c03e0 0x7f2970147350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:36.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.069+0000 7f2975bf8700 1 -- 172.21.15.117:0/3150902093 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29700beb30 msgr2=0x7f2970145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:36.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.069+0000 7f2975bf8700 1 --2- 172.21.15.117:0/3150902093 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29700beb30 0x7f2970145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:36.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.069+0000 7f2975bf8700 1 -- 172.21.15.117:0/3150902093 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c009550 con 0x7f29700bcff0 2023-07-19T20:44:36.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.069+0000 7f2975bf8700 1 --2- 172.21.15.117:0/3150902093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29700bcff0 0x7f29700ba7f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f296000e870 tx=0x7f296000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:36.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.069+0000 7f29667fc700 1 -- 172.21.15.117:0/3150902093 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960009590 con 0x7f29700bcff0 2023-07-19T20:44:36.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.069+0000 7f29667fc700 1 -- 172.21.15.117:0/3150902093 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960013680 con 0x7f29700bcff0 2023-07-19T20:44:36.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.069+0000 7f29667fc700 1 -- 172.21.15.117:0/3150902093 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29600139f0 con 0x7f29700bcff0 2023-07-19T20:44:36.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.069+0000 7f2977e5c700 1 -- 172.21.15.117:0/3150902093 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29701e0830 con 0x7f29700bcff0 2023-07-19T20:44:36.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.069+0000 7f2977e5c700 1 -- 172.21.15.117:0/3150902093 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2970146130 con 0x7f29700bcff0 2023-07-19T20:44:36.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.070+0000 7f2977e5c700 1 -- 172.21.15.117:0/3150902093 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2970067940 con 0x7f29700bcff0 2023-07-19T20:44:36.072 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.070+0000 7f29667fc700 1 -- 172.21.15.117:0/3150902093 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f2960013b50 con 0x7f29700bcff0 2023-07-19T20:44:36.072 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.071+0000 7f29667fc700 1 --2- 172.21.15.117:0/3150902093 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f295406a660 0x7f295406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:36.072 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.071+0000 7f29753f7700 1 --2- 172.21.15.117:0/3150902093 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f295406a660 0x7f295406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:36.072 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.071+0000 7f29667fc700 1 -- 172.21.15.117:0/3150902093 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2960088580 con 0x7f29700bcff0 2023-07-19T20:44:36.072 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.071+0000 7f29753f7700 1 --2- 172.21.15.117:0/3150902093 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f295406a660 0x7f295406cb10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f296c000c00 tx=0x7f296c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:36.074 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.075+0000 7f29667fc700 1 -- 172.21.15.117:0/3150902093 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f29600577f0 con 0x7f29700bcff0 2023-07-19T20:44:36.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:36.262+0000 7f2977e5c700 1 -- 172.21.15.117:0/3150902093 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f297014ba90 con 0x7f29700bcff0 2023-07-19T20:44:37.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.135+0000 7f29667fc700 1 -- 172.21.15.117:0/3150902093 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2960057380 con 0x7f29700bcff0 2023-07-19T20:44:37.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.137+0000 7f2977e5c700 1 -- 172.21.15.117:0/3150902093 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f295406a660 msgr2=0x7f295406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:37.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.137+0000 7f2977e5c700 1 --2- 172.21.15.117:0/3150902093 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f295406a660 0x7f295406cb10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f296c000c00 tx=0x7f296c008030 comp rx=0 tx=0).stop 2023-07-19T20:44:37.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.137+0000 7f2977e5c700 1 -- 172.21.15.117:0/3150902093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29700bcff0 msgr2=0x7f29700ba7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.137+0000 7f2977e5c700 1 --2- 172.21.15.117:0/3150902093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29700bcff0 0x7f29700ba7f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f296000e870 tx=0x7f296000eb80 comp rx=0 tx=0).stop 2023-07-19T20:44:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.137+0000 7f2977e5c700 1 -- 172.21.15.117:0/3150902093 shutdown_connections 2023-07-19T20:44:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.137+0000 7f2977e5c700 1 --2- 172.21.15.117:0/3150902093 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f295406a660 0x7f295406cb10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.137+0000 7f2977e5c700 1 --2- 172.21.15.117:0/3150902093 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29700c03e0 0x7f2970147350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.137+0000 7f2977e5c700 1 --2- 172.21.15.117:0/3150902093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29700bcff0 0x7f29700ba7f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.137+0000 7f2977e5c700 1 --2- 172.21.15.117:0/3150902093 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29700beb30 0x7f2970145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.137+0000 7f2977e5c700 1 -- 172.21.15.117:0/3150902093 >> 172.21.15.117:0/3150902093 conn(0x7f29700a3490 msgr2=0x7f29700a0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.137+0000 7f2977e5c700 1 -- 172.21.15.117:0/3150902093 shutdown_connections 2023-07-19T20:44:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.138+0000 7f2977e5c700 1 -- 172.21.15.117:0/3150902093 wait complete. 2023-07-19T20:44:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_metadata' created 2023-07-19T20:44:37.149 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-19T20:44:37.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.295+0000 7fd83ae1a700 1 Processor -- start 2023-07-19T20:44:37.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.295+0000 7fd83ae1a700 1 -- start start 2023-07-19T20:44:37.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.296+0000 7fd83ae1a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd8340b81c0 0x7fd8340bab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:37.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.296+0000 7fd83ae1a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd8340ba1d0 0x7fd8340b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:37.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.296+0000 7fd83ae1a700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8340bd990 con 0x7fd8340b9340 2023-07-19T20:44:37.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.296+0000 7fd83ae1a700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8340b9760 con 0x7fd8340b81c0 2023-07-19T20:44:37.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.296+0000 7fd83ae1a700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8340bcdd0 con 0x7fd8340ba1d0 2023-07-19T20:44:37.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.296+0000 7fd838bb6700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd8340b81c0 0x7fd8340bab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:37.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.296+0000 7fd838bb6700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd8340b81c0 0x7fd8340bab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35868/0 (socket says 172.21.15.117:35868) 2023-07-19T20:44:37.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.296+0000 7fd838bb6700 1 -- 172.21.15.117:0/1175128381 learned_addr learned my addr 172.21.15.117:0/1175128381 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:37.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.296+0000 7fd833fff700 1 --2- 172.21.15.117:0/1175128381 >> v2:172.21.15.124:3300/0 conn(0x7fd8340ba1d0 0x7fd8340b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:37.292 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.296+0000 7fd838bb6700 1 -- 172.21.15.117:0/1175128381 >> v2:172.21.15.124:3300/0 conn(0x7fd8340ba1d0 msgr2=0x7fd8340b8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:37.292 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.296+0000 7fd838bb6700 1 --2- 172.21.15.117:0/1175128381 >> v2:172.21.15.124:3300/0 conn(0x7fd8340ba1d0 0x7fd8340b8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:37.292 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.296+0000 7fd838bb6700 1 -- 172.21.15.117:0/1175128381 >> v1:172.21.15.124:6789/0 conn(0x7fd8340b9340 legacy=0x7fd834147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:37.292 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.296+0000 7fd838bb6700 1 -- 172.21.15.117:0/1175128381 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340bd2c0 con 0x7fd8340b81c0 2023-07-19T20:44:37.292 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.296+0000 7fd838bb6700 1 --2- 172.21.15.117:0/1175128381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8340b81c0 0x7fd8340bab40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd8340be4d0 tx=0x7fd828009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4484723994e80e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:37.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.297+0000 7fd8337fe700 1 -- 172.21.15.117:0/1175128381 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82800b870 con 0x7fd8340b81c0 2023-07-19T20:44:37.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.297+0000 7fd8337fe700 1 -- 172.21.15.117:0/1175128381 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82800b9d0 con 0x7fd8340b81c0 2023-07-19T20:44:37.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.297+0000 7fd8337fe700 1 -- 172.21.15.117:0/1175128381 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82800bd60 con 0x7fd8340b81c0 2023-07-19T20:44:37.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.297+0000 7fd83ae1a700 1 -- 172.21.15.117:0/1175128381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8340b81c0 msgr2=0x7fd8340bab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:37.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.297+0000 7fd83ae1a700 1 --2- 172.21.15.117:0/1175128381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8340b81c0 0x7fd8340bab40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd8340be4d0 tx=0x7fd828009bd0 comp rx=0 tx=0).stop 2023-07-19T20:44:37.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.297+0000 7fd83ae1a700 1 -- 172.21.15.117:0/1175128381 shutdown_connections 2023-07-19T20:44:37.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.297+0000 7fd83ae1a700 1 --2- 172.21.15.117:0/1175128381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8340b81c0 0x7fd8340bab40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:37.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.297+0000 7fd83ae1a700 1 --2- 172.21.15.117:0/1175128381 >> v2:172.21.15.124:3300/0 conn(0x7fd8340ba1d0 0x7fd8340b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:37.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.297+0000 7fd83ae1a700 1 -- 172.21.15.117:0/1175128381 >> 172.21.15.117:0/1175128381 conn(0x7fd834071c90 msgr2=0x7fd834072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:37.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.297+0000 7fd83ae1a700 1 -- 172.21.15.117:0/1175128381 shutdown_connections 2023-07-19T20:44:37.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.297+0000 7fd83ae1a700 1 -- 172.21.15.117:0/1175128381 wait complete. 2023-07-19T20:44:37.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.298+0000 7fd83ae1a700 1 Processor -- start 2023-07-19T20:44:37.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.298+0000 7fd83ae1a700 1 -- start start 2023-07-19T20:44:37.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd83ae1a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8340b81c0 0x7fd8340bec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:37.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd83ae1a700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd8340b9340 0x7fd8340bf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:37.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd83ae1a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8340ba1d0 0x7fd8341d52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:37.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd83ae1a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8341453f0 con 0x7fd8340ba1d0 2023-07-19T20:44:37.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd83ae1a700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340c0560 con 0x7fd8340b81c0 2023-07-19T20:44:37.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd83ae1a700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340bfe90 con 0x7fd8340b9340 2023-07-19T20:44:37.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd8393b7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8340ba1d0 0x7fd8341d52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:37.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd8393b7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8340ba1d0 0x7fd8341d52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35880/0 (socket says 172.21.15.117:35880) 2023-07-19T20:44:37.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd8393b7700 1 -- 172.21.15.117:0/885624046 learned_addr learned my addr 172.21.15.117:0/885624046 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:37.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd838bb6700 1 --2- 172.21.15.117:0/885624046 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8340b81c0 0x7fd8340bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:37.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd833fff700 1 --2- 172.21.15.117:0/885624046 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd8340b9340 0x7fd8340bf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:37.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd8393b7700 1 -- 172.21.15.117:0/885624046 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd8340b9340 msgr2=0x7fd8340bf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:37.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd8393b7700 1 --2- 172.21.15.117:0/885624046 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd8340b9340 0x7fd8340bf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:37.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd8393b7700 1 -- 172.21.15.117:0/885624046 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8340b81c0 msgr2=0x7fd8340bec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:37.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd8393b7700 1 --2- 172.21.15.117:0/885624046 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8340b81c0 0x7fd8340bec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:37.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.299+0000 7fd8393b7700 1 -- 172.21.15.117:0/885624046 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd828009550 con 0x7fd8340ba1d0 2023-07-19T20:44:37.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.300+0000 7fd8393b7700 1 --2- 172.21.15.117:0/885624046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8340ba1d0 0x7fd8341d52c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00cc50 tx=0x7fd82c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:37.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.300+0000 7fd8317fa700 1 -- 172.21.15.117:0/885624046 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c003c00 con 0x7fd8340ba1d0 2023-07-19T20:44:37.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.300+0000 7fd8317fa700 1 -- 172.21.15.117:0/885624046 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c003d60 con 0x7fd8340ba1d0 2023-07-19T20:44:37.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.300+0000 7fd83ae1a700 1 -- 172.21.15.117:0/885624046 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd834145660 con 0x7fd8340ba1d0 2023-07-19T20:44:37.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.300+0000 7fd8317fa700 1 -- 172.21.15.117:0/885624046 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00aab0 con 0x7fd8340ba1d0 2023-07-19T20:44:37.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.300+0000 7fd83ae1a700 1 -- 172.21.15.117:0/885624046 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8341d7110 con 0x7fd8340ba1d0 2023-07-19T20:44:37.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.301+0000 7fd83ae1a700 1 -- 172.21.15.117:0/885624046 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8340b9c50 con 0x7fd8340ba1d0 2023-07-19T20:44:37.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.301+0000 7fd8317fa700 1 -- 172.21.15.117:0/885624046 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fd82c00ac10 con 0x7fd8340ba1d0 2023-07-19T20:44:37.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.301+0000 7fd8317fa700 1 --2- 172.21.15.117:0/885624046 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd81806a690 0x7fd81806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:37.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.302+0000 7fd8317fa700 1 -- 172.21.15.117:0/885624046 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fd82c088800 con 0x7fd8340ba1d0 2023-07-19T20:44:37.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.302+0000 7fd838bb6700 1 --2- 172.21.15.117:0/885624046 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd81806a690 0x7fd81806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:37.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.302+0000 7fd838bb6700 1 --2- 172.21.15.117:0/885624046 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd81806a690 0x7fd81806cb40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd828000c00 tx=0x7fd828008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:37.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.306+0000 7fd8317fa700 1 -- 172.21.15.117:0/885624046 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fd82c053de0 con 0x7fd8340ba1d0 2023-07-19T20:44:37.485 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:37.491+0000 7fd83ae1a700 1 -- 172.21.15.117:0/885624046 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd834145b80 con 0x7fd8340ba1d0 2023-07-19T20:44:38.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.151+0000 7fd8317fa700 1 -- 172.21.15.117:0/885624046 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd834145b80 con 0x7fd8340ba1d0 2023-07-19T20:44:38.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.159+0000 7fd83ae1a700 1 -- 172.21.15.117:0/885624046 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd81806a690 msgr2=0x7fd81806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:38.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.159+0000 7fd83ae1a700 1 --2- 172.21.15.117:0/885624046 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd81806a690 0x7fd81806cb40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd828000c00 tx=0x7fd828008030 comp rx=0 tx=0).stop 2023-07-19T20:44:38.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.159+0000 7fd83ae1a700 1 -- 172.21.15.117:0/885624046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8340ba1d0 msgr2=0x7fd8341d52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:38.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.159+0000 7fd83ae1a700 1 --2- 172.21.15.117:0/885624046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8340ba1d0 0x7fd8341d52c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00cc50 tx=0x7fd82c00cf60 comp rx=0 tx=0).stop 2023-07-19T20:44:38.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.160+0000 7fd83ae1a700 1 -- 172.21.15.117:0/885624046 shutdown_connections 2023-07-19T20:44:38.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.160+0000 7fd83ae1a700 1 --2- 172.21.15.117:0/885624046 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd81806a690 0x7fd81806cb40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.160+0000 7fd83ae1a700 1 --2- 172.21.15.117:0/885624046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8340ba1d0 0x7fd8341d52c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.160+0000 7fd83ae1a700 1 --2- 172.21.15.117:0/885624046 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8340b81c0 0x7fd8340bec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.160+0000 7fd83ae1a700 1 --2- 172.21.15.117:0/885624046 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd8340b9340 0x7fd8340bf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.160+0000 7fd83ae1a700 1 -- 172.21.15.117:0/885624046 >> 172.21.15.117:0/885624046 conn(0x7fd834071c90 msgr2=0x7fd834145e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:38.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.160+0000 7fd83ae1a700 1 -- 172.21.15.117:0/885624046 shutdown_connections 2023-07-19T20:44:38.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.160+0000 7fd83ae1a700 1 -- 172.21.15.117:0/885624046 wait complete. 2023-07-19T20:44:38.157 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_data' created 2023-07-19T20:44:38.170 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-19T20:44:38.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.308+0000 7fedb35e1700 1 Processor -- start 2023-07-19T20:44:38.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.308+0000 7fedb35e1700 1 -- start start 2023-07-19T20:44:38.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.309+0000 7fedb35e1700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fedac141070 0x7fedac148150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:38.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.309+0000 7fedb35e1700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fedac0b2500 0x7fedac1515e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:38.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.309+0000 7fedb35e1700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac14b1e0 con 0x7fedac14ad90 2023-07-19T20:44:38.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.309+0000 7fedb35e1700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedac06bc80 con 0x7fedac0b2500 2023-07-19T20:44:38.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.309+0000 7fedb35e1700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac141440 con 0x7fedac141070 2023-07-19T20:44:38.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.309+0000 7fedb1b7e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fedac0b2500 0x7fedac1515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:38.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.309+0000 7fedb0b7c700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fedac14ad90 0x7fedac06b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:53180/0 (socket says 172.21.15.117:53180) 2023-07-19T20:44:38.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.309+0000 7fedb0b7c700 1 -- 172.21.15.117:0/3713799427 learned_addr learned my addr 172.21.15.117:0/3713799427 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:38.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.310+0000 7fedb137d700 1 --2- 172.21.15.117:0/3713799427 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fedac141070 0x7fedac148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:38.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.310+0000 7fedb1b7e700 1 -- 172.21.15.117:0/3713799427 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fedac141070 msgr2=0x7fedac148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:38.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.310+0000 7fedb1b7e700 1 --2- 172.21.15.117:0/3713799427 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fedac141070 0x7fedac148150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.310+0000 7fedb1b7e700 1 -- 172.21.15.117:0/3713799427 >> v1:172.21.15.117:6789/0 conn(0x7fedac14ad90 legacy=0x7fedac06b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:38.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.310+0000 7fedb1b7e700 1 -- 172.21.15.117:0/3713799427 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac14a2f0 con 0x7fedac0b2500 2023-07-19T20:44:38.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.310+0000 7fedb137d700 1 --2- 172.21.15.117:0/3713799427 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fedac141070 0x7fedac148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:38.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.310+0000 7fedb1b7e700 1 --2- 172.21.15.117:0/3713799427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedac0b2500 0x7fedac1515e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feda4009840 tx=0x7feda4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32634116db004ca2 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:38.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.310+0000 7feda3fff700 1 -- 172.21.15.117:0/3713799427 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda4010800 con 0x7fedac0b2500 2023-07-19T20:44:38.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.310+0000 7feda3fff700 1 -- 172.21.15.117:0/3713799427 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda4010960 con 0x7fedac0b2500 2023-07-19T20:44:38.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.310+0000 7feda3fff700 1 -- 172.21.15.117:0/3713799427 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda4010cf0 con 0x7fedac0b2500 2023-07-19T20:44:38.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.311+0000 7fedb35e1700 1 -- 172.21.15.117:0/3713799427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedac0b2500 msgr2=0x7fedac1515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:38.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.311+0000 7fedb35e1700 1 --2- 172.21.15.117:0/3713799427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedac0b2500 0x7fedac1515e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feda4009840 tx=0x7feda4009b50 comp rx=0 tx=0).stop 2023-07-19T20:44:38.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.311+0000 7fedb35e1700 1 -- 172.21.15.117:0/3713799427 shutdown_connections 2023-07-19T20:44:38.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.311+0000 7fedb35e1700 1 --2- 172.21.15.117:0/3713799427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedac0b2500 0x7fedac1515e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.311+0000 7fedb35e1700 1 --2- 172.21.15.117:0/3713799427 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fedac141070 0x7fedac148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.311+0000 7fedb35e1700 1 -- 172.21.15.117:0/3713799427 >> 172.21.15.117:0/3713799427 conn(0x7fedac0bdc50 msgr2=0x7fedac06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:38.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.311+0000 7fedb35e1700 1 -- 172.21.15.117:0/3713799427 shutdown_connections 2023-07-19T20:44:38.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.311+0000 7fedb35e1700 1 -- 172.21.15.117:0/3713799427 wait complete. 2023-07-19T20:44:38.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.312+0000 7fedb35e1700 1 Processor -- start 2023-07-19T20:44:38.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.312+0000 7fedb35e1700 1 -- start start 2023-07-19T20:44:38.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.312+0000 7fedb35e1700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fedac0b2500 0x7fedac06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:38.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.312+0000 7fedb35e1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedac141070 0x7fedac0bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:38.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.312+0000 7fedb35e1700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fedac14ad90 0x7fedac0b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:38.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.312+0000 7fedb35e1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac06ae10 con 0x7fedac141070 2023-07-19T20:44:38.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.312+0000 7fedb35e1700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0bca20 con 0x7fedac14ad90 2023-07-19T20:44:38.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.312+0000 7fedb35e1700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0bba90 con 0x7fedac0b2500 2023-07-19T20:44:38.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.312+0000 7fedb0b7c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedac141070 0x7fedac0bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:38.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.312+0000 7fedb0b7c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedac141070 0x7fedac0bc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35896/0 (socket says 172.21.15.117:35896) 2023-07-19T20:44:38.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.312+0000 7fedb0b7c700 1 -- 172.21.15.117:0/1205215514 learned_addr learned my addr 172.21.15.117:0/1205215514 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:38.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.313+0000 7fedb137d700 1 --2- 172.21.15.117:0/1205215514 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fedac0b2500 0x7fedac06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:38.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.313+0000 7fedb1b7e700 1 --2- 172.21.15.117:0/1205215514 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fedac14ad90 0x7fedac0b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:38.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.313+0000 7fedb0b7c700 1 -- 172.21.15.117:0/1205215514 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fedac0b2500 msgr2=0x7fedac06a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:38.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.313+0000 7fedb0b7c700 1 --2- 172.21.15.117:0/1205215514 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fedac0b2500 0x7fedac06a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.313+0000 7fedb0b7c700 1 -- 172.21.15.117:0/1205215514 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fedac14ad90 msgr2=0x7fedac0b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:38.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.313+0000 7fedb0b7c700 1 --2- 172.21.15.117:0/1205215514 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fedac14ad90 0x7fedac0b7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.313+0000 7fedb0b7c700 1 -- 172.21.15.117:0/1205215514 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40094a0 con 0x7fedac141070 2023-07-19T20:44:38.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.313+0000 7fedb0b7c700 1 --2- 172.21.15.117:0/1205215514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedac141070 0x7fedac0bc4e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00e940 tx=0x7fed9c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:38.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.313+0000 7feda1ffb700 1 -- 172.21.15.117:0/1205215514 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c005b40 con 0x7fedac141070 2023-07-19T20:44:38.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.313+0000 7feda1ffb700 1 -- 172.21.15.117:0/1205215514 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c005ca0 con 0x7fedac141070 2023-07-19T20:44:38.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.313+0000 7fedb35e1700 1 -- 172.21.15.117:0/1205215514 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac0b80f0 con 0x7fedac141070 2023-07-19T20:44:38.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.313+0000 7feda1ffb700 1 -- 172.21.15.117:0/1205215514 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c001810 con 0x7fedac141070 2023-07-19T20:44:38.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.313+0000 7fedb35e1700 1 -- 172.21.15.117:0/1205215514 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac0bbce0 con 0x7fedac141070 2023-07-19T20:44:38.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.314+0000 7fedb35e1700 1 -- 172.21.15.117:0/1205215514 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac0b8580 con 0x7fedac141070 2023-07-19T20:44:38.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.315+0000 7feda1ffb700 1 -- 172.21.15.117:0/1205215514 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fed9c001970 con 0x7fedac141070 2023-07-19T20:44:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.315+0000 7feda1ffb700 1 --2- 172.21.15.117:0/1205215514 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fed9006a660 0x7fed9006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.315+0000 7fedb137d700 1 --2- 172.21.15.117:0/1205215514 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fed9006a660 0x7fed9006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.315+0000 7feda1ffb700 1 -- 172.21.15.117:0/1205215514 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fed9c08a9b0 con 0x7fedac141070 2023-07-19T20:44:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.315+0000 7fedb137d700 1 --2- 172.21.15.117:0/1205215514 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fed9006a660 0x7fed9006cb10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feda8003c10 tx=0x7feda8009910 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.320+0000 7feda1ffb700 1 -- 172.21.15.117:0/1205215514 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fed9c055ea0 con 0x7fedac141070 2023-07-19T20:44:38.540 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.546+0000 7fedb35e1700 1 -- 172.21.15.117:0/1205215514 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fedac14b1e0 con 0x7fedac141070 2023-07-19T20:44:38.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.552+0000 7feda1ffb700 1 -- 172.21.15.117:0/1205215514 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fedac14b1e0 con 0x7fedac141070 2023-07-19T20:44:38.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.556+0000 7fedb35e1700 1 -- 172.21.15.117:0/1205215514 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fed9006a660 msgr2=0x7fed9006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:38.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.556+0000 7fedb35e1700 1 --2- 172.21.15.117:0/1205215514 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fed9006a660 0x7fed9006cb10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feda8003c10 tx=0x7feda8009910 comp rx=0 tx=0).stop 2023-07-19T20:44:38.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.556+0000 7fedb35e1700 1 -- 172.21.15.117:0/1205215514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedac141070 msgr2=0x7fedac0bc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:38.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.556+0000 7fedb35e1700 1 --2- 172.21.15.117:0/1205215514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedac141070 0x7fedac0bc4e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00e940 tx=0x7fed9c00ec50 comp rx=0 tx=0).stop 2023-07-19T20:44:38.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.556+0000 7fedb35e1700 1 -- 172.21.15.117:0/1205215514 shutdown_connections 2023-07-19T20:44:38.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.556+0000 7fedb35e1700 1 --2- 172.21.15.117:0/1205215514 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fed9006a660 0x7fed9006cb10 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feda8003c10 tx=0x7feda8009910 comp rx=0 tx=0).stop 2023-07-19T20:44:38.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.556+0000 7fedb35e1700 1 --2- 172.21.15.117:0/1205215514 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fedac14ad90 0x7fedac0b7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.556+0000 7fedb35e1700 1 --2- 172.21.15.117:0/1205215514 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fedac0b2500 0x7fedac06a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.556+0000 7fedb35e1700 1 --2- 172.21.15.117:0/1205215514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedac141070 0x7fedac0bc4e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.556+0000 7fedb35e1700 1 -- 172.21.15.117:0/1205215514 >> 172.21.15.117:0/1205215514 conn(0x7fedac0bdc50 msgr2=0x7fedac0b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:38.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.557+0000 7fedb35e1700 1 -- 172.21.15.117:0/1205215514 shutdown_connections 2023-07-19T20:44:38.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.557+0000 7fedb35e1700 1 -- 172.21.15.117:0/1205215514 wait complete. 2023-07-19T20:44:38.552 INFO:teuthology.orchestra.run.smithi117.stderr:new fs with metadata pool 3 and data pool 4 2023-07-19T20:44:38.573 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:38.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.701+0000 7fe5bb076700 1 Processor -- start 2023-07-19T20:44:38.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.701+0000 7fe5bb076700 1 -- start start 2023-07-19T20:44:38.697 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.701+0000 7fe5bb076700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5b4071be0 0x7fe5b40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:38.697 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.701+0000 7fe5bb076700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe5b40b8da0 0x7fe5b40b9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:38.697 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.701+0000 7fe5bb076700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b40729d0 con 0x7fe5b40bacb0 2023-07-19T20:44:38.697 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.701+0000 7fe5bb076700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b40715e0 con 0x7fe5b40b8da0 2023-07-19T20:44:38.697 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.701+0000 7fe5bb076700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b40717c0 con 0x7fe5b4071be0 2023-07-19T20:44:38.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.702+0000 7fe5b9613700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe5b40b8da0 0x7fe5b40b9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:38.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.702+0000 7fe5b3fff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5b4071be0 0x7fe5b40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:38.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.702+0000 7fe5b8e12700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fe5b40bacb0 0x7fe5b41446a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.117:58700/0 (socket says 172.21.15.117:58700) 2023-07-19T20:44:38.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.702+0000 7fe5b8e12700 1 -- 172.21.15.117:0/3296310471 learned_addr learned my addr 172.21.15.117:0/3296310471 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:38.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.702+0000 7fe5b9613700 1 -- 172.21.15.117:0/3296310471 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5b4071be0 msgr2=0x7fe5b40702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:38.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.702+0000 7fe5b9613700 1 --2- 172.21.15.117:0/3296310471 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5b4071be0 0x7fe5b40702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.702+0000 7fe5b9613700 1 -- 172.21.15.117:0/3296310471 >> v1:172.21.15.124:6789/0 conn(0x7fe5b40bacb0 legacy=0x7fe5b41446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:38.699 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.702+0000 7fe5b9613700 1 -- 172.21.15.117:0/3296310471 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b40b9740 con 0x7fe5b40b8da0 2023-07-19T20:44:38.699 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.702+0000 7fe5b9613700 1 --2- 172.21.15.117:0/3296310471 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5b40b8da0 0x7fe5b40b9200 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009d90 tx=0x7fe5ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15c7adfcf9c11a20 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:38.699 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.702+0000 7fe5b37fe700 1 -- 172.21.15.117:0/3296310471 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac00e070 con 0x7fe5b40b8da0 2023-07-19T20:44:38.699 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.702+0000 7fe5b37fe700 1 -- 172.21.15.117:0/3296310471 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac00bb20 con 0x7fe5b40b8da0 2023-07-19T20:44:38.699 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.702+0000 7fe5b37fe700 1 -- 172.21.15.117:0/3296310471 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac012430 con 0x7fe5b40b8da0 2023-07-19T20:44:38.699 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.703+0000 7fe5bb076700 1 -- 172.21.15.117:0/3296310471 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5b40b8da0 msgr2=0x7fe5b40b9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:38.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.703+0000 7fe5bb076700 1 --2- 172.21.15.117:0/3296310471 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5b40b8da0 0x7fe5b40b9200 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009d90 tx=0x7fe5ac00b330 comp rx=0 tx=0).stop 2023-07-19T20:44:38.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.703+0000 7fe5bb076700 1 -- 172.21.15.117:0/3296310471 shutdown_connections 2023-07-19T20:44:38.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.703+0000 7fe5bb076700 1 --2- 172.21.15.117:0/3296310471 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5b40b8da0 0x7fe5b40b9200 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.703+0000 7fe5bb076700 1 --2- 172.21.15.117:0/3296310471 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5b4071be0 0x7fe5b40702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.703+0000 7fe5bb076700 1 -- 172.21.15.117:0/3296310471 >> 172.21.15.117:0/3296310471 conn(0x7fe5b40be4b0 msgr2=0x7fe5b40ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:38.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.703+0000 7fe5bb076700 1 -- 172.21.15.117:0/3296310471 shutdown_connections 2023-07-19T20:44:38.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.703+0000 7fe5bb076700 1 -- 172.21.15.117:0/3296310471 wait complete. 2023-07-19T20:44:38.702 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.704+0000 7fe5bb076700 1 Processor -- start 2023-07-19T20:44:38.702 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.704+0000 7fe5bb076700 1 -- start start 2023-07-19T20:44:38.703 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.704+0000 7fe5bb076700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5b4071be0 0x7fe5b40bcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:38.703 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.704+0000 7fe5bb076700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b40b8da0 0x7fe5b40b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:38.703 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.704+0000 7fe5bb076700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5b40bacb0 0x7fe5b41e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:38.703 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.704+0000 7fe5bb076700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b40b60c0 con 0x7fe5b40b8da0 2023-07-19T20:44:38.703 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5bb076700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b40bd320 con 0x7fe5b4071be0 2023-07-19T20:44:38.703 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5bb076700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b40b6bd0 con 0x7fe5b40bacb0 2023-07-19T20:44:38.703 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5b3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b40b8da0 0x7fe5b40b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:38.704 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5b3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b40b8da0 0x7fe5b40b73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35910/0 (socket says 172.21.15.117:35910) 2023-07-19T20:44:38.704 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5b3fff700 1 -- 172.21.15.117:0/2112277993 learned_addr learned my addr 172.21.15.117:0/2112277993 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:38.705 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5b8e12700 1 --2- 172.21.15.117:0/2112277993 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5b4071be0 0x7fe5b40bcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:38.705 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5b9613700 1 --2- 172.21.15.117:0/2112277993 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5b40bacb0 0x7fe5b41e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:38.705 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5b3fff700 1 -- 172.21.15.117:0/2112277993 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5b40bacb0 msgr2=0x7fe5b41e3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:38.705 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5b3fff700 1 --2- 172.21.15.117:0/2112277993 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5b40bacb0 0x7fe5b41e3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.706 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5b3fff700 1 -- 172.21.15.117:0/2112277993 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5b4071be0 msgr2=0x7fe5b40bcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:38.706 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5b3fff700 1 --2- 172.21.15.117:0/2112277993 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5b4071be0 0x7fe5b40bcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.706 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5b3fff700 1 -- 172.21.15.117:0/2112277993 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac009a70 con 0x7fe5b40b8da0 2023-07-19T20:44:38.706 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5b3fff700 1 --2- 172.21.15.117:0/2112277993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b40b8da0 0x7fe5b40b73b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00e9b0 tx=0x7fe59c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:38.706 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5b17fa700 1 -- 172.21.15.117:0/2112277993 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c009710 con 0x7fe5b40b8da0 2023-07-19T20:44:38.707 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5b17fa700 1 -- 172.21.15.117:0/2112277993 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c00ee50 con 0x7fe5b40b8da0 2023-07-19T20:44:38.707 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5bb076700 1 -- 172.21.15.117:0/2112277993 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b40b7950 con 0x7fe5b40b8da0 2023-07-19T20:44:38.707 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5b17fa700 1 -- 172.21.15.117:0/2112277993 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00ca70 con 0x7fe5b40b8da0 2023-07-19T20:44:38.707 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.705+0000 7fe5bb076700 1 -- 172.21.15.117:0/2112277993 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b40b6580 con 0x7fe5b40b8da0 2023-07-19T20:44:38.707 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.706+0000 7fe5bb076700 1 -- 172.21.15.117:0/2112277993 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b4067940 con 0x7fe5b40b8da0 2023-07-19T20:44:38.707 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.707+0000 7fe5b17fa700 1 -- 172.21.15.117:0/2112277993 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fe59c00cbd0 con 0x7fe5b40b8da0 2023-07-19T20:44:38.708 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.707+0000 7fe5b17fa700 1 --2- 172.21.15.117:0/2112277993 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe59406a660 0x7fe59406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:38.708 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.707+0000 7fe5b8e12700 1 --2- 172.21.15.117:0/2112277993 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe59406a660 0x7fe59406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:38.708 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.707+0000 7fe5b17fa700 1 -- 172.21.15.117:0/2112277993 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe59c088d60 con 0x7fe5b40b8da0 2023-07-19T20:44:38.708 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.707+0000 7fe5b8e12700 1 --2- 172.21.15.117:0/2112277993 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe59406a660 0x7fe59406cb10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4005910 tx=0x7fe5a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:38.709 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.711+0000 7fe5b17fa700 1 -- 172.21.15.117:0/2112277993 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fe59c057be0 con 0x7fe5b40b8da0 2023-07-19T20:44:38.891 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.897+0000 7fe5bb076700 1 -- 172.21.15.117:0/2112277993 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5b40b6d10 con 0x7fe5b40b8da0 2023-07-19T20:44:38.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.899+0000 7fe5b17fa700 1 -- 172.21.15.117:0/2112277993 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17910 (secure 0 0 0) 0x7fe5b40b6d10 con 0x7fe5b40b8da0 2023-07-19T20:44:38.894 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:38.894 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":21,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:38.547641+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:38.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.900+0000 7fe5bb076700 1 -- 172.21.15.117:0/2112277993 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe59406a660 msgr2=0x7fe59406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:38.897 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.901+0000 7fe5bb076700 1 --2- 172.21.15.117:0/2112277993 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe59406a660 0x7fe59406cb10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4005910 tx=0x7fe5a4009040 comp rx=0 tx=0).stop 2023-07-19T20:44:38.898 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.901+0000 7fe5bb076700 1 -- 172.21.15.117:0/2112277993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b40b8da0 msgr2=0x7fe5b40b73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:38.898 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.901+0000 7fe5bb076700 1 --2- 172.21.15.117:0/2112277993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b40b8da0 0x7fe5b40b73b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00e9b0 tx=0x7fe59c00ecc0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.899 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.901+0000 7fe5bb076700 1 -- 172.21.15.117:0/2112277993 shutdown_connections 2023-07-19T20:44:38.899 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.901+0000 7fe5bb076700 1 --2- 172.21.15.117:0/2112277993 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe59406a660 0x7fe59406cb10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.899 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.901+0000 7fe5bb076700 1 --2- 172.21.15.117:0/2112277993 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5b40bacb0 0x7fe5b41e3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.899 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.901+0000 7fe5bb076700 1 --2- 172.21.15.117:0/2112277993 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5b4071be0 0x7fe5b40bcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.900 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.901+0000 7fe5bb076700 1 --2- 172.21.15.117:0/2112277993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b40b8da0 0x7fe5b40b73b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:38.900 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.901+0000 7fe5bb076700 1 -- 172.21.15.117:0/2112277993 >> 172.21.15.117:0/2112277993 conn(0x7fe5b40be4b0 msgr2=0x7fe5b41425e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:38.900 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.901+0000 7fe5bb076700 1 -- 172.21.15.117:0/2112277993 shutdown_connections 2023-07-19T20:44:38.900 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:38.901+0000 7fe5bb076700 1 -- 172.21.15.117:0/2112277993 wait complete. 2023-07-19T20:44:38.909 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:39.036 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.039+0000 7f2b2e985700 1 Processor -- start 2023-07-19T20:44:39.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.039+0000 7f2b2e985700 1 -- start start 2023-07-19T20:44:39.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.040+0000 7f2b2e985700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2b2806fe50 0x7f2b2814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:39.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.040+0000 7f2b2e985700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b280721e0 con 0x7f2b28144e00 2023-07-19T20:44:39.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.040+0000 7f2b2e985700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2806bc80 con 0x7f2b2814b120 2023-07-19T20:44:39.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.040+0000 7f2b2e985700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2814b560 con 0x7f2b2806fe50 2023-07-19T20:44:39.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.040+0000 7f2b277fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2b2806fe50 0x7f2b2814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:39.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.040+0000 7f2b27fff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f2b28144e00 0x7f2b2806b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:53194/0 (socket says 172.21.15.117:53194) 2023-07-19T20:44:39.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.040+0000 7f2b27fff700 1 -- 172.21.15.117:0/3837689766 learned_addr learned my addr 172.21.15.117:0/3837689766 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:39.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.040+0000 7f2b277fe700 1 -- 172.21.15.117:0/3837689766 >> v1:172.21.15.124:6789/0 conn(0x7f2b2814b120 legacy=0x7f2b28155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:39.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.040+0000 7f2b277fe700 1 -- 172.21.15.117:0/3837689766 >> v1:172.21.15.117:6789/0 conn(0x7f2b28144e00 legacy=0x7f2b2806b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:39.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.041+0000 7f2b277fe700 1 -- 172.21.15.117:0/3837689766 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b280718b0 con 0x7f2b2806fe50 2023-07-19T20:44:39.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.040+0000 7f2b26ffd700 1 -- 172.21.15.117:0/3837689766 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797797920 0 0) 0x7f2b280721e0 con 0x7f2b28144e00 2023-07-19T20:44:39.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.041+0000 7f2b277fe700 1 --2- 172.21.15.117:0/3837689766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b2806fe50 0x7f2b2814abe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009840 tx=0x7f2b10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cf614200b843bf server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:39.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.041+0000 7f2b26ffd700 1 -- 172.21.15.117:0/3837689766 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10011830 con 0x7f2b2806fe50 2023-07-19T20:44:39.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.041+0000 7f2b26ffd700 1 -- 172.21.15.117:0/3837689766 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b10011990 con 0x7f2b2806fe50 2023-07-19T20:44:39.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.041+0000 7f2b26ffd700 1 -- 172.21.15.117:0/3837689766 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10011d20 con 0x7f2b2806fe50 2023-07-19T20:44:39.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.041+0000 7f2b2e985700 1 -- 172.21.15.117:0/3837689766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b2806fe50 msgr2=0x7f2b2814abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:39.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.041+0000 7f2b2e985700 1 --2- 172.21.15.117:0/3837689766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b2806fe50 0x7f2b2814abe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009840 tx=0x7f2b10009b50 comp rx=0 tx=0).stop 2023-07-19T20:44:39.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.041+0000 7f2b2e985700 1 -- 172.21.15.117:0/3837689766 shutdown_connections 2023-07-19T20:44:39.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.041+0000 7f2b2e985700 1 --2- 172.21.15.117:0/3837689766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b2806fe50 0x7f2b2814abe0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:39.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.041+0000 7f2b2e985700 1 -- 172.21.15.117:0/3837689766 >> 172.21.15.117:0/3837689766 conn(0x7f2b280bdc00 msgr2=0x7f2b280b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:39.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.041+0000 7f2b2e985700 1 -- 172.21.15.117:0/3837689766 shutdown_connections 2023-07-19T20:44:39.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.041+0000 7f2b2e985700 1 -- 172.21.15.117:0/3837689766 wait complete. 2023-07-19T20:44:39.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.042+0000 7f2b2e985700 1 Processor -- start 2023-07-19T20:44:39.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.043+0000 7f2b2e985700 1 -- start start 2023-07-19T20:44:39.042 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.043+0000 7f2b2e985700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b2806fe50 0x7f2b280b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:39.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.043+0000 7f2b2e985700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2b28144e00 0x7f2b281d70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:39.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.043+0000 7f2b2e985700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b2814b120 0x7f2b281d7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:39.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.043+0000 7f2b2e985700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b281d58c0 con 0x7f2b2814b120 2023-07-19T20:44:39.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.043+0000 7f2b2e985700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280b7220 con 0x7f2b2806fe50 2023-07-19T20:44:39.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.043+0000 7f2b2e985700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280bc860 con 0x7f2b28144e00 2023-07-19T20:44:39.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.043+0000 7f2b2cf22700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b2814b120 0x7f2b281d7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:39.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.043+0000 7f2b2cf22700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b2814b120 0x7f2b281d7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35914/0 (socket says 172.21.15.117:35914) 2023-07-19T20:44:39.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.043+0000 7f2b2cf22700 1 -- 172.21.15.117:0/1742367581 learned_addr learned my addr 172.21.15.117:0/1742367581 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:39.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.043+0000 7f2b27fff700 1 --2- 172.21.15.117:0/1742367581 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b2806fe50 0x7f2b280b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:39.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.043+0000 7f2b277fe700 1 --2- 172.21.15.117:0/1742367581 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2b28144e00 0x7f2b281d70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:39.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.044+0000 7f2b2cf22700 1 -- 172.21.15.117:0/1742367581 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2b28144e00 msgr2=0x7f2b281d70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:39.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.044+0000 7f2b2cf22700 1 --2- 172.21.15.117:0/1742367581 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2b28144e00 0x7f2b281d70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:39.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.044+0000 7f2b2cf22700 1 -- 172.21.15.117:0/1742367581 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b2806fe50 msgr2=0x7f2b280b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:39.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.044+0000 7f2b2cf22700 1 --2- 172.21.15.117:0/1742367581 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b2806fe50 0x7f2b280b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:39.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.044+0000 7f2b2cf22700 1 -- 172.21.15.117:0/1742367581 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b100094a0 con 0x7f2b2814b120 2023-07-19T20:44:39.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.044+0000 7f2b2cf22700 1 --2- 172.21.15.117:0/1742367581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b2814b120 0x7f2b281d7610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000cc80 tx=0x7f2b2000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:39.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.044+0000 7f2b24ff9700 1 -- 172.21.15.117:0/1742367581 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b20003c00 con 0x7f2b2814b120 2023-07-19T20:44:39.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.044+0000 7f2b24ff9700 1 -- 172.21.15.117:0/1742367581 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b20003d60 con 0x7f2b2814b120 2023-07-19T20:44:39.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.044+0000 7f2b2e985700 1 -- 172.21.15.117:0/1742367581 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b281d5aa0 con 0x7f2b2814b120 2023-07-19T20:44:39.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.044+0000 7f2b24ff9700 1 -- 172.21.15.117:0/1742367581 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000aae0 con 0x7f2b2814b120 2023-07-19T20:44:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.044+0000 7f2b2e985700 1 -- 172.21.15.117:0/1742367581 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b281d6610 con 0x7f2b2814b120 2023-07-19T20:44:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.045+0000 7f2b2e985700 1 -- 172.21.15.117:0/1742367581 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b281d67a0 con 0x7f2b2814b120 2023-07-19T20:44:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.045+0000 7f2b24ff9700 1 -- 172.21.15.117:0/1742367581 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f2b2000ac40 con 0x7f2b2814b120 2023-07-19T20:44:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.046+0000 7f2b24ff9700 1 --2- 172.21.15.117:0/1742367581 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2b0806a660 0x7f2b0806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.046+0000 7f2b27fff700 1 --2- 172.21.15.117:0/1742367581 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2b0806a660 0x7f2b0806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.046+0000 7f2b24ff9700 1 -- 172.21.15.117:0/1742367581 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b20088ae0 con 0x7f2b2814b120 2023-07-19T20:44:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.046+0000 7f2b27fff700 1 --2- 172.21.15.117:0/1742367581 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2b0806a660 0x7f2b0806cb10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b18007b10 tx=0x7f2b18007a60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:39.047 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.050+0000 7f2b24ff9700 1 -- 172.21.15.117:0/1742367581 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2b281d67a0 con 0x7f2b2814b120 2023-07-19T20:44:39.230 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.236+0000 7f2b2e985700 1 -- 172.21.15.117:0/1742367581 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b281d67a0 con 0x7f2b2814b120 2023-07-19T20:44:39.231 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.237+0000 7f2b24ff9700 1 -- 172.21.15.117:0/1742367581 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17910 (secure 0 0 0) 0x7f2b281d67a0 con 0x7f2b2814b120 2023-07-19T20:44:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:39.232 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":21,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:38.547641+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:39.234 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.240+0000 7f2b2e985700 1 -- 172.21.15.117:0/1742367581 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2b0806a660 msgr2=0x7f2b0806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:39.234 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.240+0000 7f2b2e985700 1 --2- 172.21.15.117:0/1742367581 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2b0806a660 0x7f2b0806cb10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b18007b10 tx=0x7f2b18007a60 comp rx=0 tx=0).stop 2023-07-19T20:44:39.234 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.240+0000 7f2b2e985700 1 -- 172.21.15.117:0/1742367581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b2814b120 msgr2=0x7f2b281d7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:39.234 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.240+0000 7f2b2e985700 1 --2- 172.21.15.117:0/1742367581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b2814b120 0x7f2b281d7610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000cc80 tx=0x7f2b2000cf90 comp rx=0 tx=0).stop 2023-07-19T20:44:39.234 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.240+0000 7f2b2e985700 1 -- 172.21.15.117:0/1742367581 shutdown_connections 2023-07-19T20:44:39.234 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.240+0000 7f2b2e985700 1 --2- 172.21.15.117:0/1742367581 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2b0806a660 0x7f2b0806cb10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:39.234 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.240+0000 7f2b2e985700 1 --2- 172.21.15.117:0/1742367581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b2814b120 0x7f2b281d7610 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:39.235 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.240+0000 7f2b2e985700 1 --2- 172.21.15.117:0/1742367581 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b2806fe50 0x7f2b280b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:39.235 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.240+0000 7f2b2e985700 1 --2- 172.21.15.117:0/1742367581 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2b28144e00 0x7f2b281d70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:39.235 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.240+0000 7f2b2e985700 1 -- 172.21.15.117:0/1742367581 >> 172.21.15.117:0/1742367581 conn(0x7f2b280bdc00 msgr2=0x7f2b2806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:39.235 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.240+0000 7f2b2e985700 1 -- 172.21.15.117:0/1742367581 shutdown_connections 2023-07-19T20:44:39.235 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.240+0000 7f2b2e985700 1 -- 172.21.15.117:0/1742367581 wait complete. 2023-07-19T20:44:39.246 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-19T20:44:39.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.377+0000 7fcf2b6ab700 1 Processor -- start 2023-07-19T20:44:39.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.377+0000 7fcf2b6ab700 1 -- start start 2023-07-19T20:44:39.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.378+0000 7fcf2b6ab700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf24144b40 0x7fcf2406b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:39.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.378+0000 7fcf2b6ab700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fcf240b9680 0x7fcf2414a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:39.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.378+0000 7fcf2b6ab700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcf2414af20 0x7fcf2414de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:39.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.378+0000 7fcf2b6ab700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2414b3c0 con 0x7fcf2414af20 2023-07-19T20:44:39.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.378+0000 7fcf2b6ab700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2409e6b0 con 0x7fcf240b9680 2023-07-19T20:44:39.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.378+0000 7fcf2b6ab700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2409e360 con 0x7fcf24144b40 2023-07-19T20:44:39.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.378+0000 7fcf29c48700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcf2414af20 0x7fcf2414de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:39.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.378+0000 7fcf29c48700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcf2414af20 0x7fcf2414de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35918/0 (socket says 172.21.15.117:35918) 2023-07-19T20:44:39.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.378+0000 7fcf29c48700 1 -- 172.21.15.117:0/706705969 learned_addr learned my addr 172.21.15.117:0/706705969 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:39.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.378+0000 7fcf28c46700 1 --2- 172.21.15.117:0/706705969 >> v2:172.21.15.124:3300/0 conn(0x7fcf240b9680 0x7fcf2414a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:39.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.378+0000 7fcf29447700 1 --2- 172.21.15.117:0/706705969 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf24144b40 0x7fcf2406b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:39.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf29c48700 1 -- 172.21.15.117:0/706705969 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf24144b40 msgr2=0x7fcf2406b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:39.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf29c48700 1 --2- 172.21.15.117:0/706705969 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf24144b40 0x7fcf2406b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:39.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf29c48700 1 -- 172.21.15.117:0/706705969 >> v2:172.21.15.124:3300/0 conn(0x7fcf240b9680 msgr2=0x7fcf2414a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:39.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf29c48700 1 --2- 172.21.15.117:0/706705969 >> v2:172.21.15.124:3300/0 conn(0x7fcf240b9680 0x7fcf2414a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:39.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf29c48700 1 -- 172.21.15.117:0/706705969 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2409fa50 con 0x7fcf2414af20 2023-07-19T20:44:39.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf29c48700 1 --2- 172.21.15.117:0/706705969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf2414af20 0x7fcf2414de40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf2406bec0 tx=0x7fcf1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500422a33eecc4ca server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:39.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf1bfff700 1 -- 172.21.15.117:0/706705969 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c00e070 con 0x7fcf2414af20 2023-07-19T20:44:39.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf1bfff700 1 -- 172.21.15.117:0/706705969 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c00b980 con 0x7fcf2414af20 2023-07-19T20:44:39.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf1bfff700 1 -- 172.21.15.117:0/706705969 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c00bd30 con 0x7fcf2414af20 2023-07-19T20:44:39.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/706705969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf2414af20 msgr2=0x7fcf2414de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:39.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf2b6ab700 1 --2- 172.21.15.117:0/706705969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf2414af20 0x7fcf2414de40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf2406bec0 tx=0x7fcf1c00b330 comp rx=0 tx=0).stop 2023-07-19T20:44:39.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/706705969 shutdown_connections 2023-07-19T20:44:39.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf2b6ab700 1 --2- 172.21.15.117:0/706705969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf2414af20 0x7fcf2414de40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:39.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf2b6ab700 1 --2- 172.21.15.117:0/706705969 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf24144b40 0x7fcf2406b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:39.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf2b6ab700 1 --2- 172.21.15.117:0/706705969 >> v2:172.21.15.124:3300/0 conn(0x7fcf240b9680 0x7fcf2414a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:39.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.379+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/706705969 >> 172.21.15.117:0/706705969 conn(0x7fcf240bdc50 msgr2=0x7fcf2406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:39.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.380+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/706705969 shutdown_connections 2023-07-19T20:44:39.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.380+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/706705969 wait complete. 2023-07-19T20:44:39.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.381+0000 7fcf2b6ab700 1 Processor -- start 2023-07-19T20:44:39.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.381+0000 7fcf2b6ab700 1 -- start start 2023-07-19T20:44:39.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.381+0000 7fcf2b6ab700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf240b9680 0x7fcf240bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:39.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.381+0000 7fcf2b6ab700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcf24144b40 0x7fcf24071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:39.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.381+0000 7fcf2b6ab700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf2414af20 0x7fcf240a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:39.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.381+0000 7fcf2b6ab700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf240a2240 con 0x7fcf240b9680 2023-07-19T20:44:39.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.381+0000 7fcf2b6ab700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf240bcb10 con 0x7fcf24144b40 2023-07-19T20:44:39.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.381+0000 7fcf2b6ab700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf240a1fa0 con 0x7fcf2414af20 2023-07-19T20:44:39.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.381+0000 7fcf29447700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf240b9680 0x7fcf240bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:39.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.381+0000 7fcf29447700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf240b9680 0x7fcf240bc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35924/0 (socket says 172.21.15.117:35924) 2023-07-19T20:44:39.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.381+0000 7fcf29447700 1 -- 172.21.15.117:0/3967143065 learned_addr learned my addr 172.21.15.117:0/3967143065 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:39.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.381+0000 7fcf28c46700 1 --2- 172.21.15.117:0/3967143065 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcf24144b40 0x7fcf24071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:39.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.381+0000 7fcf29c48700 1 --2- 172.21.15.117:0/3967143065 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf2414af20 0x7fcf240a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:39.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.382+0000 7fcf29447700 1 -- 172.21.15.117:0/3967143065 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf2414af20 msgr2=0x7fcf240a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.382+0000 7fcf29447700 1 --2- 172.21.15.117:0/3967143065 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf2414af20 0x7fcf240a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.382+0000 7fcf29447700 1 -- 172.21.15.117:0/3967143065 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcf24144b40 msgr2=0x7fcf24071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.382+0000 7fcf29447700 1 --2- 172.21.15.117:0/3967143065 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcf24144b40 0x7fcf24071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.382+0000 7fcf29447700 1 -- 172.21.15.117:0/3967143065 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c009b30 con 0x7fcf240b9680 2023-07-19T20:44:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.382+0000 7fcf29447700 1 --2- 172.21.15.117:0/3967143065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf240b9680 0x7fcf240bc5d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400e810 tx=0x7fcf1400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.382+0000 7fcf19ffb700 1 -- 172.21.15.117:0/3967143065 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400c070 con 0x7fcf240b9680 2023-07-19T20:44:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.382+0000 7fcf19ffb700 1 -- 172.21.15.117:0/3967143065 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf14013610 con 0x7fcf240b9680 2023-07-19T20:44:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.382+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/3967143065 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf240a2590 con 0x7fcf240b9680 2023-07-19T20:44:39.384 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.382+0000 7fcf19ffb700 1 -- 172.21.15.117:0/3967143065 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf140139c0 con 0x7fcf240b9680 2023-07-19T20:44:39.384 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.382+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/3967143065 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf24071b10 con 0x7fcf240b9680 2023-07-19T20:44:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.383+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/3967143065 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2409ee40 con 0x7fcf240b9680 2023-07-19T20:44:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.383+0000 7fcf19ffb700 1 -- 172.21.15.117:0/3967143065 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fcf14013b20 con 0x7fcf240b9680 2023-07-19T20:44:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.384+0000 7fcf19ffb700 1 --2- 172.21.15.117:0/3967143065 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcf0806a660 0x7fcf0806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.384+0000 7fcf19ffb700 1 -- 172.21.15.117:0/3967143065 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf14088700 con 0x7fcf240b9680 2023-07-19T20:44:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.384+0000 7fcf28c46700 1 --2- 172.21.15.117:0/3967143065 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcf0806a660 0x7fcf0806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.384+0000 7fcf28c46700 1 --2- 172.21.15.117:0/3967143065 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcf0806a660 0x7fcf0806cb10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf241dd810 tx=0x7fcf20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.388+0000 7fcf19ffb700 1 -- 172.21.15.117:0/3967143065 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fcf14057510 con 0x7fcf240b9680 2023-07-19T20:44:39.608 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:39.614+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/3967143065 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcf24071b10 con 0x7fcf240b9680 2023-07-19T20:44:40.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.559+0000 7fcf19ffb700 1 -- 172.21.15.117:0/3967143065 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcf24071b10 con 0x7fcf240b9680 2023-07-19T20:44:40.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.562+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/3967143065 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcf0806a660 msgr2=0x7fcf0806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:40.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.562+0000 7fcf2b6ab700 1 --2- 172.21.15.117:0/3967143065 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcf0806a660 0x7fcf0806cb10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf241dd810 tx=0x7fcf20008040 comp rx=0 tx=0).stop 2023-07-19T20:44:40.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.562+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/3967143065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf240b9680 msgr2=0x7fcf240bc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:40.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.562+0000 7fcf2b6ab700 1 --2- 172.21.15.117:0/3967143065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf240b9680 0x7fcf240bc5d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400e810 tx=0x7fcf1400eb20 comp rx=0 tx=0).stop 2023-07-19T20:44:40.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.562+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/3967143065 shutdown_connections 2023-07-19T20:44:40.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.562+0000 7fcf2b6ab700 1 --2- 172.21.15.117:0/3967143065 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcf0806a660 0x7fcf0806cb10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:40.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.562+0000 7fcf2b6ab700 1 --2- 172.21.15.117:0/3967143065 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf2414af20 0x7fcf240a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:40.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.562+0000 7fcf2b6ab700 1 --2- 172.21.15.117:0/3967143065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf240b9680 0x7fcf240bc5d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:40.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.562+0000 7fcf2b6ab700 1 --2- 172.21.15.117:0/3967143065 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcf24144b40 0x7fcf24071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:40.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.562+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/3967143065 >> 172.21.15.117:0/3967143065 conn(0x7fcf240bdc50 msgr2=0x7fcf2413f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:40.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.562+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/3967143065 shutdown_connections 2023-07-19T20:44:40.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.562+0000 7fcf2b6ab700 1 -- 172.21.15.117:0/3967143065 wait complete. 2023-07-19T20:44:40.570 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-19T20:44:40.571 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-19T20:44:40.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.706+0000 7f3cf6e72700 1 Processor -- start 2023-07-19T20:44:40.701 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.707+0000 7f3cf6e72700 1 -- start start 2023-07-19T20:44:40.710 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cf6e72700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3cf0142b90 0x7f3cf0072490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:40.711 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cf6e72700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf0142f60 con 0x7f3cf00a0a90 2023-07-19T20:44:40.711 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cf6e72700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf00bf620 con 0x7f3cf00a05f0 2023-07-19T20:44:40.711 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cf6e72700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf00bdda0 con 0x7f3cf0142b90 2023-07-19T20:44:40.711 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cf540f700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f3cf00a0a90 0x7f3cf0153070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:53202/0 (socket says 172.21.15.117:53202) 2023-07-19T20:44:40.711 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cf540f700 1 -- 172.21.15.117:0/4140619680 learned_addr learned my addr 172.21.15.117:0/4140619680 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:40.711 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cf4c0e700 1 --2- 172.21.15.117:0/4140619680 >> v2:172.21.15.124:3300/0 conn(0x7f3cf0142b90 0x7f3cf0072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:40.711 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 -- 172.21.15.117:0/4140619680 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980852975 0 0) 0x7f3cf0142f60 con 0x7f3cf00a0a90 2023-07-19T20:44:40.712 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 -- 172.21.15.117:0/4140619680 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cdc0035b0 con 0x7f3cf00a0a90 2023-07-19T20:44:40.712 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 -- 172.21.15.117:0/4140619680 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2834007149 0 0) 0x7f3cdc0035b0 con 0x7f3cf00a0a90 2023-07-19T20:44:40.712 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 -- 172.21.15.117:0/4140619680 >> v2:172.21.15.124:3300/0 conn(0x7f3cf0142b90 msgr2=0x7f3cf0072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:40.712 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 --2- 172.21.15.117:0/4140619680 >> v2:172.21.15.124:3300/0 conn(0x7f3cf0142b90 0x7f3cf0072490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:40.712 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 -- 172.21.15.117:0/4140619680 >> v1:172.21.15.124:6789/0 conn(0x7f3cf00a05f0 legacy=0x7f3cf014bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:40.712 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 -- 172.21.15.117:0/4140619680 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf00bdf80 con 0x7f3cf00a0a90 2023-07-19T20:44:40.713 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 -- 172.21.15.117:0/4140619680 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f3ce80019f0 con 0x7f3cf00a0a90 2023-07-19T20:44:40.713 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 -- 172.21.15.117:0/4140619680 >> v1:172.21.15.117:6789/0 conn(0x7f3cf00a0a90 legacy=0x7f3cf0153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:40.713 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 --2- 172.21.15.117:0/4140619680 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3cdc003a70 0x7f3cdc003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:40.713 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 --2- 172.21.15.117:0/4140619680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cdc004850 0x7f3cdc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:40.713 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 --2- 172.21.15.117:0/4140619680 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3cdc005200 0x7f3cdc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:40.713 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 -- 172.21.15.117:0/4140619680 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf00bdda0 con 0x7f3cdc004850 2023-07-19T20:44:40.713 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 -- 172.21.15.117:0/4140619680 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc00c0e0 con 0x7f3cdc003a70 2023-07-19T20:44:40.713 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cef7fe700 1 -- 172.21.15.117:0/4140619680 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc00c2a0 con 0x7f3cdc005200 2023-07-19T20:44:40.714 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3cf4c0e700 1 --2- 172.21.15.117:0/4140619680 >> v2:172.21.15.124:3300/0 conn(0x7f3cf0142b90 0x7f3cf0072490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:40.714 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.708+0000 7f3ceffff700 1 --2- 172.21.15.117:0/4140619680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cdc004850 0x7f3cdc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:40.714 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3cf4c0e700 1 --2- 172.21.15.117:0/4140619680 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3cdc003a70 0x7f3cdc003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:40.714 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3cf540f700 1 --2- 172.21.15.117:0/4140619680 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3cdc005200 0x7f3cdc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:40.714 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3ceffff700 1 -- 172.21.15.117:0/4140619680 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3cdc005200 msgr2=0x7f3cdc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:40.714 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3ceffff700 1 --2- 172.21.15.117:0/4140619680 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3cdc005200 0x7f3cdc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:40.714 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3ceffff700 1 -- 172.21.15.117:0/4140619680 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3cdc003a70 msgr2=0x7f3cdc003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:40.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3ceffff700 1 --2- 172.21.15.117:0/4140619680 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3cdc003a70 0x7f3cdc003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:40.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3ceffff700 1 -- 172.21.15.117:0/4140619680 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc0035b0 con 0x7f3cdc004850 2023-07-19T20:44:40.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3cf540f700 1 -- 172.21.15.117:0/4140619680 reap_dead start 2023-07-19T20:44:40.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3ceffff700 1 --2- 172.21.15.117:0/4140619680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cdc004850 0x7f3cdc004cc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0001800 tx=0x7f3cdc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da7f661a5a1ced0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:40.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3cef7fe700 1 -- 172.21.15.117:0/4140619680 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00012f0 con 0x7f3cdc004850 2023-07-19T20:44:40.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3cef7fe700 1 -- 172.21.15.117:0/4140619680 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce0005310 con 0x7f3cdc004850 2023-07-19T20:44:40.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3cef7fe700 1 -- 172.21.15.117:0/4140619680 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0006860 con 0x7f3cdc004850 2023-07-19T20:44:40.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3cf6e72700 1 -- 172.21.15.117:0/4140619680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cdc004850 msgr2=0x7f3cdc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:40.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3cf6e72700 1 --2- 172.21.15.117:0/4140619680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cdc004850 0x7f3cdc004cc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0001800 tx=0x7f3cdc005880 comp rx=0 tx=0).stop 2023-07-19T20:44:40.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3cf6e72700 1 -- 172.21.15.117:0/4140619680 shutdown_connections 2023-07-19T20:44:40.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3cf6e72700 1 --2- 172.21.15.117:0/4140619680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cdc004850 0x7f3cdc004cc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:40.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3cf6e72700 1 -- 172.21.15.117:0/4140619680 >> 172.21.15.117:0/4140619680 conn(0x7f3cf00bea10 msgr2=0x7f3cf00bee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:40.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3cf6e72700 1 -- 172.21.15.117:0/4140619680 shutdown_connections 2023-07-19T20:44:40.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.709+0000 7f3cf6e72700 1 -- 172.21.15.117:0/4140619680 wait complete. 2023-07-19T20:44:40.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.711+0000 7f3cf6e72700 1 Processor -- start 2023-07-19T20:44:40.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.711+0000 7f3cf6e72700 1 -- start start 2023-07-19T20:44:40.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf6e72700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cdc004850 0x7f3cf00bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:40.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf6e72700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3cf00badf0 0x7f3cf009f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:40.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf6e72700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3cf01e1170 0x7f3cf013bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:40.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf6e72700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf009fde0 con 0x7f3cdc004850 2023-07-19T20:44:40.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf6e72700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf00b9c90 con 0x7f3cf01e1170 2023-07-19T20:44:40.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf6e72700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf00b9640 con 0x7f3cf00badf0 2023-07-19T20:44:40.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf4c0e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cdc004850 0x7f3cf00bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:40.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf4c0e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cdc004850 0x7f3cf00bbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35942/0 (socket says 172.21.15.117:35942) 2023-07-19T20:44:40.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf4c0e700 1 -- 172.21.15.117:0/3921138173 learned_addr learned my addr 172.21.15.117:0/3921138173 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:40.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf540f700 1 --2- 172.21.15.117:0/3921138173 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3cf01e1170 0x7f3cf013bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:40.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3ceffff700 1 --2- 172.21.15.117:0/3921138173 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3cf00badf0 0x7f3cf009f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:40.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf4c0e700 1 -- 172.21.15.117:0/3921138173 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3cf00badf0 msgr2=0x7f3cf009f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:40.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf4c0e700 1 --2- 172.21.15.117:0/3921138173 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3cf00badf0 0x7f3cf009f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:40.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf4c0e700 1 -- 172.21.15.117:0/3921138173 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3cf01e1170 msgr2=0x7f3cf013bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:40.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf4c0e700 1 --2- 172.21.15.117:0/3921138173 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3cf01e1170 0x7f3cf013bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:40.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.712+0000 7f3cf4c0e700 1 -- 172.21.15.117:0/3921138173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf00b9920 con 0x7f3cdc004850 2023-07-19T20:44:40.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.713+0000 7f3cf4c0e700 1 --2- 172.21.15.117:0/3921138173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cdc004850 0x7f3cf00bbc70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8011c20 tx=0x7f3cd8011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:40.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.713+0000 7f3ced7fa700 1 -- 172.21.15.117:0/3921138173 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd800fab0 con 0x7f3cdc004850 2023-07-19T20:44:40.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.713+0000 7f3ced7fa700 1 -- 172.21.15.117:0/3921138173 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd800fc10 con 0x7f3cdc004850 2023-07-19T20:44:40.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.713+0000 7f3cf6e72700 1 -- 172.21.15.117:0/3921138173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf00ba120 con 0x7f3cdc004850 2023-07-19T20:44:40.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.713+0000 7f3ced7fa700 1 -- 172.21.15.117:0/3921138173 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8004020 con 0x7f3cdc004850 2023-07-19T20:44:40.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.713+0000 7f3cf6e72700 1 -- 172.21.15.117:0/3921138173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf01e15f0 con 0x7f3cdc004850 2023-07-19T20:44:40.720 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.714+0000 7f3cf6e72700 1 -- 172.21.15.117:0/3921138173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf00b94a0 con 0x7f3cdc004850 2023-07-19T20:44:40.720 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.714+0000 7f3ced7fa700 1 -- 172.21.15.117:0/3921138173 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f3cd8004180 con 0x7f3cdc004850 2023-07-19T20:44:40.720 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.714+0000 7f3ced7fa700 1 --2- 172.21.15.117:0/3921138173 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3cd006a660 0x7f3cd006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:40.720 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.714+0000 7f3ced7fa700 1 -- 172.21.15.117:0/3921138173 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3cd80890c0 con 0x7f3cdc004850 2023-07-19T20:44:40.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.714+0000 7f3ceffff700 1 --2- 172.21.15.117:0/3921138173 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3cd006a660 0x7f3cd006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:40.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.715+0000 7f3ceffff700 1 --2- 172.21.15.117:0/3921138173 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3cd006a660 0x7f3cd006cb10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0001800 tx=0x7f3ce0009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:40.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.719+0000 7f3ced7fa700 1 -- 172.21.15.117:0/3921138173 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3cf00b94a0 con 0x7f3cdc004850 2023-07-19T20:44:40.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:40.948+0000 7f3cf6e72700 1 -- 172.21.15.117:0/3921138173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3cf00b94a0 con 0x7f3cdc004850 2023-07-19T20:44:41.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.561+0000 7f3ced7fa700 1 -- 172.21.15.117:0/3921138173 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3cf00b94a0 con 0x7f3cdc004850 2023-07-19T20:44:41.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.563+0000 7f3cf6e72700 1 -- 172.21.15.117:0/3921138173 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3cd006a660 msgr2=0x7f3cd006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:41.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.563+0000 7f3cf6e72700 1 --2- 172.21.15.117:0/3921138173 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3cd006a660 0x7f3cd006cb10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0001800 tx=0x7f3ce0009030 comp rx=0 tx=0).stop 2023-07-19T20:44:41.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.563+0000 7f3cf6e72700 1 -- 172.21.15.117:0/3921138173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cdc004850 msgr2=0x7f3cf00bbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:41.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.563+0000 7f3cf6e72700 1 --2- 172.21.15.117:0/3921138173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cdc004850 0x7f3cf00bbc70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8011c20 tx=0x7f3cd8011f30 comp rx=0 tx=0).stop 2023-07-19T20:44:41.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.564+0000 7f3cf6e72700 1 -- 172.21.15.117:0/3921138173 shutdown_connections 2023-07-19T20:44:41.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.564+0000 7f3cf6e72700 1 --2- 172.21.15.117:0/3921138173 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3cd006a660 0x7f3cd006cb10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:41.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.564+0000 7f3cf6e72700 1 --2- 172.21.15.117:0/3921138173 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3cf01e1170 0x7f3cf013bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:41.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.564+0000 7f3cf6e72700 1 --2- 172.21.15.117:0/3921138173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cdc004850 0x7f3cf00bbc70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:41.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.564+0000 7f3cf6e72700 1 --2- 172.21.15.117:0/3921138173 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3cf00badf0 0x7f3cf009f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:41.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.564+0000 7f3cf6e72700 1 -- 172.21.15.117:0/3921138173 >> 172.21.15.117:0/3921138173 conn(0x7f3cf00bea10 msgr2=0x7f3cf0140b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:41.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.564+0000 7f3cf6e72700 1 -- 172.21.15.117:0/3921138173 shutdown_connections 2023-07-19T20:44:41.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.564+0000 7f3cf6e72700 1 -- 172.21.15.117:0/3921138173 wait complete. 2023-07-19T20:44:41.570 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-19T20:44:41.571 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-19T20:44:41.697 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.701+0000 7f4896118700 1 Processor -- start 2023-07-19T20:44:41.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.701+0000 7f4896118700 1 -- start start 2023-07-19T20:44:41.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f4896118700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f48900b8c10 0x7f48900ba8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:41.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f4896118700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f489014afc0 0x7f4890155170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:41.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f4896118700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48900bb4f0 con 0x7f4890144900 2023-07-19T20:44:41.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f4896118700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48900bb740 con 0x7f489014afc0 2023-07-19T20:44:41.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f4896118700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48900bba20 con 0x7f48900b8c10 2023-07-19T20:44:41.699 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f488effd700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4890144900 0x7f489014a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:53216/0 (socket says 172.21.15.117:53216) 2023-07-19T20:44:41.699 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f488ffff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f489014afc0 0x7f4890155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:41.699 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f488effd700 1 -- 172.21.15.117:0/1906463709 learned_addr learned my addr 172.21.15.117:0/1906463709 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:41.699 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f488e7fc700 1 -- 172.21.15.117:0/1906463709 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220943768 0 0) 0x7f48900bb4f0 con 0x7f4890144900 2023-07-19T20:44:41.699 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f488f7fe700 1 --2- 172.21.15.117:0/1906463709 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f48900b8c10 0x7f48900ba8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:41.699 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f488e7fc700 1 -- 172.21.15.117:0/1906463709 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f487c0035b0 con 0x7f4890144900 2023-07-19T20:44:41.699 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f488ffff700 1 -- 172.21.15.117:0/1906463709 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f48900b8c10 msgr2=0x7f48900ba8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:41.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f488ffff700 1 --2- 172.21.15.117:0/1906463709 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f48900b8c10 0x7f48900ba8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:41.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f488ffff700 1 -- 172.21.15.117:0/1906463709 >> v1:172.21.15.117:6789/0 conn(0x7f4890144900 legacy=0x7f489014a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:41.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f488ffff700 1 -- 172.21.15.117:0/1906463709 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48900bbd00 con 0x7f489014afc0 2023-07-19T20:44:41.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f488ffff700 1 --2- 172.21.15.117:0/1906463709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f489014afc0 0x7f4890155170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4888009d90 tx=0x7f488800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b5595b2125b818 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:41.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f488e7fc700 1 -- 172.21.15.117:0/1906463709 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488800e070 con 0x7f489014afc0 2023-07-19T20:44:41.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f488e7fc700 1 -- 172.21.15.117:0/1906463709 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488800bb20 con 0x7f489014afc0 2023-07-19T20:44:41.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.702+0000 7f488e7fc700 1 -- 172.21.15.117:0/1906463709 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888012430 con 0x7f489014afc0 2023-07-19T20:44:41.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.703+0000 7f4896118700 1 -- 172.21.15.117:0/1906463709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f489014afc0 msgr2=0x7f4890155170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:41.701 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.703+0000 7f4896118700 1 --2- 172.21.15.117:0/1906463709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f489014afc0 0x7f4890155170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4888009d90 tx=0x7f488800b330 comp rx=0 tx=0).stop 2023-07-19T20:44:41.701 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.703+0000 7f4896118700 1 -- 172.21.15.117:0/1906463709 shutdown_connections 2023-07-19T20:44:41.701 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.703+0000 7f4896118700 1 --2- 172.21.15.117:0/1906463709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f489014afc0 0x7f4890155170 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:41.701 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.703+0000 7f4896118700 1 --2- 172.21.15.117:0/1906463709 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f48900b8c10 0x7f48900ba8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:41.701 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.703+0000 7f4896118700 1 -- 172.21.15.117:0/1906463709 >> 172.21.15.117:0/1906463709 conn(0x7f4890071c90 msgr2=0x7f4890072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:41.701 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.703+0000 7f4896118700 1 -- 172.21.15.117:0/1906463709 shutdown_connections 2023-07-19T20:44:41.702 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.703+0000 7f4896118700 1 -- 172.21.15.117:0/1906463709 wait complete. 2023-07-19T20:44:41.702 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.704+0000 7f4896118700 1 Processor -- start 2023-07-19T20:44:41.702 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.704+0000 7f4896118700 1 -- start start 2023-07-19T20:44:41.704 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f4896118700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48900b8c10 0x7f4890147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:41.704 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f4896118700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4890144900 0x7f48900b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:41.704 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f4896118700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f489014afc0 0x7f48901e0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:41.704 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f4896118700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4890148150 con 0x7f4890144900 2023-07-19T20:44:41.704 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f4896118700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48900a63d0 con 0x7f48900b8c10 2023-07-19T20:44:41.705 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f4896118700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48900b5ad0 con 0x7f489014afc0 2023-07-19T20:44:41.705 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f488effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4890144900 0x7f48900b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:41.705 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f488effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4890144900 0x7f48900b5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35970/0 (socket says 172.21.15.117:35970) 2023-07-19T20:44:41.705 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f488effd700 1 -- 172.21.15.117:0/1199264682 learned_addr learned my addr 172.21.15.117:0/1199264682 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:41.705 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f488f7fe700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48900b8c10 0x7f4890147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:41.705 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f488ffff700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f489014afc0 0x7f48901e0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:41.705 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f488effd700 1 -- 172.21.15.117:0/1199264682 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f489014afc0 msgr2=0x7f48901e0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:41.705 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f488effd700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f489014afc0 0x7f48901e0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:41.706 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f488effd700 1 -- 172.21.15.117:0/1199264682 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48900b8c10 msgr2=0x7f4890147c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:41.706 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f488effd700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48900b8c10 0x7f4890147c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:41.706 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f488effd700 1 -- 172.21.15.117:0/1199264682 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4888009a70 con 0x7f4890144900 2023-07-19T20:44:41.706 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f488f7fe700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48900b8c10 0x7f4890147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:41.706 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f488ffff700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f489014afc0 0x7f48901e0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:41.706 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f488effd700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4890144900 0x7f48900b5030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f488000c700 tx=0x7f488000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:41.706 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f4887fff700 1 -- 172.21.15.117:0/1199264682 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880005d70 con 0x7f4890144900 2023-07-19T20:44:41.707 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f4887fff700 1 -- 172.21.15.117:0/1199264682 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48800070d0 con 0x7f4890144900 2023-07-19T20:44:41.707 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f4896118700 1 -- 172.21.15.117:0/1199264682 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4890142d50 con 0x7f4890144900 2023-07-19T20:44:41.707 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f4887fff700 1 -- 172.21.15.117:0/1199264682 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880007460 con 0x7f4890144900 2023-07-19T20:44:41.707 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.705+0000 7f4896118700 1 -- 172.21.15.117:0/1199264682 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4890143310 con 0x7f4890144900 2023-07-19T20:44:41.707 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.706+0000 7f4896118700 1 -- 172.21.15.117:0/1199264682 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48901434a0 con 0x7f4890144900 2023-07-19T20:44:41.707 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.707+0000 7f4887fff700 1 -- 172.21.15.117:0/1199264682 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f48800075c0 con 0x7f4890144900 2023-07-19T20:44:41.707 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.707+0000 7f4887fff700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f487006a660 0x7f487006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:41.708 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.707+0000 7f4887fff700 1 -- 172.21.15.117:0/1199264682 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4880088070 con 0x7f4890144900 2023-07-19T20:44:41.708 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.707+0000 7f488f7fe700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f487006a660 0x7f487006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:41.708 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.708+0000 7f488f7fe700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f487006a660 0x7f487006cb10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f48780099f0 tx=0x7f4878008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:41.708 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.711+0000 7f4887fff700 1 -- 172.21.15.117:0/1199264682 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f4880053480 con 0x7f4890144900 2023-07-19T20:44:41.938 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.945+0000 7f4896118700 1 -- 172.21.15.117:0/1199264682 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4890074890 con 0x7f4890144900 2023-07-19T20:44:41.939 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.945+0000 7f4887fff700 1 -- 172.21.15.117:0/1199264682 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3892 (secure 0 0 0) 0x7f4880056aa0 con 0x7f4890144900 2023-07-19T20:44:41.940 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:41.940 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6833/1121968339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":1121968339},{"type":"v1","addr":"172.21.15.124:6833","nonce":1121968339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3740070710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3740070710},{"type":"v1","addr":"172.21.15.117:6835","nonce":3740070710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-19T20:44:38.547955+0000","modified":"2023-07-19T20:44:41.558655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/479216080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":479216080},{"type":"v1","addr":"172.21.15.117:6837","nonce":479216080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-19T20:44:41.941 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.947+0000 7f4896118700 1 -- 172.21.15.117:0/1199264682 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f487006a660 msgr2=0x7f487006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:41.941 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.947+0000 7f4896118700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f487006a660 0x7f487006cb10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f48780099f0 tx=0x7f4878008040 comp rx=0 tx=0).stop 2023-07-19T20:44:41.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.947+0000 7f4896118700 1 -- 172.21.15.117:0/1199264682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4890144900 msgr2=0x7f48900b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:41.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.947+0000 7f4896118700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4890144900 0x7f48900b5030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f488000c700 tx=0x7f488000cac0 comp rx=0 tx=0).stop 2023-07-19T20:44:41.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.947+0000 7f4896118700 1 -- 172.21.15.117:0/1199264682 shutdown_connections 2023-07-19T20:44:41.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.947+0000 7f4896118700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f487006a660 0x7f487006cb10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:41.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.947+0000 7f4896118700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f489014afc0 0x7f48901e0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:41.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.947+0000 7f4896118700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48900b8c10 0x7f4890147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:41.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.947+0000 7f4896118700 1 --2- 172.21.15.117:0/1199264682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4890144900 0x7f48900b5030 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:41.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.947+0000 7f4896118700 1 -- 172.21.15.117:0/1199264682 >> 172.21.15.117:0/1199264682 conn(0x7f4890071c90 msgr2=0x7f48900c0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:41.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.947+0000 7f4896118700 1 -- 172.21.15.117:0/1199264682 shutdown_connections 2023-07-19T20:44:41.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:41.947+0000 7f4896118700 1 -- 172.21.15.117:0/1199264682 wait complete. 2023-07-19T20:44:41.944 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 8 2023-07-19T20:44:41.953 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:42.074 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.080+0000 7f9dceaf4700 1 Processor -- start 2023-07-19T20:44:42.075 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.080+0000 7f9dceaf4700 1 -- start start 2023-07-19T20:44:42.075 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.081+0000 7f9dceaf4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc814c9e0 0x7f9dc80b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.075 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.081+0000 7f9dceaf4700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc814be40 con 0x7f9dc80b7210 2023-07-19T20:44:42.075 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.081+0000 7f9dceaf4700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc806bc80 con 0x7f9dc8071770 2023-07-19T20:44:42.076 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.081+0000 7f9dceaf4700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc80b9700 con 0x7f9dc814c9e0 2023-07-19T20:44:42.076 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.081+0000 7f9dcc890700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9dc80b7210 0x7f9dc806b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:53218/0 (socket says 172.21.15.117:53218) 2023-07-19T20:44:42.076 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.081+0000 7f9dcc890700 1 -- 172.21.15.117:0/1631078129 learned_addr learned my addr 172.21.15.117:0/1631078129 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:42.081 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.081+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576270630 0 0) 0x7f9dc814be40 con 0x7f9dc80b7210 2023-07-19T20:44:42.082 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.081+0000 7f9dcd091700 1 --2- 172.21.15.117:0/1631078129 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc814c9e0 0x7f9dc80b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.082 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.081+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9db80035b0 con 0x7f9dc80b7210 2023-07-19T20:44:42.082 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685486 0 0) 0x7f9dc806bc80 con 0x7f9dc8071770 2023-07-19T20:44:42.082 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dc814be40 con 0x7f9dc8071770 2023-07-19T20:44:42.082 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 306935314 0 0) 0x7f9db80035b0 con 0x7f9dc80b7210 2023-07-19T20:44:42.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc814c9e0 msgr2=0x7f9dc80b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:42.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 --2- 172.21.15.117:0/1631078129 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc814c9e0 0x7f9dc80b91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 >> v1:172.21.15.124:6789/0 conn(0x7f9dc8071770 legacy=0x7f9dc814c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc8071bc0 con 0x7f9dc80b7210 2023-07-19T20:44:42.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f9dbc001670 con 0x7f9dc80b7210 2023-07-19T20:44:42.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 >> v1:172.21.15.117:6789/0 conn(0x7f9dc80b7210 legacy=0x7f9dc806b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 --2- 172.21.15.117:0/1631078129 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc814c9e0 0x7f9db8003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 --2- 172.21.15.117:0/1631078129 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9db8004170 0x7f9db8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 --2- 172.21.15.117:0/1631078129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db8004d90 0x7f9db8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc80b9700 con 0x7f9db8004d90 2023-07-19T20:44:42.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db800bb20 con 0x7f9db8004170 2023-07-19T20:44:42.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db800bce0 con 0x7f9dc814c9e0 2023-07-19T20:44:42.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dcd091700 1 --2- 172.21.15.117:0/1631078129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db8004d90 0x7f9db8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dcc890700 1 --2- 172.21.15.117:0/1631078129 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc814c9e0 0x7f9db8003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc7fff700 1 --2- 172.21.15.117:0/1631078129 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9db8004170 0x7f9db8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dcd091700 1 -- 172.21.15.117:0/1631078129 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc814c9e0 msgr2=0x7f9db8003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:42.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dcd091700 1 --2- 172.21.15.117:0/1631078129 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc814c9e0 0x7f9db8003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dcd091700 1 -- 172.21.15.117:0/1631078129 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9db8004170 msgr2=0x7f9db8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:42.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dcd091700 1 --2- 172.21.15.117:0/1631078129 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9db8004170 0x7f9db8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dcd091700 1 -- 172.21.15.117:0/1631078129 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db80035b0 con 0x7f9db8004d90 2023-07-19T20:44:42.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dcd091700 1 --2- 172.21.15.117:0/1631078129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db8004d90 0x7f9db8005200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009f90 tx=0x7f9db8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dd09b579df643d server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc000ec30 con 0x7f9db8004d90 2023-07-19T20:44:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc000f040 con 0x7f9db8004d90 2023-07-19T20:44:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.082+0000 7f9dc77fe700 1 -- 172.21.15.117:0/1631078129 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0014480 con 0x7f9db8004d90 2023-07-19T20:44:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.083+0000 7f9dceaf4700 1 -- 172.21.15.117:0/1631078129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db8004d90 msgr2=0x7f9db8005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.083+0000 7f9dceaf4700 1 --2- 172.21.15.117:0/1631078129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db8004d90 0x7f9db8005200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009f90 tx=0x7f9db8005880 comp rx=0 tx=0).stop 2023-07-19T20:44:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.083+0000 7f9dcd091700 1 -- 172.21.15.117:0/1631078129 reap_dead start 2023-07-19T20:44:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.083+0000 7f9dceaf4700 1 -- 172.21.15.117:0/1631078129 shutdown_connections 2023-07-19T20:44:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.083+0000 7f9dceaf4700 1 -- 172.21.15.117:0/1631078129 >> 172.21.15.117:0/1631078129 conn(0x7f9dc80bdc00 msgr2=0x7f9dc80b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.083+0000 7f9dceaf4700 1 -- 172.21.15.117:0/1631078129 shutdown_connections 2023-07-19T20:44:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.083+0000 7f9dceaf4700 1 -- 172.21.15.117:0/1631078129 wait complete. 2023-07-19T20:44:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.084+0000 7f9dceaf4700 1 Processor -- start 2023-07-19T20:44:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.084+0000 7f9dceaf4700 1 -- start start 2023-07-19T20:44:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dceaf4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db8004d90 0x7f9dc8070380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dceaf4700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dc8070f20 0x7f9dc81e0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dceaf4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc81e06a0 0x7f9dc8138320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.088 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dceaf4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc80708c0 con 0x7f9db8004d90 2023-07-19T20:44:42.088 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dceaf4700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc8141500 con 0x7f9dc8070f20 2023-07-19T20:44:42.088 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dceaf4700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc806fd30 con 0x7f9dc81e06a0 2023-07-19T20:44:42.088 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dcc890700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db8004d90 0x7f9dc8070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.088 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dcc890700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db8004d90 0x7f9dc8070380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35992/0 (socket says 172.21.15.117:35992) 2023-07-19T20:44:42.088 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dcc890700 1 -- 172.21.15.117:0/3704850179 learned_addr learned my addr 172.21.15.117:0/3704850179 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:42.088 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dc7fff700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dc8070f20 0x7f9dc81e0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.089 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dcd091700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc81e06a0 0x7f9dc8138320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.089 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dcc890700 1 -- 172.21.15.117:0/3704850179 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc81e06a0 msgr2=0x7f9dc8138320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.089 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dcc890700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc81e06a0 0x7f9dc8138320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.089 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dcc890700 1 -- 172.21.15.117:0/3704850179 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dc8070f20 msgr2=0x7f9dc81e0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.089 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dcc890700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dc8070f20 0x7f9dc81e0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.089 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dcc890700 1 -- 172.21.15.117:0/3704850179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc806f770 con 0x7f9db8004d90 2023-07-19T20:44:42.089 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dc7fff700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dc8070f20 0x7f9dc81e0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:42.089 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.085+0000 7f9dcc890700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db8004d90 0x7f9dc8070380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0072c0 tx=0x7f9dbc0075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:42.090 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.086+0000 7f9dc57fa700 1 -- 172.21.15.117:0/3704850179 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0077b0 con 0x7f9db8004d90 2023-07-19T20:44:42.090 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.086+0000 7f9dc57fa700 1 -- 172.21.15.117:0/3704850179 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc00f850 con 0x7f9db8004d90 2023-07-19T20:44:42.090 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.086+0000 7f9dceaf4700 1 -- 172.21.15.117:0/3704850179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc806fa50 con 0x7f9db8004d90 2023-07-19T20:44:42.090 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.086+0000 7f9dc57fa700 1 -- 172.21.15.117:0/3704850179 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc00fc00 con 0x7f9db8004d90 2023-07-19T20:44:42.090 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.086+0000 7f9dceaf4700 1 -- 172.21.15.117:0/3704850179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc81d1ee0 con 0x7f9db8004d90 2023-07-19T20:44:42.090 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.086+0000 7f9dceaf4700 1 -- 172.21.15.117:0/3704850179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc81417e0 con 0x7f9db8004d90 2023-07-19T20:44:42.090 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.087+0000 7f9dc57fa700 1 -- 172.21.15.117:0/3704850179 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f9dbc00fd60 con 0x7f9db8004d90 2023-07-19T20:44:42.091 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.087+0000 7f9dc57fa700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f9dac06a660 0x7f9dac06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.091 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.087+0000 7f9dc7fff700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f9dac06a660 0x7f9dac06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.091 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.087+0000 7f9dc57fa700 1 -- 172.21.15.117:0/3704850179 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9dbc088a20 con 0x7f9db8004d90 2023-07-19T20:44:42.091 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.088+0000 7f9dc7fff700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f9dac06a660 0x7f9dac06cb10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9dc81d4d20 tx=0x7f9db4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:42.091 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.092+0000 7f9dc57fa700 1 -- 172.21.15.117:0/3704850179 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9dbc053eb0 con 0x7f9db8004d90 2023-07-19T20:44:42.272 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.278+0000 7f9dceaf4700 1 -- 172.21.15.117:0/3704850179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dc8067940 con 0x7f9db8004d90 2023-07-19T20:44:42.273 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.280+0000 7f9dc57fa700 1 -- 172.21.15.117:0/3704850179 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17897 (secure 0 0 0) 0x7f9dbc0574d0 con 0x7f9db8004d90 2023-07-19T20:44:42.273 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:42.274 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:39.549566+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:42.275 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.282+0000 7f9dceaf4700 1 -- 172.21.15.117:0/3704850179 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f9dac06a660 msgr2=0x7f9dac06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.282+0000 7f9dceaf4700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f9dac06a660 0x7f9dac06cb10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9dc81d4d20 tx=0x7f9db4009040 comp rx=0 tx=0).stop 2023-07-19T20:44:42.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.282+0000 7f9dceaf4700 1 -- 172.21.15.117:0/3704850179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db8004d90 msgr2=0x7f9dc8070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.282+0000 7f9dceaf4700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db8004d90 0x7f9dc8070380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0072c0 tx=0x7f9dbc0075d0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.282+0000 7f9dceaf4700 1 -- 172.21.15.117:0/3704850179 shutdown_connections 2023-07-19T20:44:42.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.282+0000 7f9dceaf4700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f9dac06a660 0x7f9dac06cb10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.282+0000 7f9dceaf4700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc81e06a0 0x7f9dc8138320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.282+0000 7f9dceaf4700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db8004d90 0x7f9dc8070380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.282+0000 7f9dceaf4700 1 --2- 172.21.15.117:0/3704850179 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dc8070f20 0x7f9dc81e0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.282+0000 7f9dceaf4700 1 -- 172.21.15.117:0/3704850179 >> 172.21.15.117:0/3704850179 conn(0x7f9dc80bdc00 msgr2=0x7f9dc8066200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:42.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.282+0000 7f9dceaf4700 1 -- 172.21.15.117:0/3704850179 shutdown_connections 2023-07-19T20:44:42.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.282+0000 7f9dceaf4700 1 -- 172.21.15.117:0/3704850179 wait complete. 2023-07-19T20:44:42.287 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-19T20:44:42.288 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-19T20:44:42.407 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.414+0000 7fb108aca700 1 Processor -- start 2023-07-19T20:44:42.407 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.414+0000 7fb108aca700 1 -- start start 2023-07-19T20:44:42.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb108aca700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb1041475e0 0x7fb10414fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb108aca700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1040b7900 con 0x7fb1040b8a20 2023-07-19T20:44:42.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb108aca700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb104147a70 con 0x7fb1040baa40 2023-07-19T20:44:42.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb108aca700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb104147d50 con 0x7fb1041475e0 2023-07-19T20:44:42.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb102d9d700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb1040b8a20 0x7fb104152430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41222/0 (socket says 172.21.15.117:41222) 2023-07-19T20:44:42.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb102d9d700 1 -- 172.21.15.117:0/1145202387 learned_addr learned my addr 172.21.15.117:0/1145202387 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:42.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb101d9b700 1 --2- 172.21.15.117:0/1145202387 >> v2:172.21.15.124:3300/0 conn(0x7fb1041475e0 0x7fb10414fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb10159a700 1 -- 172.21.15.117:0/1145202387 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165654991 0 0) 0x7fb1040b7900 con 0x7fb1040b8a20 2023-07-19T20:44:42.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb10159a700 1 -- 172.21.15.117:0/1145202387 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0ec0035b0 con 0x7fb1040b8a20 2023-07-19T20:44:42.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb10159a700 1 -- 172.21.15.117:0/1145202387 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2660867732 0 0) 0x7fb0ec0035b0 con 0x7fb1040b8a20 2023-07-19T20:44:42.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb101d9b700 1 -- 172.21.15.117:0/1145202387 >> v1:172.21.15.124:6789/0 conn(0x7fb1040baa40 legacy=0x7fb1040b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.411 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb101d9b700 1 -- 172.21.15.117:0/1145202387 >> v1:172.21.15.117:6789/0 conn(0x7fb1040b8a20 legacy=0x7fb104152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.411 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb101d9b700 1 -- 172.21.15.117:0/1145202387 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb104148030 con 0x7fb1041475e0 2023-07-19T20:44:42.411 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb101d9b700 1 --2- 172.21.15.117:0/1145202387 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1041475e0 0x7fb10414fee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb1040b95e0 tx=0x7fb0f8009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8a59e22dfcf0dd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:42.411 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.415+0000 7fb10159a700 1 -- 172.21.15.117:0/1145202387 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0019f0 con 0x7fb1041475e0 2023-07-19T20:44:42.411 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.416+0000 7fb10159a700 1 -- 172.21.15.117:0/1145202387 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f8004030 con 0x7fb1041475e0 2023-07-19T20:44:42.411 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.416+0000 7fb10159a700 1 -- 172.21.15.117:0/1145202387 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80043a0 con 0x7fb1041475e0 2023-07-19T20:44:42.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.416+0000 7fb108aca700 1 -- 172.21.15.117:0/1145202387 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1041475e0 msgr2=0x7fb10414fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.416+0000 7fb108aca700 1 --2- 172.21.15.117:0/1145202387 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1041475e0 0x7fb10414fee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb1040b95e0 tx=0x7fb0f8009b20 comp rx=0 tx=0).stop 2023-07-19T20:44:42.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.416+0000 7fb108aca700 1 -- 172.21.15.117:0/1145202387 shutdown_connections 2023-07-19T20:44:42.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.416+0000 7fb108aca700 1 --2- 172.21.15.117:0/1145202387 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1041475e0 0x7fb10414fee0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.416+0000 7fb108aca700 1 -- 172.21.15.117:0/1145202387 >> 172.21.15.117:0/1145202387 conn(0x7fb1040be4b0 msgr2=0x7fb1040ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:42.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.416+0000 7fb108aca700 1 -- 172.21.15.117:0/1145202387 shutdown_connections 2023-07-19T20:44:42.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.416+0000 7fb108aca700 1 -- 172.21.15.117:0/1145202387 wait complete. 2023-07-19T20:44:42.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.417+0000 7fb108aca700 1 Processor -- start 2023-07-19T20:44:42.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.417+0000 7fb108aca700 1 -- start start 2023-07-19T20:44:42.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb108aca700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1040b8a20 0x7fb1041e4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb108aca700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb1040baa40 0x7fb104133e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb108aca700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1041475e0 0x7fb1041dff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb108aca700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb104134360 con 0x7fb1040b8a20 2023-07-19T20:44:42.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb108aca700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1041e0480 con 0x7fb1041475e0 2023-07-19T20:44:42.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb108aca700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1041423d0 con 0x7fb1040baa40 2023-07-19T20:44:42.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb10259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1040b8a20 0x7fb1041e4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb10259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1040b8a20 0x7fb1041e4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43416/0 (socket says 172.21.15.117:43416) 2023-07-19T20:44:42.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb10259c700 1 -- 172.21.15.117:0/1685317136 learned_addr learned my addr 172.21.15.117:0/1685317136 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:42.419 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb102d9d700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1041475e0 0x7fb1041dff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.419 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb101d9b700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb1040baa40 0x7fb104133e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.419 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb10259c700 1 -- 172.21.15.117:0/1685317136 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb1040baa40 msgr2=0x7fb104133e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.419 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb10259c700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb1040baa40 0x7fb104133e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb10259c700 1 -- 172.21.15.117:0/1685317136 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1041475e0 msgr2=0x7fb1041dff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb10259c700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1041475e0 0x7fb1041dff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb10259c700 1 -- 172.21.15.117:0/1685317136 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f80094a0 con 0x7fb1040b8a20 2023-07-19T20:44:42.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb101d9b700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb1040baa40 0x7fb104133e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:42.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.418+0000 7fb10259c700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1040b8a20 0x7fb1041e4010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400c4e0 tx=0x7fb0f400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:42.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.419+0000 7fb0f2ffd700 1 -- 172.21.15.117:0/1685317136 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f40052d0 con 0x7fb1040b8a20 2023-07-19T20:44:42.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.419+0000 7fb0f2ffd700 1 -- 172.21.15.117:0/1685317136 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f4005430 con 0x7fb1040b8a20 2023-07-19T20:44:42.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.419+0000 7fb108aca700 1 -- 172.21.15.117:0/1685317136 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1040b6b90 con 0x7fb1040b8a20 2023-07-19T20:44:42.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.419+0000 7fb0f2ffd700 1 -- 172.21.15.117:0/1685317136 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f40038c0 con 0x7fb1040b8a20 2023-07-19T20:44:42.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.419+0000 7fb108aca700 1 -- 172.21.15.117:0/1685317136 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1041e3810 con 0x7fb1040b8a20 2023-07-19T20:44:42.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.419+0000 7fb108aca700 1 -- 172.21.15.117:0/1685317136 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb104067940 con 0x7fb1040b8a20 2023-07-19T20:44:42.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.420+0000 7fb0f2ffd700 1 -- 172.21.15.117:0/1685317136 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fb0f4003a20 con 0x7fb1040b8a20 2023-07-19T20:44:42.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.420+0000 7fb0f2ffd700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb0e406a690 0x7fb0e406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.420+0000 7fb0f2ffd700 1 -- 172.21.15.117:0/1685317136 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb0f4087d70 con 0x7fb1040b8a20 2023-07-19T20:44:42.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.420+0000 7fb101d9b700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb0e406a690 0x7fb0e406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.421+0000 7fb101d9b700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb0e406a690 0x7fb0e406cb40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8000c00 tx=0x7fb0f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:42.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.425+0000 7fb0f2ffd700 1 -- 172.21.15.117:0/1685317136 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fb0f4053170 con 0x7fb1040b8a20 2023-07-19T20:44:42.605 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.611+0000 7fb108aca700 1 -- 172.21.15.117:0/1685317136 --> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb104148310 con 0x7fb0e406a690 2023-07-19T20:44:42.613 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.619+0000 7fb0f2ffd700 1 -- 172.21.15.117:0/1685317136 <== mgr.4107 v2:172.21.15.117:6832/146126 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286935 (secure 0 0 0) 0x7fb0f8022070 con 0x7fb0e406a690 2023-07-19T20:44:42.620 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.623+0000 7fb108aca700 1 -- 172.21.15.117:0/1685317136 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb0e406a690 msgr2=0x7fb0e406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.623+0000 7fb108aca700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb0e406a690 0x7fb0e406cb40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8000c00 tx=0x7fb0f8008030 comp rx=0 tx=0).stop 2023-07-19T20:44:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.623+0000 7fb108aca700 1 -- 172.21.15.117:0/1685317136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1040b8a20 msgr2=0x7fb1041e4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.623+0000 7fb108aca700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1040b8a20 0x7fb1041e4010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400c4e0 tx=0x7fb0f400c7f0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.623+0000 7fb108aca700 1 -- 172.21.15.117:0/1685317136 shutdown_connections 2023-07-19T20:44:42.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.623+0000 7fb108aca700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb0e406a690 0x7fb0e406cb40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.623+0000 7fb108aca700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1041475e0 0x7fb1041dff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.623+0000 7fb108aca700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1040b8a20 0x7fb1041e4010 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.623+0000 7fb108aca700 1 --2- 172.21.15.117:0/1685317136 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb1040baa40 0x7fb104133e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.623+0000 7fb108aca700 1 -- 172.21.15.117:0/1685317136 >> 172.21.15.117:0/1685317136 conn(0x7fb1040be4b0 msgr2=0x7fb1041456f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:42.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.623+0000 7fb108aca700 1 -- 172.21.15.117:0/1685317136 shutdown_connections 2023-07-19T20:44:42.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.623+0000 7fb108aca700 1 -- 172.21.15.117:0/1685317136 wait complete. 2023-07-19T20:44:42.625 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2023-07-19T20:44:42.628 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-07-19T20:44:41.686109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218556,"kb_used_data":2940,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756164,"statfs":{"total":773094113280,"available":772870311936,"internally_reserved":0,"allocated":3010560,"data_stored":1820955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.552006"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557519+0000","last_change":"2023-07-19T20:44:38.557553+0000","last_active":"2023-07-19T20:44:39.557519+0000","last_peered":"2023-07-19T20:44:39.557519+0000","last_clean":"2023-07-19T20:44:39.557519+0000","last_became_active":"2023-07-19T20:44:38.557300+0000","last_became_peered":"2023-07-19T20:44:38.557300+0000","last_unstale":"2023-07-19T20:44:39.557519+0000","last_undegraded":"2023-07-19T20:44:39.557519+0000","last_fullsized":"2023-07-19T20:44:39.557519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:51:24.459453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967118+0000","last_change":"2023-07-19T20:44:38.568068+0000","last_active":"2023-07-19T20:44:39.967118+0000","last_peered":"2023-07-19T20:44:39.967118+0000","last_clean":"2023-07-19T20:44:39.967118+0000","last_became_active":"2023-07-19T20:44:38.567801+0000","last_became_peered":"2023-07-19T20:44:38.567801+0000","last_unstale":"2023-07-19T20:44:39.967118+0000","last_undegraded":"2023-07-19T20:44:39.967118+0000","last_fullsized":"2023-07-19T20:44:39.967118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:54:57.194368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966678+0000","last_change":"2023-07-19T20:44:38.570481+0000","last_active":"2023-07-19T20:44:39.966678+0000","last_peered":"2023-07-19T20:44:39.966678+0000","last_clean":"2023-07-19T20:44:39.966678+0000","last_became_active":"2023-07-19T20:44:38.570229+0000","last_became_peered":"2023-07-19T20:44:38.570229+0000","last_unstale":"2023-07-19T20:44:39.966678+0000","last_undegraded":"2023-07-19T20:44:39.966678+0000","last_fullsized":"2023-07-19T20:44:39.966678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:14:05.967200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557053+0000","last_change":"2023-07-19T20:44:38.570166+0000","last_active":"2023-07-19T20:44:39.557053+0000","last_peered":"2023-07-19T20:44:39.557053+0000","last_clean":"2023-07-19T20:44:39.557053+0000","last_became_active":"2023-07-19T20:44:38.569877+0000","last_became_peered":"2023-07-19T20:44:38.569877+0000","last_unstale":"2023-07-19T20:44:39.557053+0000","last_undegraded":"2023-07-19T20:44:39.557053+0000","last_fullsized":"2023-07-19T20:44:39.557053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:50:18.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965691+0000","last_change":"2023-07-19T20:44:38.571798+0000","last_active":"2023-07-19T20:44:39.965691+0000","last_peered":"2023-07-19T20:44:39.965691+0000","last_clean":"2023-07-19T20:44:39.965691+0000","last_became_active":"2023-07-19T20:44:38.571402+0000","last_became_peered":"2023-07-19T20:44:38.571402+0000","last_unstale":"2023-07-19T20:44:39.965691+0000","last_undegraded":"2023-07-19T20:44:39.965691+0000","last_fullsized":"2023-07-19T20:44:39.965691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:15:18.131376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965752+0000","last_change":"2023-07-19T20:44:38.572155+0000","last_active":"2023-07-19T20:44:39.965752+0000","last_peered":"2023-07-19T20:44:39.965752+0000","last_clean":"2023-07-19T20:44:39.965752+0000","last_became_active":"2023-07-19T20:44:38.571889+0000","last_became_peered":"2023-07-19T20:44:38.571889+0000","last_unstale":"2023-07-19T20:44:39.965752+0000","last_undegraded":"2023-07-19T20:44:39.965752+0000","last_fullsized":"2023-07-19T20:44:39.965752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:05:47.118546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965842+0000","last_change":"2023-07-19T20:44:38.583148+0000","last_active":"2023-07-19T20:44:39.965842+0000","last_peered":"2023-07-19T20:44:39.965842+0000","last_clean":"2023-07-19T20:44:39.965842+0000","last_became_active":"2023-07-19T20:44:38.582674+0000","last_became_peered":"2023-07-19T20:44:38.582674+0000","last_unstale":"2023-07-19T20:44:39.965842+0000","last_undegraded":"2023-07-19T20:44:39.965842+0000","last_fullsized":"2023-07-19T20:44:39.965842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966760+0000","last_change":"2023-07-19T20:44:38.563551+0000","last_active":"2023-07-19T20:44:39.966760+0000","last_peered":"2023-07-19T20:44:39.966760+0000","last_clean":"2023-07-19T20:44:39.966760+0000","last_became_active":"2023-07-19T20:44:38.563241+0000","last_became_peered":"2023-07-19T20:44:38.563241+0000","last_unstale":"2023-07-19T20:44:39.966760+0000","last_undegraded":"2023-07-19T20:44:39.966760+0000","last_fullsized":"2023-07-19T20:44:39.966760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:41:57.896806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965333+0000","last_change":"2023-07-19T20:44:38.568101+0000","last_active":"2023-07-19T20:44:39.965333+0000","last_peered":"2023-07-19T20:44:39.965333+0000","last_clean":"2023-07-19T20:44:39.965333+0000","last_became_active":"2023-07-19T20:44:38.567841+0000","last_became_peered":"2023-07-19T20:44:38.567841+0000","last_unstale":"2023-07-19T20:44:39.965333+0000","last_undegraded":"2023-07-19T20:44:39.965333+0000","last_fullsized":"2023-07-19T20:44:39.965333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:47:51.985998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967220+0000","last_change":"2023-07-19T20:44:38.573636+0000","last_active":"2023-07-19T20:44:39.967220+0000","last_peered":"2023-07-19T20:44:39.967220+0000","last_clean":"2023-07-19T20:44:39.967220+0000","last_became_active":"2023-07-19T20:44:38.572946+0000","last_became_peered":"2023-07-19T20:44:38.572946+0000","last_unstale":"2023-07-19T20:44:39.967220+0000","last_undegraded":"2023-07-19T20:44:39.967220+0000","last_fullsized":"2023-07-19T20:44:39.967220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:44:21.312824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966695+0000","last_change":"2023-07-19T20:44:38.569267+0000","last_active":"2023-07-19T20:44:39.966695+0000","last_peered":"2023-07-19T20:44:39.966695+0000","last_clean":"2023-07-19T20:44:39.966695+0000","last_became_active":"2023-07-19T20:44:38.568642+0000","last_became_peered":"2023-07-19T20:44:38.568642+0000","last_unstale":"2023-07-19T20:44:39.966695+0000","last_undegraded":"2023-07-19T20:44:39.966695+0000","last_fullsized":"2023-07-19T20:44:39.966695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:05:25.043607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557296+0000","last_change":"2023-07-19T20:44:38.563272+0000","last_active":"2023-07-19T20:44:39.557296+0000","last_peered":"2023-07-19T20:44:39.557296+0000","last_clean":"2023-07-19T20:44:39.557296+0000","last_became_active":"2023-07-19T20:44:38.562986+0000","last_became_peered":"2023-07-19T20:44:38.562986+0000","last_unstale":"2023-07-19T20:44:39.557296+0000","last_undegraded":"2023-07-19T20:44:39.557296+0000","last_fullsized":"2023-07-19T20:44:39.557296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:10:44.096418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557003+0000","last_change":"2023-07-19T20:44:38.558158+0000","last_active":"2023-07-19T20:44:39.557003+0000","last_peered":"2023-07-19T20:44:39.557003+0000","last_clean":"2023-07-19T20:44:39.557003+0000","last_became_active":"2023-07-19T20:44:38.557930+0000","last_became_peered":"2023-07-19T20:44:38.557930+0000","last_unstale":"2023-07-19T20:44:39.557003+0000","last_undegraded":"2023-07-19T20:44:39.557003+0000","last_fullsized":"2023-07-19T20:44:39.557003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:29:27.698047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967203+0000","last_change":"2023-07-19T20:44:38.561137+0000","last_active":"2023-07-19T20:44:39.967203+0000","last_peered":"2023-07-19T20:44:39.967203+0000","last_clean":"2023-07-19T20:44:39.967203+0000","last_became_active":"2023-07-19T20:44:38.560853+0000","last_became_peered":"2023-07-19T20:44:38.560853+0000","last_unstale":"2023-07-19T20:44:39.967203+0000","last_undegraded":"2023-07-19T20:44:39.967203+0000","last_fullsized":"2023-07-19T20:44:39.967203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:01:57.502720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965944+0000","last_change":"2023-07-19T20:44:38.583262+0000","last_active":"2023-07-19T20:44:39.965944+0000","last_peered":"2023-07-19T20:44:39.965944+0000","last_clean":"2023-07-19T20:44:39.965944+0000","last_became_active":"2023-07-19T20:44:38.582950+0000","last_became_peered":"2023-07-19T20:44:38.582950+0000","last_unstale":"2023-07-19T20:44:39.965944+0000","last_undegraded":"2023-07-19T20:44:39.965944+0000","last_fullsized":"2023-07-19T20:44:39.965944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:47:20.937341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965794+0000","last_change":"2023-07-19T20:44:38.572479+0000","last_active":"2023-07-19T20:44:39.965794+0000","last_peered":"2023-07-19T20:44:39.965794+0000","last_clean":"2023-07-19T20:44:39.965794+0000","last_became_active":"2023-07-19T20:44:38.572213+0000","last_became_peered":"2023-07-19T20:44:38.572213+0000","last_unstale":"2023-07-19T20:44:39.965794+0000","last_undegraded":"2023-07-19T20:44:39.965794+0000","last_fullsized":"2023-07-19T20:44:39.965794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:21:54.976852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965428+0000","last_change":"2023-07-19T20:44:38.568103+0000","last_active":"2023-07-19T20:44:39.965428+0000","last_peered":"2023-07-19T20:44:39.965428+0000","last_clean":"2023-07-19T20:44:39.965428+0000","last_became_active":"2023-07-19T20:44:38.567824+0000","last_became_peered":"2023-07-19T20:44:38.567824+0000","last_unstale":"2023-07-19T20:44:39.965428+0000","last_undegraded":"2023-07-19T20:44:39.965428+0000","last_fullsized":"2023-07-19T20:44:39.965428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:45:53.848298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966933+0000","last_change":"2023-07-19T20:44:38.567578+0000","last_active":"2023-07-19T20:44:39.966933+0000","last_peered":"2023-07-19T20:44:39.966933+0000","last_clean":"2023-07-19T20:44:39.966933+0000","last_became_active":"2023-07-19T20:44:38.567290+0000","last_became_peered":"2023-07-19T20:44:38.567290+0000","last_unstale":"2023-07-19T20:44:39.966933+0000","last_undegraded":"2023-07-19T20:44:39.966933+0000","last_fullsized":"2023-07-19T20:44:39.966933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:58:55.531091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557561+0000","last_change":"2023-07-19T20:44:38.572691+0000","last_active":"2023-07-19T20:44:39.557561+0000","last_peered":"2023-07-19T20:44:39.557561+0000","last_clean":"2023-07-19T20:44:39.557561+0000","last_became_active":"2023-07-19T20:44:38.572438+0000","last_became_peered":"2023-07-19T20:44:38.572438+0000","last_unstale":"2023-07-19T20:44:39.557561+0000","last_undegraded":"2023-07-19T20:44:39.557561+0000","last_fullsized":"2023-07-19T20:44:39.557561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:40:43.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966413+0000","last_change":"2023-07-19T20:44:38.567705+0000","last_active":"2023-07-19T20:44:39.966413+0000","last_peered":"2023-07-19T20:44:39.966413+0000","last_clean":"2023-07-19T20:44:39.966413+0000","last_became_active":"2023-07-19T20:44:38.567230+0000","last_became_peered":"2023-07-19T20:44:38.567230+0000","last_unstale":"2023-07-19T20:44:39.966413+0000","last_undegraded":"2023-07-19T20:44:39.966413+0000","last_fullsized":"2023-07-19T20:44:39.966413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:16:57.118793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966275+0000","last_change":"2023-07-19T20:44:38.583001+0000","last_active":"2023-07-19T20:44:39.966275+0000","last_peered":"2023-07-19T20:44:39.966275+0000","last_clean":"2023-07-19T20:44:39.966275+0000","last_became_active":"2023-07-19T20:44:38.582767+0000","last_became_peered":"2023-07-19T20:44:38.582767+0000","last_unstale":"2023-07-19T20:44:39.966275+0000","last_undegraded":"2023-07-19T20:44:39.966275+0000","last_fullsized":"2023-07-19T20:44:39.966275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:30:42.451874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965394+0000","last_change":"2023-07-19T20:44:38.571958+0000","last_active":"2023-07-19T20:44:39.965394+0000","last_peered":"2023-07-19T20:44:39.965394+0000","last_clean":"2023-07-19T20:44:39.965394+0000","last_became_active":"2023-07-19T20:44:38.571485+0000","last_became_peered":"2023-07-19T20:44:38.571485+0000","last_unstale":"2023-07-19T20:44:39.965394+0000","last_undegraded":"2023-07-19T20:44:39.965394+0000","last_fullsized":"2023-07-19T20:44:39.965394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965238+0000","last_change":"2023-07-19T20:44:38.566759+0000","last_active":"2023-07-19T20:44:39.965238+0000","last_peered":"2023-07-19T20:44:39.965238+0000","last_clean":"2023-07-19T20:44:39.965238+0000","last_became_active":"2023-07-19T20:44:38.566496+0000","last_became_peered":"2023-07-19T20:44:38.566496+0000","last_unstale":"2023-07-19T20:44:39.965238+0000","last_undegraded":"2023-07-19T20:44:39.965238+0000","last_fullsized":"2023-07-19T20:44:39.965238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:40:30.028440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966363+0000","last_change":"2023-07-19T20:44:38.582748+0000","last_active":"2023-07-19T20:44:39.966363+0000","last_peered":"2023-07-19T20:44:39.966363+0000","last_clean":"2023-07-19T20:44:39.966363+0000","last_became_active":"2023-07-19T20:44:38.582492+0000","last_became_peered":"2023-07-19T20:44:38.582492+0000","last_unstale":"2023-07-19T20:44:39.966363+0000","last_undegraded":"2023-07-19T20:44:39.966363+0000","last_fullsized":"2023-07-19T20:44:39.966363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556709+0000","last_change":"2023-07-19T20:44:38.573862+0000","last_active":"2023-07-19T20:44:39.556709+0000","last_peered":"2023-07-19T20:44:39.556709+0000","last_clean":"2023-07-19T20:44:39.556709+0000","last_became_active":"2023-07-19T20:44:38.573438+0000","last_became_peered":"2023-07-19T20:44:38.573438+0000","last_unstale":"2023-07-19T20:44:39.556709+0000","last_undegraded":"2023-07-19T20:44:39.556709+0000","last_fullsized":"2023-07-19T20:44:39.556709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:48:50.207451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556599+0000","last_change":"2023-07-19T20:44:38.573890+0000","last_active":"2023-07-19T20:44:39.556599+0000","last_peered":"2023-07-19T20:44:39.556599+0000","last_clean":"2023-07-19T20:44:39.556599+0000","last_became_active":"2023-07-19T20:44:38.573657+0000","last_became_peered":"2023-07-19T20:44:38.573657+0000","last_unstale":"2023-07-19T20:44:39.556599+0000","last_undegraded":"2023-07-19T20:44:39.556599+0000","last_fullsized":"2023-07-19T20:44:39.556599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:50:18.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967285+0000","last_change":"2023-07-19T20:44:38.578334+0000","last_active":"2023-07-19T20:44:39.967285+0000","last_peered":"2023-07-19T20:44:39.967285+0000","last_clean":"2023-07-19T20:44:39.967285+0000","last_became_active":"2023-07-19T20:44:38.578066+0000","last_became_peered":"2023-07-19T20:44:38.578066+0000","last_unstale":"2023-07-19T20:44:39.967285+0000","last_undegraded":"2023-07-19T20:44:39.967285+0000","last_fullsized":"2023-07-19T20:44:39.967285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965878+0000","last_change":"2023-07-19T20:44:38.150761+0000","last_active":"2023-07-19T20:44:39.965878+0000","last_peered":"2023-07-19T20:44:39.965878+0000","last_clean":"2023-07-19T20:44:39.965878+0000","last_became_active":"2023-07-19T20:44:38.150480+0000","last_became_peered":"2023-07-19T20:44:38.150480+0000","last_unstale":"2023-07-19T20:44:39.965878+0000","last_undegraded":"2023-07-19T20:44:39.965878+0000","last_fullsized":"2023-07-19T20:44:39.965878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:29:26.692730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965845+0000","last_change":"2023-07-19T20:44:38.573757+0000","last_active":"2023-07-19T20:44:39.965845+0000","last_peered":"2023-07-19T20:44:39.965845+0000","last_clean":"2023-07-19T20:44:39.965845+0000","last_became_active":"2023-07-19T20:44:38.573579+0000","last_became_peered":"2023-07-19T20:44:38.573579+0000","last_unstale":"2023-07-19T20:44:39.965845+0000","last_undegraded":"2023-07-19T20:44:39.965845+0000","last_fullsized":"2023-07-19T20:44:39.965845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:45:53.848298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556369+0000","last_change":"2023-07-19T20:44:38.163117+0000","last_active":"2023-07-19T20:44:39.556369+0000","last_peered":"2023-07-19T20:44:39.556369+0000","last_clean":"2023-07-19T20:44:39.556369+0000","last_became_active":"2023-07-19T20:44:38.162834+0000","last_became_peered":"2023-07-19T20:44:38.162834+0000","last_unstale":"2023-07-19T20:44:39.556369+0000","last_undegraded":"2023-07-19T20:44:39.556369+0000","last_fullsized":"2023-07-19T20:44:39.556369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:40:42.266562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965931+0000","last_change":"2023-07-19T20:44:38.582906+0000","last_active":"2023-07-19T20:44:39.965931+0000","last_peered":"2023-07-19T20:44:39.965931+0000","last_clean":"2023-07-19T20:44:39.965931+0000","last_became_active":"2023-07-19T20:44:38.582633+0000","last_became_peered":"2023-07-19T20:44:38.582633+0000","last_unstale":"2023-07-19T20:44:39.965931+0000","last_undegraded":"2023-07-19T20:44:39.965931+0000","last_fullsized":"2023-07-19T20:44:39.965931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:07:43.608434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965284+0000","last_change":"2023-07-19T20:44:38.162257+0000","last_active":"2023-07-19T20:44:39.965284+0000","last_peered":"2023-07-19T20:44:39.965284+0000","last_clean":"2023-07-19T20:44:39.965284+0000","last_became_active":"2023-07-19T20:44:38.161974+0000","last_became_peered":"2023-07-19T20:44:38.161974+0000","last_unstale":"2023-07-19T20:44:39.965284+0000","last_undegraded":"2023-07-19T20:44:39.965284+0000","last_fullsized":"2023-07-19T20:44:39.965284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:27:00.609956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557276+0000","last_change":"2023-07-19T20:44:38.570736+0000","last_active":"2023-07-19T20:44:39.557276+0000","last_peered":"2023-07-19T20:44:39.557276+0000","last_clean":"2023-07-19T20:44:39.557276+0000","last_became_active":"2023-07-19T20:44:38.570456+0000","last_became_peered":"2023-07-19T20:44:38.570456+0000","last_unstale":"2023-07-19T20:44:39.557276+0000","last_undegraded":"2023-07-19T20:44:39.557276+0000","last_fullsized":"2023-07-19T20:44:39.557276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:47:25.794801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965516+0000","last_change":"2023-07-19T20:44:38.156406+0000","last_active":"2023-07-19T20:44:39.965516+0000","last_peered":"2023-07-19T20:44:39.965516+0000","last_clean":"2023-07-19T20:44:39.965516+0000","last_became_active":"2023-07-19T20:44:38.156105+0000","last_became_peered":"2023-07-19T20:44:38.156105+0000","last_unstale":"2023-07-19T20:44:39.965516+0000","last_undegraded":"2023-07-19T20:44:39.965516+0000","last_fullsized":"2023-07-19T20:44:39.965516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:27:00.609956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965254+0000","last_change":"2023-07-19T20:44:38.566993+0000","last_active":"2023-07-19T20:44:39.965254+0000","last_peered":"2023-07-19T20:44:39.965254+0000","last_clean":"2023-07-19T20:44:39.965254+0000","last_became_active":"2023-07-19T20:44:38.566840+0000","last_became_peered":"2023-07-19T20:44:38.566840+0000","last_unstale":"2023-07-19T20:44:39.965254+0000","last_undegraded":"2023-07-19T20:44:39.965254+0000","last_fullsized":"2023-07-19T20:44:39.965254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:47:51.985998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967138+0000","last_change":"2023-07-19T20:44:38.158430+0000","last_active":"2023-07-19T20:44:39.967138+0000","last_peered":"2023-07-19T20:44:39.967138+0000","last_clean":"2023-07-19T20:44:39.967138+0000","last_became_active":"2023-07-19T20:44:38.158144+0000","last_became_peered":"2023-07-19T20:44:38.158144+0000","last_unstale":"2023-07-19T20:44:39.967138+0000","last_undegraded":"2023-07-19T20:44:39.967138+0000","last_fullsized":"2023-07-19T20:44:39.967138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:27:00.609956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965414+0000","last_change":"2023-07-19T20:44:38.578647+0000","last_active":"2023-07-19T20:44:39.965414+0000","last_peered":"2023-07-19T20:44:39.965414+0000","last_clean":"2023-07-19T20:44:39.965414+0000","last_became_active":"2023-07-19T20:44:38.578203+0000","last_became_peered":"2023-07-19T20:44:38.578203+0000","last_unstale":"2023-07-19T20:44:39.965414+0000","last_undegraded":"2023-07-19T20:44:39.965414+0000","last_fullsized":"2023-07-19T20:44:39.965414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:15:18.131376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966763+0000","last_change":"2023-07-19T20:44:38.162400+0000","last_active":"2023-07-19T20:44:39.966763+0000","last_peered":"2023-07-19T20:44:39.966763+0000","last_clean":"2023-07-19T20:44:39.966763+0000","last_became_active":"2023-07-19T20:44:38.161909+0000","last_became_peered":"2023-07-19T20:44:38.161909+0000","last_unstale":"2023-07-19T20:44:39.966763+0000","last_undegraded":"2023-07-19T20:44:39.966763+0000","last_fullsized":"2023-07-19T20:44:39.966763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:06:03.165653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556326+0000","last_change":"2023-07-19T20:44:38.576965+0000","last_active":"2023-07-19T20:44:39.556326+0000","last_peered":"2023-07-19T20:44:39.556326+0000","last_clean":"2023-07-19T20:44:39.556326+0000","last_became_active":"2023-07-19T20:44:38.574467+0000","last_became_peered":"2023-07-19T20:44:38.574467+0000","last_unstale":"2023-07-19T20:44:39.556326+0000","last_undegraded":"2023-07-19T20:44:39.556326+0000","last_fullsized":"2023-07-19T20:44:39.556326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:29:14.941818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966551+0000","last_change":"2023-07-19T20:44:38.159725+0000","last_active":"2023-07-19T20:44:39.966551+0000","last_peered":"2023-07-19T20:44:39.966551+0000","last_clean":"2023-07-19T20:44:39.966551+0000","last_became_active":"2023-07-19T20:44:38.159461+0000","last_became_peered":"2023-07-19T20:44:38.159461+0000","last_unstale":"2023-07-19T20:44:39.966551+0000","last_undegraded":"2023-07-19T20:44:39.966551+0000","last_fullsized":"2023-07-19T20:44:39.966551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:10:43.091101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966298+0000","last_change":"2023-07-19T20:44:38.570213+0000","last_active":"2023-07-19T20:44:39.966298+0000","last_peered":"2023-07-19T20:44:39.966298+0000","last_clean":"2023-07-19T20:44:39.966298+0000","last_became_active":"2023-07-19T20:44:38.567536+0000","last_became_peered":"2023-07-19T20:44:38.567536+0000","last_unstale":"2023-07-19T20:44:39.966298+0000","last_undegraded":"2023-07-19T20:44:39.966298+0000","last_fullsized":"2023-07-19T20:44:39.966298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:43:36.018520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966166+0000","last_change":"2023-07-19T20:44:38.161200+0000","last_active":"2023-07-19T20:44:39.966166+0000","last_peered":"2023-07-19T20:44:39.966166+0000","last_clean":"2023-07-19T20:44:39.966166+0000","last_became_active":"2023-07-19T20:44:38.160914+0000","last_became_peered":"2023-07-19T20:44:38.160914+0000","last_unstale":"2023-07-19T20:44:39.966166+0000","last_undegraded":"2023-07-19T20:44:39.966166+0000","last_fullsized":"2023-07-19T20:44:39.966166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:22:47.753831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965319+0000","last_change":"2023-07-19T20:44:38.573870+0000","last_active":"2023-07-19T20:44:39.965319+0000","last_peered":"2023-07-19T20:44:39.965319+0000","last_clean":"2023-07-19T20:44:39.965319+0000","last_became_active":"2023-07-19T20:44:38.573603+0000","last_became_peered":"2023-07-19T20:44:38.573603+0000","last_unstale":"2023-07-19T20:44:39.965319+0000","last_undegraded":"2023-07-19T20:44:39.965319+0000","last_fullsized":"2023-07-19T20:44:39.965319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:07:43.608434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965884+0000","last_change":"2023-07-19T20:44:38.158352+0000","last_active":"2023-07-19T20:44:39.965884+0000","last_peered":"2023-07-19T20:44:39.965884+0000","last_clean":"2023-07-19T20:44:39.965884+0000","last_became_active":"2023-07-19T20:44:38.158108+0000","last_became_peered":"2023-07-19T20:44:38.158108+0000","last_unstale":"2023-07-19T20:44:39.965884+0000","last_undegraded":"2023-07-19T20:44:39.965884+0000","last_fullsized":"2023-07-19T20:44:39.965884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:56:20.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967338+0000","last_change":"2023-07-19T20:44:38.578475+0000","last_active":"2023-07-19T20:44:39.967338+0000","last_peered":"2023-07-19T20:44:39.967338+0000","last_clean":"2023-07-19T20:44:39.967338+0000","last_became_active":"2023-07-19T20:44:38.578148+0000","last_became_peered":"2023-07-19T20:44:38.578148+0000","last_unstale":"2023-07-19T20:44:39.967338+0000","last_undegraded":"2023-07-19T20:44:39.967338+0000","last_fullsized":"2023-07-19T20:44:39.967338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:47:20.937341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966031+0000","last_change":"2023-07-19T20:44:38.161146+0000","last_active":"2023-07-19T20:44:39.966031+0000","last_peered":"2023-07-19T20:44:39.966031+0000","last_clean":"2023-07-19T20:44:39.966031+0000","last_became_active":"2023-07-19T20:44:38.160826+0000","last_became_peered":"2023-07-19T20:44:38.160826+0000","last_unstale":"2023-07-19T20:44:39.966031+0000","last_undegraded":"2023-07-19T20:44:39.966031+0000","last_fullsized":"2023-07-19T20:44:39.966031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:00:17.913421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965696+0000","last_change":"2023-07-19T20:44:38.575529+0000","last_active":"2023-07-19T20:44:39.965696+0000","last_peered":"2023-07-19T20:44:39.965696+0000","last_clean":"2023-07-19T20:44:39.965696+0000","last_became_active":"2023-07-19T20:44:38.571437+0000","last_became_peered":"2023-07-19T20:44:38.571437+0000","last_unstale":"2023-07-19T20:44:39.965696+0000","last_undegraded":"2023-07-19T20:44:39.965696+0000","last_fullsized":"2023-07-19T20:44:39.965696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:31:08.854923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556868+0000","last_change":"2023-07-19T20:44:38.151428+0000","last_active":"2023-07-19T20:44:39.556868+0000","last_peered":"2023-07-19T20:44:39.556868+0000","last_clean":"2023-07-19T20:44:39.556868+0000","last_became_active":"2023-07-19T20:44:38.150814+0000","last_became_peered":"2023-07-19T20:44:38.150814+0000","last_unstale":"2023-07-19T20:44:39.556868+0000","last_undegraded":"2023-07-19T20:44:39.556868+0000","last_fullsized":"2023-07-19T20:44:39.556868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:43:49.400337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966925+0000","last_change":"2023-07-19T20:44:38.578498+0000","last_active":"2023-07-19T20:44:39.966925+0000","last_peered":"2023-07-19T20:44:39.966925+0000","last_clean":"2023-07-19T20:44:39.966925+0000","last_became_active":"2023-07-19T20:44:38.578229+0000","last_became_peered":"2023-07-19T20:44:38.578229+0000","last_unstale":"2023-07-19T20:44:39.966925+0000","last_undegraded":"2023-07-19T20:44:39.966925+0000","last_fullsized":"2023-07-19T20:44:39.966925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965996+0000","last_change":"2023-07-19T20:44:38.162523+0000","last_active":"2023-07-19T20:44:39.965996+0000","last_peered":"2023-07-19T20:44:39.965996+0000","last_clean":"2023-07-19T20:44:39.965996+0000","last_became_active":"2023-07-19T20:44:38.162180+0000","last_became_peered":"2023-07-19T20:44:38.162180+0000","last_unstale":"2023-07-19T20:44:39.965996+0000","last_undegraded":"2023-07-19T20:44:39.965996+0000","last_fullsized":"2023-07-19T20:44:39.965996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:51:41.425413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966943+0000","last_change":"2023-07-19T20:44:38.578374+0000","last_active":"2023-07-19T20:44:39.966943+0000","last_peered":"2023-07-19T20:44:39.966943+0000","last_clean":"2023-07-19T20:44:39.966943+0000","last_became_active":"2023-07-19T20:44:38.578063+0000","last_became_peered":"2023-07-19T20:44:38.578063+0000","last_unstale":"2023-07-19T20:44:39.966943+0000","last_undegraded":"2023-07-19T20:44:39.966943+0000","last_fullsized":"2023-07-19T20:44:39.966943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966034+0000","last_change":"2023-07-19T20:44:38.161133+0000","last_active":"2023-07-19T20:44:39.966034+0000","last_peered":"2023-07-19T20:44:39.966034+0000","last_clean":"2023-07-19T20:44:39.966034+0000","last_became_active":"2023-07-19T20:44:38.160858+0000","last_became_peered":"2023-07-19T20:44:38.160858+0000","last_unstale":"2023-07-19T20:44:39.966034+0000","last_undegraded":"2023-07-19T20:44:39.966034+0000","last_fullsized":"2023-07-19T20:44:39.966034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966513+0000","last_change":"2023-07-19T20:44:38.569109+0000","last_active":"2023-07-19T20:44:39.966513+0000","last_peered":"2023-07-19T20:44:39.966513+0000","last_clean":"2023-07-19T20:44:39.966513+0000","last_became_active":"2023-07-19T20:44:38.568655+0000","last_became_peered":"2023-07-19T20:44:38.568655+0000","last_unstale":"2023-07-19T20:44:39.966513+0000","last_undegraded":"2023-07-19T20:44:39.966513+0000","last_fullsized":"2023-07-19T20:44:39.966513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:22:21.797390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966727+0000","last_change":"2023-07-19T20:44:38.159979+0000","last_active":"2023-07-19T20:44:39.966727+0000","last_peered":"2023-07-19T20:44:39.966727+0000","last_clean":"2023-07-19T20:44:39.966727+0000","last_became_active":"2023-07-19T20:44:38.159724+0000","last_became_peered":"2023-07-19T20:44:38.159724+0000","last_unstale":"2023-07-19T20:44:39.966727+0000","last_undegraded":"2023-07-19T20:44:39.966727+0000","last_fullsized":"2023-07-19T20:44:39.966727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:13:29.703932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557319+0000","last_change":"2023-07-19T20:44:38.573821+0000","last_active":"2023-07-19T20:44:39.557319+0000","last_peered":"2023-07-19T20:44:39.557319+0000","last_clean":"2023-07-19T20:44:39.557319+0000","last_became_active":"2023-07-19T20:44:38.573531+0000","last_became_peered":"2023-07-19T20:44:38.573531+0000","last_unstale":"2023-07-19T20:44:39.557319+0000","last_undegraded":"2023-07-19T20:44:39.557319+0000","last_fullsized":"2023-07-19T20:44:39.557319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:12:57.038089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967186+0000","last_change":"2023-07-19T20:44:38.161247+0000","last_active":"2023-07-19T20:44:39.967186+0000","last_peered":"2023-07-19T20:44:39.967186+0000","last_clean":"2023-07-19T20:44:39.967186+0000","last_became_active":"2023-07-19T20:44:38.160983+0000","last_became_peered":"2023-07-19T20:44:38.160983+0000","last_unstale":"2023-07-19T20:44:39.967186+0000","last_undegraded":"2023-07-19T20:44:39.967186+0000","last_fullsized":"2023-07-19T20:44:39.967186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:48:53.708405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965596+0000","last_change":"2023-07-19T20:44:38.570267+0000","last_active":"2023-07-19T20:44:39.965596+0000","last_peered":"2023-07-19T20:44:39.965596+0000","last_clean":"2023-07-19T20:44:39.965596+0000","last_became_active":"2023-07-19T20:44:38.569970+0000","last_became_peered":"2023-07-19T20:44:38.569970+0000","last_unstale":"2023-07-19T20:44:39.965596+0000","last_undegraded":"2023-07-19T20:44:39.965596+0000","last_fullsized":"2023-07-19T20:44:39.965596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965824+0000","last_change":"2023-07-19T20:44:38.162813+0000","last_active":"2023-07-19T20:44:39.965824+0000","last_peered":"2023-07-19T20:44:39.965824+0000","last_clean":"2023-07-19T20:44:39.965824+0000","last_became_active":"2023-07-19T20:44:38.162512+0000","last_became_peered":"2023-07-19T20:44:38.162512+0000","last_unstale":"2023-07-19T20:44:39.965824+0000","last_undegraded":"2023-07-19T20:44:39.965824+0000","last_fullsized":"2023-07-19T20:44:39.965824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:56:20.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966572+0000","last_change":"2023-07-19T20:44:38.574677+0000","last_active":"2023-07-19T20:44:39.966572+0000","last_peered":"2023-07-19T20:44:39.966572+0000","last_clean":"2023-07-19T20:44:39.966572+0000","last_became_active":"2023-07-19T20:44:38.574384+0000","last_became_peered":"2023-07-19T20:44:38.574384+0000","last_unstale":"2023-07-19T20:44:39.966572+0000","last_undegraded":"2023-07-19T20:44:39.966572+0000","last_fullsized":"2023-07-19T20:44:39.966572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:56:39.985134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557050+0000","last_change":"2023-07-19T20:44:38.157897+0000","last_active":"2023-07-19T20:44:39.557050+0000","last_peered":"2023-07-19T20:44:39.557050+0000","last_clean":"2023-07-19T20:44:39.557050+0000","last_became_active":"2023-07-19T20:44:38.157613+0000","last_became_peered":"2023-07-19T20:44:38.157613+0000","last_unstale":"2023-07-19T20:44:39.557050+0000","last_undegraded":"2023-07-19T20:44:39.557050+0000","last_fullsized":"2023-07-19T20:44:39.557050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:10:43.091101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966876+0000","last_change":"2023-07-19T20:44:38.567166+0000","last_active":"2023-07-19T20:44:39.966876+0000","last_peered":"2023-07-19T20:44:39.966876+0000","last_clean":"2023-07-19T20:44:39.966876+0000","last_became_active":"2023-07-19T20:44:38.566539+0000","last_became_peered":"2023-07-19T20:44:38.566539+0000","last_unstale":"2023-07-19T20:44:39.966876+0000","last_undegraded":"2023-07-19T20:44:39.966876+0000","last_fullsized":"2023-07-19T20:44:39.966876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:57:34.828178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966584+0000","last_change":"2023-07-19T20:44:38.153301+0000","last_active":"2023-07-19T20:44:39.966584+0000","last_peered":"2023-07-19T20:44:39.966584+0000","last_clean":"2023-07-19T20:44:39.966584+0000","last_became_active":"2023-07-19T20:44:38.153036+0000","last_became_peered":"2023-07-19T20:44:38.153036+0000","last_unstale":"2023-07-19T20:44:39.966584+0000","last_undegraded":"2023-07-19T20:44:39.966584+0000","last_fullsized":"2023-07-19T20:44:39.966584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:29:36.129487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966373+0000","last_change":"2023-07-19T20:44:38.566702+0000","last_active":"2023-07-19T20:44:39.966373+0000","last_peered":"2023-07-19T20:44:39.966373+0000","last_clean":"2023-07-19T20:44:39.966373+0000","last_became_active":"2023-07-19T20:44:38.566298+0000","last_became_peered":"2023-07-19T20:44:38.566298+0000","last_unstale":"2023-07-19T20:44:39.966373+0000","last_undegraded":"2023-07-19T20:44:39.966373+0000","last_fullsized":"2023-07-19T20:44:39.966373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:40:21.960885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965195+0000","last_change":"2023-07-19T20:44:38.161123+0000","last_active":"2023-07-19T20:44:39.965195+0000","last_peered":"2023-07-19T20:44:39.965195+0000","last_clean":"2023-07-19T20:44:39.965195+0000","last_became_active":"2023-07-19T20:44:38.160828+0000","last_became_peered":"2023-07-19T20:44:38.160828+0000","last_unstale":"2023-07-19T20:44:39.965195+0000","last_undegraded":"2023-07-19T20:44:39.965195+0000","last_fullsized":"2023-07-19T20:44:39.965195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556893+0000","last_change":"2023-07-19T20:44:38.573695+0000","last_active":"2023-07-19T20:44:39.556893+0000","last_peered":"2023-07-19T20:44:39.556893+0000","last_clean":"2023-07-19T20:44:39.556893+0000","last_became_active":"2023-07-19T20:44:38.573109+0000","last_became_peered":"2023-07-19T20:44:38.573109+0000","last_unstale":"2023-07-19T20:44:39.556893+0000","last_undegraded":"2023-07-19T20:44:39.556893+0000","last_fullsized":"2023-07-19T20:44:39.556893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:10:27.373852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966776+0000","last_change":"2023-07-19T20:44:38.159710+0000","last_active":"2023-07-19T20:44:39.966776+0000","last_peered":"2023-07-19T20:44:39.966776+0000","last_clean":"2023-07-19T20:44:39.966776+0000","last_became_active":"2023-07-19T20:44:38.159491+0000","last_became_peered":"2023-07-19T20:44:38.159491+0000","last_unstale":"2023-07-19T20:44:39.966776+0000","last_undegraded":"2023-07-19T20:44:39.966776+0000","last_fullsized":"2023-07-19T20:44:39.966776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:48:53.708405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.556794+0000","last_change":"2023-07-19T20:44:33.123673+0000","last_active":"2023-07-19T20:44:38.556794+0000","last_peered":"2023-07-19T20:44:38.556794+0000","last_clean":"2023-07-19T20:44:38.556794+0000","last_became_active":"2023-07-19T20:44:33.123400+0000","last_became_peered":"2023-07-19T20:44:33.123400+0000","last_unstale":"2023-07-19T20:44:38.556794+0000","last_undegraded":"2023-07-19T20:44:38.556794+0000","last_fullsized":"2023-07-19T20:44:38.556794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:29:32.159769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965145+0000","last_change":"2023-07-19T20:44:38.578403+0000","last_active":"2023-07-19T20:44:39.965145+0000","last_peered":"2023-07-19T20:44:39.965145+0000","last_clean":"2023-07-19T20:44:39.965145+0000","last_became_active":"2023-07-19T20:44:38.578137+0000","last_became_peered":"2023-07-19T20:44:38.578137+0000","last_unstale":"2023-07-19T20:44:39.965145+0000","last_undegraded":"2023-07-19T20:44:39.965145+0000","last_fullsized":"2023-07-19T20:44:39.965145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:31:08.854923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.556588+0000","last_change":"2023-07-19T20:44:33.124105+0000","last_active":"2023-07-19T20:44:38.556588+0000","last_peered":"2023-07-19T20:44:38.556588+0000","last_clean":"2023-07-19T20:44:38.556588+0000","last_became_active":"2023-07-19T20:44:33.123795+0000","last_became_peered":"2023-07-19T20:44:33.123795+0000","last_unstale":"2023-07-19T20:44:38.556588+0000","last_undegraded":"2023-07-19T20:44:38.556588+0000","last_fullsized":"2023-07-19T20:44:38.556588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:14:19.759142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965980+0000","last_change":"2023-07-19T20:44:38.153628+0000","last_active":"2023-07-19T20:44:39.965980+0000","last_peered":"2023-07-19T20:44:39.965980+0000","last_clean":"2023-07-19T20:44:39.965980+0000","last_became_active":"2023-07-19T20:44:38.153300+0000","last_became_peered":"2023-07-19T20:44:38.153300+0000","last_unstale":"2023-07-19T20:44:39.965980+0000","last_undegraded":"2023-07-19T20:44:39.965980+0000","last_fullsized":"2023-07-19T20:44:39.965980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966636+0000","last_change":"2023-07-19T20:44:38.565069+0000","last_active":"2023-07-19T20:44:39.966636+0000","last_peered":"2023-07-19T20:44:39.966636+0000","last_clean":"2023-07-19T20:44:39.966636+0000","last_became_active":"2023-07-19T20:44:38.564602+0000","last_became_peered":"2023-07-19T20:44:38.564602+0000","last_unstale":"2023-07-19T20:44:39.966636+0000","last_undegraded":"2023-07-19T20:44:39.966636+0000","last_fullsized":"2023-07-19T20:44:39.966636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:16:09.390291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.576773+0000","last_change":"2023-07-19T20:44:33.124619+0000","last_active":"2023-07-19T20:44:38.576773+0000","last_peered":"2023-07-19T20:44:38.576773+0000","last_clean":"2023-07-19T20:44:38.576773+0000","last_became_active":"2023-07-19T20:44:33.124278+0000","last_became_peered":"2023-07-19T20:44:33.124278+0000","last_unstale":"2023-07-19T20:44:38.576773+0000","last_undegraded":"2023-07-19T20:44:38.576773+0000","last_fullsized":"2023-07-19T20:44:38.576773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:57:12.956476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.570350+0000","last_change":"2023-07-19T20:44:33.129185+0000","last_active":"2023-07-19T20:44:38.570350+0000","last_peered":"2023-07-19T20:44:38.570350+0000","last_clean":"2023-07-19T20:44:38.570350+0000","last_became_active":"2023-07-19T20:44:33.128873+0000","last_became_peered":"2023-07-19T20:44:33.128873+0000","last_unstale":"2023-07-19T20:44:38.570350+0000","last_undegraded":"2023-07-19T20:44:38.570350+0000","last_fullsized":"2023-07-19T20:44:38.570350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:59:43.504158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965507+0000","last_change":"2023-07-19T20:44:38.157781+0000","last_active":"2023-07-19T20:44:39.965507+0000","last_peered":"2023-07-19T20:44:39.965507+0000","last_clean":"2023-07-19T20:44:39.965507+0000","last_became_active":"2023-07-19T20:44:38.157521+0000","last_became_peered":"2023-07-19T20:44:38.157521+0000","last_unstale":"2023-07-19T20:44:39.965507+0000","last_undegraded":"2023-07-19T20:44:39.965507+0000","last_fullsized":"2023-07-19T20:44:39.965507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:48:53.708405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965790+0000","last_change":"2023-07-19T20:44:38.569844+0000","last_active":"2023-07-19T20:44:39.965790+0000","last_peered":"2023-07-19T20:44:39.965790+0000","last_clean":"2023-07-19T20:44:39.965790+0000","last_became_active":"2023-07-19T20:44:38.569612+0000","last_became_peered":"2023-07-19T20:44:38.569612+0000","last_unstale":"2023-07-19T20:44:39.965790+0000","last_undegraded":"2023-07-19T20:44:39.965790+0000","last_fullsized":"2023-07-19T20:44:39.965790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:30:42.451874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.571549+0000","last_change":"2023-07-19T20:44:33.746155+0000","last_active":"2023-07-19T20:44:38.571549+0000","last_peered":"2023-07-19T20:44:38.571549+0000","last_clean":"2023-07-19T20:44:38.571549+0000","last_became_active":"2023-07-19T20:44:33.745839+0000","last_became_peered":"2023-07-19T20:44:33.745839+0000","last_unstale":"2023-07-19T20:44:38.571549+0000","last_undegraded":"2023-07-19T20:44:38.571549+0000","last_fullsized":"2023-07-19T20:44:38.571549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:27:53.622247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556163+0000","last_change":"2023-07-19T20:44:38.156539+0000","last_active":"2023-07-19T20:44:39.556163+0000","last_peered":"2023-07-19T20:44:39.556163+0000","last_clean":"2023-07-19T20:44:39.556163+0000","last_became_active":"2023-07-19T20:44:38.156248+0000","last_became_peered":"2023-07-19T20:44:38.156248+0000","last_unstale":"2023-07-19T20:44:39.556163+0000","last_undegraded":"2023-07-19T20:44:39.556163+0000","last_fullsized":"2023-07-19T20:44:39.556163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:27:24.261526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556806+0000","last_change":"2023-07-19T20:44:38.574341+0000","last_active":"2023-07-19T20:44:39.556806+0000","last_peered":"2023-07-19T20:44:39.556806+0000","last_clean":"2023-07-19T20:44:39.556806+0000","last_became_active":"2023-07-19T20:44:38.574094+0000","last_became_peered":"2023-07-19T20:44:38.574094+0000","last_unstale":"2023-07-19T20:44:39.556806+0000","last_undegraded":"2023-07-19T20:44:39.556806+0000","last_fullsized":"2023-07-19T20:44:39.556806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:47:25.794801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.569883+0000","last_change":"2023-07-19T20:44:33.746397+0000","last_active":"2023-07-19T20:44:38.569883+0000","last_peered":"2023-07-19T20:44:38.569883+0000","last_clean":"2023-07-19T20:44:38.569883+0000","last_became_active":"2023-07-19T20:44:33.746140+0000","last_became_peered":"2023-07-19T20:44:33.746140+0000","last_unstale":"2023-07-19T20:44:38.569883+0000","last_undegraded":"2023-07-19T20:44:38.569883+0000","last_fullsized":"2023-07-19T20:44:38.569883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:56:34.826030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965682+0000","last_change":"2023-07-19T20:44:38.155907+0000","last_active":"2023-07-19T20:44:39.965682+0000","last_peered":"2023-07-19T20:44:39.965682+0000","last_clean":"2023-07-19T20:44:39.965682+0000","last_became_active":"2023-07-19T20:44:38.155624+0000","last_became_peered":"2023-07-19T20:44:38.155624+0000","last_unstale":"2023-07-19T20:44:39.965682+0000","last_undegraded":"2023-07-19T20:44:39.965682+0000","last_fullsized":"2023-07-19T20:44:39.965682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:58:48.815316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557161+0000","last_change":"2023-07-19T20:44:38.564337+0000","last_active":"2023-07-19T20:44:39.557161+0000","last_peered":"2023-07-19T20:44:39.557161+0000","last_clean":"2023-07-19T20:44:39.557161+0000","last_became_active":"2023-07-19T20:44:38.563991+0000","last_became_peered":"2023-07-19T20:44:38.563991+0000","last_unstale":"2023-07-19T20:44:39.557161+0000","last_undegraded":"2023-07-19T20:44:39.557161+0000","last_fullsized":"2023-07-19T20:44:39.557161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:48:50.207451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.554572+0000","last_change":"2023-07-19T20:44:33.746552+0000","last_active":"2023-07-19T20:44:38.554572+0000","last_peered":"2023-07-19T20:44:38.554572+0000","last_clean":"2023-07-19T20:44:38.554572+0000","last_became_active":"2023-07-19T20:44:33.745934+0000","last_became_peered":"2023-07-19T20:44:33.745934+0000","last_unstale":"2023-07-19T20:44:38.554572+0000","last_undegraded":"2023-07-19T20:44:38.554572+0000","last_fullsized":"2023-07-19T20:44:38.554572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:19:16.931517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966394+0000","last_change":"2023-07-19T20:44:38.152599+0000","last_active":"2023-07-19T20:44:39.966394+0000","last_peered":"2023-07-19T20:44:39.966394+0000","last_clean":"2023-07-19T20:44:39.966394+0000","last_became_active":"2023-07-19T20:44:38.152331+0000","last_became_peered":"2023-07-19T20:44:38.152331+0000","last_unstale":"2023-07-19T20:44:39.966394+0000","last_undegraded":"2023-07-19T20:44:39.966394+0000","last_fullsized":"2023-07-19T20:44:39.966394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:43:49.400337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556867+0000","last_change":"2023-07-19T20:44:38.573279+0000","last_active":"2023-07-19T20:44:39.556867+0000","last_peered":"2023-07-19T20:44:39.556867+0000","last_clean":"2023-07-19T20:44:39.556867+0000","last_became_active":"2023-07-19T20:44:38.572918+0000","last_became_peered":"2023-07-19T20:44:38.572918+0000","last_unstale":"2023-07-19T20:44:39.556867+0000","last_undegraded":"2023-07-19T20:44:39.556867+0000","last_fullsized":"2023-07-19T20:44:39.556867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:12:57.038089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.560127+0000","last_change":"2023-07-19T20:44:33.746879+0000","last_active":"2023-07-19T20:44:38.560127+0000","last_peered":"2023-07-19T20:44:38.560127+0000","last_clean":"2023-07-19T20:44:38.560127+0000","last_became_active":"2023-07-19T20:44:33.746120+0000","last_became_peered":"2023-07-19T20:44:33.746120+0000","last_unstale":"2023-07-19T20:44:38.560127+0000","last_undegraded":"2023-07-19T20:44:38.560127+0000","last_fullsized":"2023-07-19T20:44:38.560127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:34:22.791863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556786+0000","last_change":"2023-07-19T20:44:38.157438+0000","last_active":"2023-07-19T20:44:39.556786+0000","last_peered":"2023-07-19T20:44:39.556786+0000","last_clean":"2023-07-19T20:44:39.556786+0000","last_became_active":"2023-07-19T20:44:38.157152+0000","last_became_peered":"2023-07-19T20:44:38.157152+0000","last_unstale":"2023-07-19T20:44:39.556786+0000","last_undegraded":"2023-07-19T20:44:39.556786+0000","last_fullsized":"2023-07-19T20:44:39.556786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:51:22.297960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965788+0000","last_change":"2023-07-19T20:44:38.570259+0000","last_active":"2023-07-19T20:44:39.965788+0000","last_peered":"2023-07-19T20:44:39.965788+0000","last_clean":"2023-07-19T20:44:39.965788+0000","last_became_active":"2023-07-19T20:44:38.569979+0000","last_became_peered":"2023-07-19T20:44:38.569979+0000","last_unstale":"2023-07-19T20:44:39.965788+0000","last_undegraded":"2023-07-19T20:44:39.965788+0000","last_fullsized":"2023-07-19T20:44:39.965788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:54:57.194368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.561428+0000","last_change":"2023-07-19T20:44:33.129202+0000","last_active":"2023-07-19T20:44:38.561428+0000","last_peered":"2023-07-19T20:44:38.561428+0000","last_clean":"2023-07-19T20:44:38.561428+0000","last_became_active":"2023-07-19T20:44:33.128920+0000","last_became_peered":"2023-07-19T20:44:33.128920+0000","last_unstale":"2023-07-19T20:44:38.561428+0000","last_undegraded":"2023-07-19T20:44:38.561428+0000","last_fullsized":"2023-07-19T20:44:38.561428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:43:18.861932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967383+0000","last_change":"2023-07-19T20:44:38.161925+0000","last_active":"2023-07-19T20:44:39.967383+0000","last_peered":"2023-07-19T20:44:39.967383+0000","last_clean":"2023-07-19T20:44:39.967383+0000","last_became_active":"2023-07-19T20:44:38.161648+0000","last_became_peered":"2023-07-19T20:44:38.161648+0000","last_unstale":"2023-07-19T20:44:39.967383+0000","last_undegraded":"2023-07-19T20:44:39.967383+0000","last_fullsized":"2023-07-19T20:44:39.967383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:03:08.671248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556470+0000","last_change":"2023-07-19T20:44:38.570962+0000","last_active":"2023-07-19T20:44:39.556470+0000","last_peered":"2023-07-19T20:44:39.556470+0000","last_clean":"2023-07-19T20:44:39.556470+0000","last_became_active":"2023-07-19T20:44:38.570620+0000","last_became_peered":"2023-07-19T20:44:38.570620+0000","last_unstale":"2023-07-19T20:44:39.556470+0000","last_undegraded":"2023-07-19T20:44:39.556470+0000","last_fullsized":"2023-07-19T20:44:39.556470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:09:27.024650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965931+0000","last_change":"2023-07-19T20:44:38.158044+0000","last_active":"2023-07-19T20:44:39.965931+0000","last_peered":"2023-07-19T20:44:39.965931+0000","last_clean":"2023-07-19T20:44:39.965931+0000","last_became_active":"2023-07-19T20:44:38.157760+0000","last_became_peered":"2023-07-19T20:44:38.157760+0000","last_unstale":"2023-07-19T20:44:39.965931+0000","last_undegraded":"2023-07-19T20:44:39.965931+0000","last_fullsized":"2023-07-19T20:44:39.965931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:03:08.671248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557350+0000","last_change":"2023-07-19T20:44:38.569229+0000","last_active":"2023-07-19T20:44:39.557350+0000","last_peered":"2023-07-19T20:44:39.557350+0000","last_clean":"2023-07-19T20:44:39.557350+0000","last_became_active":"2023-07-19T20:44:38.568732+0000","last_became_peered":"2023-07-19T20:44:38.568732+0000","last_unstale":"2023-07-19T20:44:39.557350+0000","last_undegraded":"2023-07-19T20:44:39.557350+0000","last_fullsized":"2023-07-19T20:44:39.557350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:43:50.405654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967067+0000","last_change":"2023-07-19T20:44:38.158368+0000","last_active":"2023-07-19T20:44:39.967067+0000","last_peered":"2023-07-19T20:44:39.967067+0000","last_clean":"2023-07-19T20:44:39.967067+0000","last_became_active":"2023-07-19T20:44:38.158097+0000","last_became_peered":"2023-07-19T20:44:38.158097+0000","last_unstale":"2023-07-19T20:44:39.967067+0000","last_undegraded":"2023-07-19T20:44:39.967067+0000","last_fullsized":"2023-07-19T20:44:39.967067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966104+0000","last_change":"2023-07-19T20:44:38.574231+0000","last_active":"2023-07-19T20:44:39.966104+0000","last_peered":"2023-07-19T20:44:39.966104+0000","last_clean":"2023-07-19T20:44:39.966104+0000","last_became_active":"2023-07-19T20:44:38.573954+0000","last_became_peered":"2023-07-19T20:44:38.573954+0000","last_unstale":"2023-07-19T20:44:39.966104+0000","last_undegraded":"2023-07-19T20:44:39.966104+0000","last_fullsized":"2023-07-19T20:44:39.966104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:44:27.891825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967472+0000","last_change":"2023-07-19T20:44:38.158334+0000","last_active":"2023-07-19T20:44:39.967472+0000","last_peered":"2023-07-19T20:44:39.967472+0000","last_clean":"2023-07-19T20:44:39.967472+0000","last_became_active":"2023-07-19T20:44:38.158046+0000","last_became_peered":"2023-07-19T20:44:38.158046+0000","last_unstale":"2023-07-19T20:44:39.967472+0000","last_undegraded":"2023-07-19T20:44:39.967472+0000","last_fullsized":"2023-07-19T20:44:39.967472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:49:55.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966062+0000","last_change":"2023-07-19T20:44:38.574118+0000","last_active":"2023-07-19T20:44:39.966062+0000","last_peered":"2023-07-19T20:44:39.966062+0000","last_clean":"2023-07-19T20:44:39.966062+0000","last_became_active":"2023-07-19T20:44:38.573825+0000","last_became_peered":"2023-07-19T20:44:38.573825+0000","last_unstale":"2023-07-19T20:44:39.966062+0000","last_undegraded":"2023-07-19T20:44:39.966062+0000","last_fullsized":"2023-07-19T20:44:39.966062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:12:33.443843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965892+0000","last_change":"2023-07-19T20:44:38.158463+0000","last_active":"2023-07-19T20:44:39.965892+0000","last_peered":"2023-07-19T20:44:39.965892+0000","last_clean":"2023-07-19T20:44:39.965892+0000","last_became_active":"2023-07-19T20:44:38.158210+0000","last_became_peered":"2023-07-19T20:44:38.158210+0000","last_unstale":"2023-07-19T20:44:39.965892+0000","last_undegraded":"2023-07-19T20:44:39.965892+0000","last_fullsized":"2023-07-19T20:44:39.965892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:03:08.671248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965328+0000","last_change":"2023-07-19T20:44:38.561250+0000","last_active":"2023-07-19T20:44:39.965328+0000","last_peered":"2023-07-19T20:44:39.965328+0000","last_clean":"2023-07-19T20:44:39.965328+0000","last_became_active":"2023-07-19T20:44:38.561001+0000","last_became_peered":"2023-07-19T20:44:38.561001+0000","last_unstale":"2023-07-19T20:44:39.965328+0000","last_undegraded":"2023-07-19T20:44:39.965328+0000","last_fullsized":"2023-07-19T20:44:39.965328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965583+0000","last_change":"2023-07-19T20:44:38.156696+0000","last_active":"2023-07-19T20:44:39.965583+0000","last_peered":"2023-07-19T20:44:39.965583+0000","last_clean":"2023-07-19T20:44:39.965583+0000","last_became_active":"2023-07-19T20:44:38.156455+0000","last_became_peered":"2023-07-19T20:44:38.156455+0000","last_unstale":"2023-07-19T20:44:39.965583+0000","last_undegraded":"2023-07-19T20:44:39.965583+0000","last_fullsized":"2023-07-19T20:44:39.965583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:00:17.913421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965669+0000","last_change":"2023-07-19T20:44:38.568760+0000","last_active":"2023-07-19T20:44:39.965669+0000","last_peered":"2023-07-19T20:44:39.965669+0000","last_clean":"2023-07-19T20:44:39.965669+0000","last_became_active":"2023-07-19T20:44:38.568148+0000","last_became_peered":"2023-07-19T20:44:38.568148+0000","last_unstale":"2023-07-19T20:44:39.965669+0000","last_undegraded":"2023-07-19T20:44:39.965669+0000","last_fullsized":"2023-07-19T20:44:39.965669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:29:06.966551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556998+0000","last_change":"2023-07-19T20:44:38.574672+0000","last_active":"2023-07-19T20:44:39.556998+0000","last_peered":"2023-07-19T20:44:39.556998+0000","last_clean":"2023-07-19T20:44:39.556998+0000","last_became_active":"2023-07-19T20:44:38.574318+0000","last_became_peered":"2023-07-19T20:44:38.574318+0000","last_unstale":"2023-07-19T20:44:39.556998+0000","last_undegraded":"2023-07-19T20:44:39.556998+0000","last_fullsized":"2023-07-19T20:44:39.556998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:29:14.941818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965294+0000","last_change":"2023-07-19T20:44:38.574389+0000","last_active":"2023-07-19T20:44:39.965294+0000","last_peered":"2023-07-19T20:44:39.965294+0000","last_clean":"2023-07-19T20:44:39.965294+0000","last_became_active":"2023-07-19T20:44:38.574112+0000","last_became_peered":"2023-07-19T20:44:38.574112+0000","last_unstale":"2023-07-19T20:44:39.965294+0000","last_undegraded":"2023-07-19T20:44:39.965294+0000","last_fullsized":"2023-07-19T20:44:39.965294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:19:13.016609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966463+0000","last_change":"2023-07-19T20:44:38.566538+0000","last_active":"2023-07-19T20:44:39.966463+0000","last_peered":"2023-07-19T20:44:39.966463+0000","last_clean":"2023-07-19T20:44:39.966463+0000","last_became_active":"2023-07-19T20:44:38.566260+0000","last_became_peered":"2023-07-19T20:44:38.566260+0000","last_unstale":"2023-07-19T20:44:39.966463+0000","last_undegraded":"2023-07-19T20:44:39.966463+0000","last_fullsized":"2023-07-19T20:44:39.966463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:39:41.156243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965832+0000","last_change":"2023-07-19T20:44:38.583615+0000","last_active":"2023-07-19T20:44:39.965832+0000","last_peered":"2023-07-19T20:44:39.965832+0000","last_clean":"2023-07-19T20:44:39.965832+0000","last_became_active":"2023-07-19T20:44:38.583193+0000","last_became_peered":"2023-07-19T20:44:38.583193+0000","last_unstale":"2023-07-19T20:44:39.965832+0000","last_undegraded":"2023-07-19T20:44:39.965832+0000","last_fullsized":"2023-07-19T20:44:39.965832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:30:42.451874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556700+0000","last_change":"2023-07-19T20:44:38.578448+0000","last_active":"2023-07-19T20:44:39.556700+0000","last_peered":"2023-07-19T20:44:39.556700+0000","last_clean":"2023-07-19T20:44:39.556700+0000","last_became_active":"2023-07-19T20:44:38.578182+0000","last_became_peered":"2023-07-19T20:44:38.578182+0000","last_unstale":"2023-07-19T20:44:39.556700+0000","last_undegraded":"2023-07-19T20:44:39.556700+0000","last_fullsized":"2023-07-19T20:44:39.556700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:20:24.991572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":835584,"data_stored":667667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":82172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":819200,"data_stored":672540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":81211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":77139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":81863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-19T20:44:42.639 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-19T20:44:42.789 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.796+0000 7fa559ad6700 1 Processor -- start 2023-07-19T20:44:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.796+0000 7fa559ad6700 1 -- start start 2023-07-19T20:44:42.792 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa559ad6700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa5541449d0 0x7fa5540bae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.792 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa559ad6700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa55414a7a0 0x7fa5540bf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.792 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa559ad6700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa5540713f0 0x7fa554071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.792 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa559ad6700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa554070f60 con 0x7fa55414a7a0 2023-07-19T20:44:42.792 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa559ad6700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa554071d90 con 0x7fa5540713f0 2023-07-19T20:44:42.792 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa559ad6700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55414aff0 con 0x7fa5541449d0 2023-07-19T20:44:42.793 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa552ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa55414a7a0 0x7fa5540bf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.793 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa552ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa55414a7a0 0x7fa5540bf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43426/0 (socket says 172.21.15.117:43426) 2023-07-19T20:44:42.793 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa552ffd700 1 -- 172.21.15.117:0/865122185 learned_addr learned my addr 172.21.15.117:0/865122185 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:42.793 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa553fff700 1 --2- 172.21.15.117:0/865122185 >> v2:172.21.15.124:3300/0 conn(0x7fa5540713f0 0x7fa554071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.793 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa5537fe700 1 --2- 172.21.15.117:0/865122185 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa5541449d0 0x7fa5540bae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.793 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa552ffd700 1 -- 172.21.15.117:0/865122185 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa5541449d0 msgr2=0x7fa5540bae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:42.793 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa552ffd700 1 --2- 172.21.15.117:0/865122185 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa5541449d0 0x7fa5540bae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa552ffd700 1 -- 172.21.15.117:0/865122185 >> v2:172.21.15.124:3300/0 conn(0x7fa5540713f0 msgr2=0x7fa554071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:42.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa552ffd700 1 --2- 172.21.15.117:0/865122185 >> v2:172.21.15.124:3300/0 conn(0x7fa5540713f0 0x7fa554071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa552ffd700 1 -- 172.21.15.117:0/865122185 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55414b2d0 con 0x7fa55414a7a0 2023-07-19T20:44:42.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa5537fe700 1 --2- 172.21.15.117:0/865122185 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa5541449d0 0x7fa5540bae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:42.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa552ffd700 1 --2- 172.21.15.117:0/865122185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55414a7a0 0x7fa5540bf090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa554070520 tx=0x7fa544009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b472d438ebcd49c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:42.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa5527fc700 1 -- 172.21.15.117:0/865122185 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54400b870 con 0x7fa55414a7a0 2023-07-19T20:44:42.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa5527fc700 1 -- 172.21.15.117:0/865122185 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54400b9d0 con 0x7fa55414a7a0 2023-07-19T20:44:42.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.797+0000 7fa5527fc700 1 -- 172.21.15.117:0/865122185 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54400bd60 con 0x7fa55414a7a0 2023-07-19T20:44:42.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.798+0000 7fa559ad6700 1 -- 172.21.15.117:0/865122185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55414a7a0 msgr2=0x7fa5540bf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.798+0000 7fa559ad6700 1 --2- 172.21.15.117:0/865122185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55414a7a0 0x7fa5540bf090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa554070520 tx=0x7fa544009bd0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.798+0000 7fa559ad6700 1 -- 172.21.15.117:0/865122185 shutdown_connections 2023-07-19T20:44:42.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.798+0000 7fa559ad6700 1 --2- 172.21.15.117:0/865122185 >> v2:172.21.15.124:3300/0 conn(0x7fa5540713f0 0x7fa554071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.798+0000 7fa559ad6700 1 --2- 172.21.15.117:0/865122185 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa5541449d0 0x7fa5540bae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.798+0000 7fa559ad6700 1 --2- 172.21.15.117:0/865122185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55414a7a0 0x7fa5540bf090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.798+0000 7fa559ad6700 1 -- 172.21.15.117:0/865122185 >> 172.21.15.117:0/865122185 conn(0x7fa5540a1250 msgr2=0x7fa5540be980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:42.796 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.798+0000 7fa559ad6700 1 -- 172.21.15.117:0/865122185 shutdown_connections 2023-07-19T20:44:42.796 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.798+0000 7fa559ad6700 1 -- 172.21.15.117:0/865122185 wait complete. 2023-07-19T20:44:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.799+0000 7fa559ad6700 1 Processor -- start 2023-07-19T20:44:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.799+0000 7fa559ad6700 1 -- start start 2023-07-19T20:44:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa559ad6700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5540713f0 0x7fa5541432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa559ad6700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa5541449d0 0x7fa55413fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa559ad6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55414a7a0 0x7fa554140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa559ad6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5541437e0 con 0x7fa55414a7a0 2023-07-19T20:44:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa559ad6700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5540b64a0 con 0x7fa5540713f0 2023-07-19T20:44:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa559ad6700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5541d65c0 con 0x7fa5541449d0 2023-07-19T20:44:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa553fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55414a7a0 0x7fa554140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa553fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55414a7a0 0x7fa554140170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43438/0 (socket says 172.21.15.117:43438) 2023-07-19T20:44:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa553fff700 1 -- 172.21.15.117:0/1289468372 learned_addr learned my addr 172.21.15.117:0/1289468372 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa5537fe700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5540713f0 0x7fa5541432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa552ffd700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa5541449d0 0x7fa55413fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa553fff700 1 -- 172.21.15.117:0/1289468372 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa5541449d0 msgr2=0x7fa55413fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa553fff700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa5541449d0 0x7fa55413fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa553fff700 1 -- 172.21.15.117:0/1289468372 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5540713f0 msgr2=0x7fa5541432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa553fff700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5540713f0 0x7fa5541432a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa553fff700 1 -- 172.21.15.117:0/1289468372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa544009550 con 0x7fa55414a7a0 2023-07-19T20:44:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa5537fe700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5540713f0 0x7fa5541432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa553fff700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55414a7a0 0x7fa554140170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa54c007e60 tx=0x7fa54c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.800+0000 7fa53bfff700 1 -- 172.21.15.117:0/1289468372 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c00ede0 con 0x7fa55414a7a0 2023-07-19T20:44:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.801+0000 7fa53bfff700 1 -- 172.21.15.117:0/1289468372 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c014420 con 0x7fa55414a7a0 2023-07-19T20:44:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.801+0000 7fa559ad6700 1 -- 172.21.15.117:0/1289468372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5540b6e90 con 0x7fa55414a7a0 2023-07-19T20:44:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.801+0000 7fa53bfff700 1 -- 172.21.15.117:0/1289468372 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0147d0 con 0x7fa55414a7a0 2023-07-19T20:44:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.801+0000 7fa559ad6700 1 -- 172.21.15.117:0/1289468372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5541d6860 con 0x7fa55414a7a0 2023-07-19T20:44:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.802+0000 7fa559ad6700 1 -- 172.21.15.117:0/1289468372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa554074890 con 0x7fa55414a7a0 2023-07-19T20:44:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.802+0000 7fa53bfff700 1 -- 172.21.15.117:0/1289468372 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fa54c014930 con 0x7fa55414a7a0 2023-07-19T20:44:42.802 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.802+0000 7fa53bfff700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa54006a660 0x7fa54006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:42.802 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.802+0000 7fa53bfff700 1 -- 172.21.15.117:0/1289468372 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa54c0891f0 con 0x7fa55414a7a0 2023-07-19T20:44:42.802 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.802+0000 7fa5537fe700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa54006a660 0x7fa54006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:42.802 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.803+0000 7fa5537fe700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa54006a660 0x7fa54006cb10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa548006fd0 tx=0x7fa548008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:42.802 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.807+0000 7fa53bfff700 1 -- 172.21.15.117:0/1289468372 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fa54c054730 con 0x7fa55414a7a0 2023-07-19T20:44:42.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.989+0000 7fa559ad6700 1 -- 172.21.15.117:0/1289468372 --> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa55414b5b0 con 0x7fa54006a660 2023-07-19T20:44:42.993 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:42.997+0000 7fa53bfff700 1 -- 172.21.15.117:0/1289468372 <== mgr.4107 v2:172.21.15.117:6832/146126 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286935 (secure 0 0 0) 0x7fa54800c050 con 0x7fa54006a660 2023-07-19T20:44:42.997 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:42.999 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.000+0000 7fa559ad6700 1 -- 172.21.15.117:0/1289468372 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa54006a660 msgr2=0x7fa54006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.999 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.000+0000 7fa559ad6700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa54006a660 0x7fa54006cb10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa548006fd0 tx=0x7fa548008040 comp rx=0 tx=0).stop 2023-07-19T20:44:42.999 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.000+0000 7fa559ad6700 1 -- 172.21.15.117:0/1289468372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55414a7a0 msgr2=0x7fa554140170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:42.999 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.000+0000 7fa559ad6700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55414a7a0 0x7fa554140170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa54c007e60 tx=0x7fa54c00e3c0 comp rx=0 tx=0).stop 2023-07-19T20:44:42.999 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.000+0000 7fa559ad6700 1 -- 172.21.15.117:0/1289468372 shutdown_connections 2023-07-19T20:44:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.000+0000 7fa559ad6700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa54006a660 0x7fa54006cb10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.000+0000 7fa559ad6700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55414a7a0 0x7fa554140170 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.000+0000 7fa559ad6700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5540713f0 0x7fa5541432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.000+0000 7fa559ad6700 1 --2- 172.21.15.117:0/1289468372 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa5541449d0 0x7fa55413fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.000+0000 7fa559ad6700 1 -- 172.21.15.117:0/1289468372 >> 172.21.15.117:0/1289468372 conn(0x7fa5540a1250 msgr2=0x7fa5540b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.000+0000 7fa559ad6700 1 -- 172.21.15.117:0/1289468372 shutdown_connections 2023-07-19T20:44:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.000+0000 7fa559ad6700 1 -- 172.21.15.117:0/1289468372 wait complete. 2023-07-19T20:44:43.001 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2023-07-19T20:44:43.006 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-07-19T20:44:41.686109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218556,"kb_used_data":2940,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756164,"statfs":{"total":773094113280,"available":772870311936,"internally_reserved":0,"allocated":3010560,"data_stored":1820955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.552006"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557519+0000","last_change":"2023-07-19T20:44:38.557553+0000","last_active":"2023-07-19T20:44:39.557519+0000","last_peered":"2023-07-19T20:44:39.557519+0000","last_clean":"2023-07-19T20:44:39.557519+0000","last_became_active":"2023-07-19T20:44:38.557300+0000","last_became_peered":"2023-07-19T20:44:38.557300+0000","last_unstale":"2023-07-19T20:44:39.557519+0000","last_undegraded":"2023-07-19T20:44:39.557519+0000","last_fullsized":"2023-07-19T20:44:39.557519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:51:24.459453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967118+0000","last_change":"2023-07-19T20:44:38.568068+0000","last_active":"2023-07-19T20:44:39.967118+0000","last_peered":"2023-07-19T20:44:39.967118+0000","last_clean":"2023-07-19T20:44:39.967118+0000","last_became_active":"2023-07-19T20:44:38.567801+0000","last_became_peered":"2023-07-19T20:44:38.567801+0000","last_unstale":"2023-07-19T20:44:39.967118+0000","last_undegraded":"2023-07-19T20:44:39.967118+0000","last_fullsized":"2023-07-19T20:44:39.967118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:54:57.194368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966678+0000","last_change":"2023-07-19T20:44:38.570481+0000","last_active":"2023-07-19T20:44:39.966678+0000","last_peered":"2023-07-19T20:44:39.966678+0000","last_clean":"2023-07-19T20:44:39.966678+0000","last_became_active":"2023-07-19T20:44:38.570229+0000","last_became_peered":"2023-07-19T20:44:38.570229+0000","last_unstale":"2023-07-19T20:44:39.966678+0000","last_undegraded":"2023-07-19T20:44:39.966678+0000","last_fullsized":"2023-07-19T20:44:39.966678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:14:05.967200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557053+0000","last_change":"2023-07-19T20:44:38.570166+0000","last_active":"2023-07-19T20:44:39.557053+0000","last_peered":"2023-07-19T20:44:39.557053+0000","last_clean":"2023-07-19T20:44:39.557053+0000","last_became_active":"2023-07-19T20:44:38.569877+0000","last_became_peered":"2023-07-19T20:44:38.569877+0000","last_unstale":"2023-07-19T20:44:39.557053+0000","last_undegraded":"2023-07-19T20:44:39.557053+0000","last_fullsized":"2023-07-19T20:44:39.557053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:50:18.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965691+0000","last_change":"2023-07-19T20:44:38.571798+0000","last_active":"2023-07-19T20:44:39.965691+0000","last_peered":"2023-07-19T20:44:39.965691+0000","last_clean":"2023-07-19T20:44:39.965691+0000","last_became_active":"2023-07-19T20:44:38.571402+0000","last_became_peered":"2023-07-19T20:44:38.571402+0000","last_unstale":"2023-07-19T20:44:39.965691+0000","last_undegraded":"2023-07-19T20:44:39.965691+0000","last_fullsized":"2023-07-19T20:44:39.965691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:15:18.131376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965752+0000","last_change":"2023-07-19T20:44:38.572155+0000","last_active":"2023-07-19T20:44:39.965752+0000","last_peered":"2023-07-19T20:44:39.965752+0000","last_clean":"2023-07-19T20:44:39.965752+0000","last_became_active":"2023-07-19T20:44:38.571889+0000","last_became_peered":"2023-07-19T20:44:38.571889+0000","last_unstale":"2023-07-19T20:44:39.965752+0000","last_undegraded":"2023-07-19T20:44:39.965752+0000","last_fullsized":"2023-07-19T20:44:39.965752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:05:47.118546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965842+0000","last_change":"2023-07-19T20:44:38.583148+0000","last_active":"2023-07-19T20:44:39.965842+0000","last_peered":"2023-07-19T20:44:39.965842+0000","last_clean":"2023-07-19T20:44:39.965842+0000","last_became_active":"2023-07-19T20:44:38.582674+0000","last_became_peered":"2023-07-19T20:44:38.582674+0000","last_unstale":"2023-07-19T20:44:39.965842+0000","last_undegraded":"2023-07-19T20:44:39.965842+0000","last_fullsized":"2023-07-19T20:44:39.965842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966760+0000","last_change":"2023-07-19T20:44:38.563551+0000","last_active":"2023-07-19T20:44:39.966760+0000","last_peered":"2023-07-19T20:44:39.966760+0000","last_clean":"2023-07-19T20:44:39.966760+0000","last_became_active":"2023-07-19T20:44:38.563241+0000","last_became_peered":"2023-07-19T20:44:38.563241+0000","last_unstale":"2023-07-19T20:44:39.966760+0000","last_undegraded":"2023-07-19T20:44:39.966760+0000","last_fullsized":"2023-07-19T20:44:39.966760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:41:57.896806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965333+0000","last_change":"2023-07-19T20:44:38.568101+0000","last_active":"2023-07-19T20:44:39.965333+0000","last_peered":"2023-07-19T20:44:39.965333+0000","last_clean":"2023-07-19T20:44:39.965333+0000","last_became_active":"2023-07-19T20:44:38.567841+0000","last_became_peered":"2023-07-19T20:44:38.567841+0000","last_unstale":"2023-07-19T20:44:39.965333+0000","last_undegraded":"2023-07-19T20:44:39.965333+0000","last_fullsized":"2023-07-19T20:44:39.965333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:47:51.985998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967220+0000","last_change":"2023-07-19T20:44:38.573636+0000","last_active":"2023-07-19T20:44:39.967220+0000","last_peered":"2023-07-19T20:44:39.967220+0000","last_clean":"2023-07-19T20:44:39.967220+0000","last_became_active":"2023-07-19T20:44:38.572946+0000","last_became_peered":"2023-07-19T20:44:38.572946+0000","last_unstale":"2023-07-19T20:44:39.967220+0000","last_undegraded":"2023-07-19T20:44:39.967220+0000","last_fullsized":"2023-07-19T20:44:39.967220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:44:21.312824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966695+0000","last_change":"2023-07-19T20:44:38.569267+0000","last_active":"2023-07-19T20:44:39.966695+0000","last_peered":"2023-07-19T20:44:39.966695+0000","last_clean":"2023-07-19T20:44:39.966695+0000","last_became_active":"2023-07-19T20:44:38.568642+0000","last_became_peered":"2023-07-19T20:44:38.568642+0000","last_unstale":"2023-07-19T20:44:39.966695+0000","last_undegraded":"2023-07-19T20:44:39.966695+0000","last_fullsized":"2023-07-19T20:44:39.966695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:05:25.043607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557296+0000","last_change":"2023-07-19T20:44:38.563272+0000","last_active":"2023-07-19T20:44:39.557296+0000","last_peered":"2023-07-19T20:44:39.557296+0000","last_clean":"2023-07-19T20:44:39.557296+0000","last_became_active":"2023-07-19T20:44:38.562986+0000","last_became_peered":"2023-07-19T20:44:38.562986+0000","last_unstale":"2023-07-19T20:44:39.557296+0000","last_undegraded":"2023-07-19T20:44:39.557296+0000","last_fullsized":"2023-07-19T20:44:39.557296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:10:44.096418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557003+0000","last_change":"2023-07-19T20:44:38.558158+0000","last_active":"2023-07-19T20:44:39.557003+0000","last_peered":"2023-07-19T20:44:39.557003+0000","last_clean":"2023-07-19T20:44:39.557003+0000","last_became_active":"2023-07-19T20:44:38.557930+0000","last_became_peered":"2023-07-19T20:44:38.557930+0000","last_unstale":"2023-07-19T20:44:39.557003+0000","last_undegraded":"2023-07-19T20:44:39.557003+0000","last_fullsized":"2023-07-19T20:44:39.557003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:29:27.698047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967203+0000","last_change":"2023-07-19T20:44:38.561137+0000","last_active":"2023-07-19T20:44:39.967203+0000","last_peered":"2023-07-19T20:44:39.967203+0000","last_clean":"2023-07-19T20:44:39.967203+0000","last_became_active":"2023-07-19T20:44:38.560853+0000","last_became_peered":"2023-07-19T20:44:38.560853+0000","last_unstale":"2023-07-19T20:44:39.967203+0000","last_undegraded":"2023-07-19T20:44:39.967203+0000","last_fullsized":"2023-07-19T20:44:39.967203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:01:57.502720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965944+0000","last_change":"2023-07-19T20:44:38.583262+0000","last_active":"2023-07-19T20:44:39.965944+0000","last_peered":"2023-07-19T20:44:39.965944+0000","last_clean":"2023-07-19T20:44:39.965944+0000","last_became_active":"2023-07-19T20:44:38.582950+0000","last_became_peered":"2023-07-19T20:44:38.582950+0000","last_unstale":"2023-07-19T20:44:39.965944+0000","last_undegraded":"2023-07-19T20:44:39.965944+0000","last_fullsized":"2023-07-19T20:44:39.965944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:47:20.937341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965794+0000","last_change":"2023-07-19T20:44:38.572479+0000","last_active":"2023-07-19T20:44:39.965794+0000","last_peered":"2023-07-19T20:44:39.965794+0000","last_clean":"2023-07-19T20:44:39.965794+0000","last_became_active":"2023-07-19T20:44:38.572213+0000","last_became_peered":"2023-07-19T20:44:38.572213+0000","last_unstale":"2023-07-19T20:44:39.965794+0000","last_undegraded":"2023-07-19T20:44:39.965794+0000","last_fullsized":"2023-07-19T20:44:39.965794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:21:54.976852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965428+0000","last_change":"2023-07-19T20:44:38.568103+0000","last_active":"2023-07-19T20:44:39.965428+0000","last_peered":"2023-07-19T20:44:39.965428+0000","last_clean":"2023-07-19T20:44:39.965428+0000","last_became_active":"2023-07-19T20:44:38.567824+0000","last_became_peered":"2023-07-19T20:44:38.567824+0000","last_unstale":"2023-07-19T20:44:39.965428+0000","last_undegraded":"2023-07-19T20:44:39.965428+0000","last_fullsized":"2023-07-19T20:44:39.965428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:45:53.848298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966933+0000","last_change":"2023-07-19T20:44:38.567578+0000","last_active":"2023-07-19T20:44:39.966933+0000","last_peered":"2023-07-19T20:44:39.966933+0000","last_clean":"2023-07-19T20:44:39.966933+0000","last_became_active":"2023-07-19T20:44:38.567290+0000","last_became_peered":"2023-07-19T20:44:38.567290+0000","last_unstale":"2023-07-19T20:44:39.966933+0000","last_undegraded":"2023-07-19T20:44:39.966933+0000","last_fullsized":"2023-07-19T20:44:39.966933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:58:55.531091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557561+0000","last_change":"2023-07-19T20:44:38.572691+0000","last_active":"2023-07-19T20:44:39.557561+0000","last_peered":"2023-07-19T20:44:39.557561+0000","last_clean":"2023-07-19T20:44:39.557561+0000","last_became_active":"2023-07-19T20:44:38.572438+0000","last_became_peered":"2023-07-19T20:44:38.572438+0000","last_unstale":"2023-07-19T20:44:39.557561+0000","last_undegraded":"2023-07-19T20:44:39.557561+0000","last_fullsized":"2023-07-19T20:44:39.557561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:40:43.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966413+0000","last_change":"2023-07-19T20:44:38.567705+0000","last_active":"2023-07-19T20:44:39.966413+0000","last_peered":"2023-07-19T20:44:39.966413+0000","last_clean":"2023-07-19T20:44:39.966413+0000","last_became_active":"2023-07-19T20:44:38.567230+0000","last_became_peered":"2023-07-19T20:44:38.567230+0000","last_unstale":"2023-07-19T20:44:39.966413+0000","last_undegraded":"2023-07-19T20:44:39.966413+0000","last_fullsized":"2023-07-19T20:44:39.966413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:16:57.118793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966275+0000","last_change":"2023-07-19T20:44:38.583001+0000","last_active":"2023-07-19T20:44:39.966275+0000","last_peered":"2023-07-19T20:44:39.966275+0000","last_clean":"2023-07-19T20:44:39.966275+0000","last_became_active":"2023-07-19T20:44:38.582767+0000","last_became_peered":"2023-07-19T20:44:38.582767+0000","last_unstale":"2023-07-19T20:44:39.966275+0000","last_undegraded":"2023-07-19T20:44:39.966275+0000","last_fullsized":"2023-07-19T20:44:39.966275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:30:42.451874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965394+0000","last_change":"2023-07-19T20:44:38.571958+0000","last_active":"2023-07-19T20:44:39.965394+0000","last_peered":"2023-07-19T20:44:39.965394+0000","last_clean":"2023-07-19T20:44:39.965394+0000","last_became_active":"2023-07-19T20:44:38.571485+0000","last_became_peered":"2023-07-19T20:44:38.571485+0000","last_unstale":"2023-07-19T20:44:39.965394+0000","last_undegraded":"2023-07-19T20:44:39.965394+0000","last_fullsized":"2023-07-19T20:44:39.965394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965238+0000","last_change":"2023-07-19T20:44:38.566759+0000","last_active":"2023-07-19T20:44:39.965238+0000","last_peered":"2023-07-19T20:44:39.965238+0000","last_clean":"2023-07-19T20:44:39.965238+0000","last_became_active":"2023-07-19T20:44:38.566496+0000","last_became_peered":"2023-07-19T20:44:38.566496+0000","last_unstale":"2023-07-19T20:44:39.965238+0000","last_undegraded":"2023-07-19T20:44:39.965238+0000","last_fullsized":"2023-07-19T20:44:39.965238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:40:30.028440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966363+0000","last_change":"2023-07-19T20:44:38.582748+0000","last_active":"2023-07-19T20:44:39.966363+0000","last_peered":"2023-07-19T20:44:39.966363+0000","last_clean":"2023-07-19T20:44:39.966363+0000","last_became_active":"2023-07-19T20:44:38.582492+0000","last_became_peered":"2023-07-19T20:44:38.582492+0000","last_unstale":"2023-07-19T20:44:39.966363+0000","last_undegraded":"2023-07-19T20:44:39.966363+0000","last_fullsized":"2023-07-19T20:44:39.966363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556709+0000","last_change":"2023-07-19T20:44:38.573862+0000","last_active":"2023-07-19T20:44:39.556709+0000","last_peered":"2023-07-19T20:44:39.556709+0000","last_clean":"2023-07-19T20:44:39.556709+0000","last_became_active":"2023-07-19T20:44:38.573438+0000","last_became_peered":"2023-07-19T20:44:38.573438+0000","last_unstale":"2023-07-19T20:44:39.556709+0000","last_undegraded":"2023-07-19T20:44:39.556709+0000","last_fullsized":"2023-07-19T20:44:39.556709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:48:50.207451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556599+0000","last_change":"2023-07-19T20:44:38.573890+0000","last_active":"2023-07-19T20:44:39.556599+0000","last_peered":"2023-07-19T20:44:39.556599+0000","last_clean":"2023-07-19T20:44:39.556599+0000","last_became_active":"2023-07-19T20:44:38.573657+0000","last_became_peered":"2023-07-19T20:44:38.573657+0000","last_unstale":"2023-07-19T20:44:39.556599+0000","last_undegraded":"2023-07-19T20:44:39.556599+0000","last_fullsized":"2023-07-19T20:44:39.556599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:50:18.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967285+0000","last_change":"2023-07-19T20:44:38.578334+0000","last_active":"2023-07-19T20:44:39.967285+0000","last_peered":"2023-07-19T20:44:39.967285+0000","last_clean":"2023-07-19T20:44:39.967285+0000","last_became_active":"2023-07-19T20:44:38.578066+0000","last_became_peered":"2023-07-19T20:44:38.578066+0000","last_unstale":"2023-07-19T20:44:39.967285+0000","last_undegraded":"2023-07-19T20:44:39.967285+0000","last_fullsized":"2023-07-19T20:44:39.967285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965878+0000","last_change":"2023-07-19T20:44:38.150761+0000","last_active":"2023-07-19T20:44:39.965878+0000","last_peered":"2023-07-19T20:44:39.965878+0000","last_clean":"2023-07-19T20:44:39.965878+0000","last_became_active":"2023-07-19T20:44:38.150480+0000","last_became_peered":"2023-07-19T20:44:38.150480+0000","last_unstale":"2023-07-19T20:44:39.965878+0000","last_undegraded":"2023-07-19T20:44:39.965878+0000","last_fullsized":"2023-07-19T20:44:39.965878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:29:26.692730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965845+0000","last_change":"2023-07-19T20:44:38.573757+0000","last_active":"2023-07-19T20:44:39.965845+0000","last_peered":"2023-07-19T20:44:39.965845+0000","last_clean":"2023-07-19T20:44:39.965845+0000","last_became_active":"2023-07-19T20:44:38.573579+0000","last_became_peered":"2023-07-19T20:44:38.573579+0000","last_unstale":"2023-07-19T20:44:39.965845+0000","last_undegraded":"2023-07-19T20:44:39.965845+0000","last_fullsized":"2023-07-19T20:44:39.965845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:45:53.848298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556369+0000","last_change":"2023-07-19T20:44:38.163117+0000","last_active":"2023-07-19T20:44:39.556369+0000","last_peered":"2023-07-19T20:44:39.556369+0000","last_clean":"2023-07-19T20:44:39.556369+0000","last_became_active":"2023-07-19T20:44:38.162834+0000","last_became_peered":"2023-07-19T20:44:38.162834+0000","last_unstale":"2023-07-19T20:44:39.556369+0000","last_undegraded":"2023-07-19T20:44:39.556369+0000","last_fullsized":"2023-07-19T20:44:39.556369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:40:42.266562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965931+0000","last_change":"2023-07-19T20:44:38.582906+0000","last_active":"2023-07-19T20:44:39.965931+0000","last_peered":"2023-07-19T20:44:39.965931+0000","last_clean":"2023-07-19T20:44:39.965931+0000","last_became_active":"2023-07-19T20:44:38.582633+0000","last_became_peered":"2023-07-19T20:44:38.582633+0000","last_unstale":"2023-07-19T20:44:39.965931+0000","last_undegraded":"2023-07-19T20:44:39.965931+0000","last_fullsized":"2023-07-19T20:44:39.965931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:07:43.608434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965284+0000","last_change":"2023-07-19T20:44:38.162257+0000","last_active":"2023-07-19T20:44:39.965284+0000","last_peered":"2023-07-19T20:44:39.965284+0000","last_clean":"2023-07-19T20:44:39.965284+0000","last_became_active":"2023-07-19T20:44:38.161974+0000","last_became_peered":"2023-07-19T20:44:38.161974+0000","last_unstale":"2023-07-19T20:44:39.965284+0000","last_undegraded":"2023-07-19T20:44:39.965284+0000","last_fullsized":"2023-07-19T20:44:39.965284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:27:00.609956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557276+0000","last_change":"2023-07-19T20:44:38.570736+0000","last_active":"2023-07-19T20:44:39.557276+0000","last_peered":"2023-07-19T20:44:39.557276+0000","last_clean":"2023-07-19T20:44:39.557276+0000","last_became_active":"2023-07-19T20:44:38.570456+0000","last_became_peered":"2023-07-19T20:44:38.570456+0000","last_unstale":"2023-07-19T20:44:39.557276+0000","last_undegraded":"2023-07-19T20:44:39.557276+0000","last_fullsized":"2023-07-19T20:44:39.557276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:47:25.794801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965516+0000","last_change":"2023-07-19T20:44:38.156406+0000","last_active":"2023-07-19T20:44:39.965516+0000","last_peered":"2023-07-19T20:44:39.965516+0000","last_clean":"2023-07-19T20:44:39.965516+0000","last_became_active":"2023-07-19T20:44:38.156105+0000","last_became_peered":"2023-07-19T20:44:38.156105+0000","last_unstale":"2023-07-19T20:44:39.965516+0000","last_undegraded":"2023-07-19T20:44:39.965516+0000","last_fullsized":"2023-07-19T20:44:39.965516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:27:00.609956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965254+0000","last_change":"2023-07-19T20:44:38.566993+0000","last_active":"2023-07-19T20:44:39.965254+0000","last_peered":"2023-07-19T20:44:39.965254+0000","last_clean":"2023-07-19T20:44:39.965254+0000","last_became_active":"2023-07-19T20:44:38.566840+0000","last_became_peered":"2023-07-19T20:44:38.566840+0000","last_unstale":"2023-07-19T20:44:39.965254+0000","last_undegraded":"2023-07-19T20:44:39.965254+0000","last_fullsized":"2023-07-19T20:44:39.965254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:47:51.985998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967138+0000","last_change":"2023-07-19T20:44:38.158430+0000","last_active":"2023-07-19T20:44:39.967138+0000","last_peered":"2023-07-19T20:44:39.967138+0000","last_clean":"2023-07-19T20:44:39.967138+0000","last_became_active":"2023-07-19T20:44:38.158144+0000","last_became_peered":"2023-07-19T20:44:38.158144+0000","last_unstale":"2023-07-19T20:44:39.967138+0000","last_undegraded":"2023-07-19T20:44:39.967138+0000","last_fullsized":"2023-07-19T20:44:39.967138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:27:00.609956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965414+0000","last_change":"2023-07-19T20:44:38.578647+0000","last_active":"2023-07-19T20:44:39.965414+0000","last_peered":"2023-07-19T20:44:39.965414+0000","last_clean":"2023-07-19T20:44:39.965414+0000","last_became_active":"2023-07-19T20:44:38.578203+0000","last_became_peered":"2023-07-19T20:44:38.578203+0000","last_unstale":"2023-07-19T20:44:39.965414+0000","last_undegraded":"2023-07-19T20:44:39.965414+0000","last_fullsized":"2023-07-19T20:44:39.965414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:15:18.131376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966763+0000","last_change":"2023-07-19T20:44:38.162400+0000","last_active":"2023-07-19T20:44:39.966763+0000","last_peered":"2023-07-19T20:44:39.966763+0000","last_clean":"2023-07-19T20:44:39.966763+0000","last_became_active":"2023-07-19T20:44:38.161909+0000","last_became_peered":"2023-07-19T20:44:38.161909+0000","last_unstale":"2023-07-19T20:44:39.966763+0000","last_undegraded":"2023-07-19T20:44:39.966763+0000","last_fullsized":"2023-07-19T20:44:39.966763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:06:03.165653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556326+0000","last_change":"2023-07-19T20:44:38.576965+0000","last_active":"2023-07-19T20:44:39.556326+0000","last_peered":"2023-07-19T20:44:39.556326+0000","last_clean":"2023-07-19T20:44:39.556326+0000","last_became_active":"2023-07-19T20:44:38.574467+0000","last_became_peered":"2023-07-19T20:44:38.574467+0000","last_unstale":"2023-07-19T20:44:39.556326+0000","last_undegraded":"2023-07-19T20:44:39.556326+0000","last_fullsized":"2023-07-19T20:44:39.556326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:29:14.941818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966551+0000","last_change":"2023-07-19T20:44:38.159725+0000","last_active":"2023-07-19T20:44:39.966551+0000","last_peered":"2023-07-19T20:44:39.966551+0000","last_clean":"2023-07-19T20:44:39.966551+0000","last_became_active":"2023-07-19T20:44:38.159461+0000","last_became_peered":"2023-07-19T20:44:38.159461+0000","last_unstale":"2023-07-19T20:44:39.966551+0000","last_undegraded":"2023-07-19T20:44:39.966551+0000","last_fullsized":"2023-07-19T20:44:39.966551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:10:43.091101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966298+0000","last_change":"2023-07-19T20:44:38.570213+0000","last_active":"2023-07-19T20:44:39.966298+0000","last_peered":"2023-07-19T20:44:39.966298+0000","last_clean":"2023-07-19T20:44:39.966298+0000","last_became_active":"2023-07-19T20:44:38.567536+0000","last_became_peered":"2023-07-19T20:44:38.567536+0000","last_unstale":"2023-07-19T20:44:39.966298+0000","last_undegraded":"2023-07-19T20:44:39.966298+0000","last_fullsized":"2023-07-19T20:44:39.966298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:43:36.018520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966166+0000","last_change":"2023-07-19T20:44:38.161200+0000","last_active":"2023-07-19T20:44:39.966166+0000","last_peered":"2023-07-19T20:44:39.966166+0000","last_clean":"2023-07-19T20:44:39.966166+0000","last_became_active":"2023-07-19T20:44:38.160914+0000","last_became_peered":"2023-07-19T20:44:38.160914+0000","last_unstale":"2023-07-19T20:44:39.966166+0000","last_undegraded":"2023-07-19T20:44:39.966166+0000","last_fullsized":"2023-07-19T20:44:39.966166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:22:47.753831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965319+0000","last_change":"2023-07-19T20:44:38.573870+0000","last_active":"2023-07-19T20:44:39.965319+0000","last_peered":"2023-07-19T20:44:39.965319+0000","last_clean":"2023-07-19T20:44:39.965319+0000","last_became_active":"2023-07-19T20:44:38.573603+0000","last_became_peered":"2023-07-19T20:44:38.573603+0000","last_unstale":"2023-07-19T20:44:39.965319+0000","last_undegraded":"2023-07-19T20:44:39.965319+0000","last_fullsized":"2023-07-19T20:44:39.965319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:07:43.608434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965884+0000","last_change":"2023-07-19T20:44:38.158352+0000","last_active":"2023-07-19T20:44:39.965884+0000","last_peered":"2023-07-19T20:44:39.965884+0000","last_clean":"2023-07-19T20:44:39.965884+0000","last_became_active":"2023-07-19T20:44:38.158108+0000","last_became_peered":"2023-07-19T20:44:38.158108+0000","last_unstale":"2023-07-19T20:44:39.965884+0000","last_undegraded":"2023-07-19T20:44:39.965884+0000","last_fullsized":"2023-07-19T20:44:39.965884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:56:20.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967338+0000","last_change":"2023-07-19T20:44:38.578475+0000","last_active":"2023-07-19T20:44:39.967338+0000","last_peered":"2023-07-19T20:44:39.967338+0000","last_clean":"2023-07-19T20:44:39.967338+0000","last_became_active":"2023-07-19T20:44:38.578148+0000","last_became_peered":"2023-07-19T20:44:38.578148+0000","last_unstale":"2023-07-19T20:44:39.967338+0000","last_undegraded":"2023-07-19T20:44:39.967338+0000","last_fullsized":"2023-07-19T20:44:39.967338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:47:20.937341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966031+0000","last_change":"2023-07-19T20:44:38.161146+0000","last_active":"2023-07-19T20:44:39.966031+0000","last_peered":"2023-07-19T20:44:39.966031+0000","last_clean":"2023-07-19T20:44:39.966031+0000","last_became_active":"2023-07-19T20:44:38.160826+0000","last_became_peered":"2023-07-19T20:44:38.160826+0000","last_unstale":"2023-07-19T20:44:39.966031+0000","last_undegraded":"2023-07-19T20:44:39.966031+0000","last_fullsized":"2023-07-19T20:44:39.966031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:00:17.913421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965696+0000","last_change":"2023-07-19T20:44:38.575529+0000","last_active":"2023-07-19T20:44:39.965696+0000","last_peered":"2023-07-19T20:44:39.965696+0000","last_clean":"2023-07-19T20:44:39.965696+0000","last_became_active":"2023-07-19T20:44:38.571437+0000","last_became_peered":"2023-07-19T20:44:38.571437+0000","last_unstale":"2023-07-19T20:44:39.965696+0000","last_undegraded":"2023-07-19T20:44:39.965696+0000","last_fullsized":"2023-07-19T20:44:39.965696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:31:08.854923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556868+0000","last_change":"2023-07-19T20:44:38.151428+0000","last_active":"2023-07-19T20:44:39.556868+0000","last_peered":"2023-07-19T20:44:39.556868+0000","last_clean":"2023-07-19T20:44:39.556868+0000","last_became_active":"2023-07-19T20:44:38.150814+0000","last_became_peered":"2023-07-19T20:44:38.150814+0000","last_unstale":"2023-07-19T20:44:39.556868+0000","last_undegraded":"2023-07-19T20:44:39.556868+0000","last_fullsized":"2023-07-19T20:44:39.556868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:43:49.400337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966925+0000","last_change":"2023-07-19T20:44:38.578498+0000","last_active":"2023-07-19T20:44:39.966925+0000","last_peered":"2023-07-19T20:44:39.966925+0000","last_clean":"2023-07-19T20:44:39.966925+0000","last_became_active":"2023-07-19T20:44:38.578229+0000","last_became_peered":"2023-07-19T20:44:38.578229+0000","last_unstale":"2023-07-19T20:44:39.966925+0000","last_undegraded":"2023-07-19T20:44:39.966925+0000","last_fullsized":"2023-07-19T20:44:39.966925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965996+0000","last_change":"2023-07-19T20:44:38.162523+0000","last_active":"2023-07-19T20:44:39.965996+0000","last_peered":"2023-07-19T20:44:39.965996+0000","last_clean":"2023-07-19T20:44:39.965996+0000","last_became_active":"2023-07-19T20:44:38.162180+0000","last_became_peered":"2023-07-19T20:44:38.162180+0000","last_unstale":"2023-07-19T20:44:39.965996+0000","last_undegraded":"2023-07-19T20:44:39.965996+0000","last_fullsized":"2023-07-19T20:44:39.965996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:51:41.425413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966943+0000","last_change":"2023-07-19T20:44:38.578374+0000","last_active":"2023-07-19T20:44:39.966943+0000","last_peered":"2023-07-19T20:44:39.966943+0000","last_clean":"2023-07-19T20:44:39.966943+0000","last_became_active":"2023-07-19T20:44:38.578063+0000","last_became_peered":"2023-07-19T20:44:38.578063+0000","last_unstale":"2023-07-19T20:44:39.966943+0000","last_undegraded":"2023-07-19T20:44:39.966943+0000","last_fullsized":"2023-07-19T20:44:39.966943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966034+0000","last_change":"2023-07-19T20:44:38.161133+0000","last_active":"2023-07-19T20:44:39.966034+0000","last_peered":"2023-07-19T20:44:39.966034+0000","last_clean":"2023-07-19T20:44:39.966034+0000","last_became_active":"2023-07-19T20:44:38.160858+0000","last_became_peered":"2023-07-19T20:44:38.160858+0000","last_unstale":"2023-07-19T20:44:39.966034+0000","last_undegraded":"2023-07-19T20:44:39.966034+0000","last_fullsized":"2023-07-19T20:44:39.966034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966513+0000","last_change":"2023-07-19T20:44:38.569109+0000","last_active":"2023-07-19T20:44:39.966513+0000","last_peered":"2023-07-19T20:44:39.966513+0000","last_clean":"2023-07-19T20:44:39.966513+0000","last_became_active":"2023-07-19T20:44:38.568655+0000","last_became_peered":"2023-07-19T20:44:38.568655+0000","last_unstale":"2023-07-19T20:44:39.966513+0000","last_undegraded":"2023-07-19T20:44:39.966513+0000","last_fullsized":"2023-07-19T20:44:39.966513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:22:21.797390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966727+0000","last_change":"2023-07-19T20:44:38.159979+0000","last_active":"2023-07-19T20:44:39.966727+0000","last_peered":"2023-07-19T20:44:39.966727+0000","last_clean":"2023-07-19T20:44:39.966727+0000","last_became_active":"2023-07-19T20:44:38.159724+0000","last_became_peered":"2023-07-19T20:44:38.159724+0000","last_unstale":"2023-07-19T20:44:39.966727+0000","last_undegraded":"2023-07-19T20:44:39.966727+0000","last_fullsized":"2023-07-19T20:44:39.966727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:13:29.703932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557319+0000","last_change":"2023-07-19T20:44:38.573821+0000","last_active":"2023-07-19T20:44:39.557319+0000","last_peered":"2023-07-19T20:44:39.557319+0000","last_clean":"2023-07-19T20:44:39.557319+0000","last_became_active":"2023-07-19T20:44:38.573531+0000","last_became_peered":"2023-07-19T20:44:38.573531+0000","last_unstale":"2023-07-19T20:44:39.557319+0000","last_undegraded":"2023-07-19T20:44:39.557319+0000","last_fullsized":"2023-07-19T20:44:39.557319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:12:57.038089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967186+0000","last_change":"2023-07-19T20:44:38.161247+0000","last_active":"2023-07-19T20:44:39.967186+0000","last_peered":"2023-07-19T20:44:39.967186+0000","last_clean":"2023-07-19T20:44:39.967186+0000","last_became_active":"2023-07-19T20:44:38.160983+0000","last_became_peered":"2023-07-19T20:44:38.160983+0000","last_unstale":"2023-07-19T20:44:39.967186+0000","last_undegraded":"2023-07-19T20:44:39.967186+0000","last_fullsized":"2023-07-19T20:44:39.967186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:48:53.708405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965596+0000","last_change":"2023-07-19T20:44:38.570267+0000","last_active":"2023-07-19T20:44:39.965596+0000","last_peered":"2023-07-19T20:44:39.965596+0000","last_clean":"2023-07-19T20:44:39.965596+0000","last_became_active":"2023-07-19T20:44:38.569970+0000","last_became_peered":"2023-07-19T20:44:38.569970+0000","last_unstale":"2023-07-19T20:44:39.965596+0000","last_undegraded":"2023-07-19T20:44:39.965596+0000","last_fullsized":"2023-07-19T20:44:39.965596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965824+0000","last_change":"2023-07-19T20:44:38.162813+0000","last_active":"2023-07-19T20:44:39.965824+0000","last_peered":"2023-07-19T20:44:39.965824+0000","last_clean":"2023-07-19T20:44:39.965824+0000","last_became_active":"2023-07-19T20:44:38.162512+0000","last_became_peered":"2023-07-19T20:44:38.162512+0000","last_unstale":"2023-07-19T20:44:39.965824+0000","last_undegraded":"2023-07-19T20:44:39.965824+0000","last_fullsized":"2023-07-19T20:44:39.965824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:56:20.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966572+0000","last_change":"2023-07-19T20:44:38.574677+0000","last_active":"2023-07-19T20:44:39.966572+0000","last_peered":"2023-07-19T20:44:39.966572+0000","last_clean":"2023-07-19T20:44:39.966572+0000","last_became_active":"2023-07-19T20:44:38.574384+0000","last_became_peered":"2023-07-19T20:44:38.574384+0000","last_unstale":"2023-07-19T20:44:39.966572+0000","last_undegraded":"2023-07-19T20:44:39.966572+0000","last_fullsized":"2023-07-19T20:44:39.966572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:56:39.985134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557050+0000","last_change":"2023-07-19T20:44:38.157897+0000","last_active":"2023-07-19T20:44:39.557050+0000","last_peered":"2023-07-19T20:44:39.557050+0000","last_clean":"2023-07-19T20:44:39.557050+0000","last_became_active":"2023-07-19T20:44:38.157613+0000","last_became_peered":"2023-07-19T20:44:38.157613+0000","last_unstale":"2023-07-19T20:44:39.557050+0000","last_undegraded":"2023-07-19T20:44:39.557050+0000","last_fullsized":"2023-07-19T20:44:39.557050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:10:43.091101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966876+0000","last_change":"2023-07-19T20:44:38.567166+0000","last_active":"2023-07-19T20:44:39.966876+0000","last_peered":"2023-07-19T20:44:39.966876+0000","last_clean":"2023-07-19T20:44:39.966876+0000","last_became_active":"2023-07-19T20:44:38.566539+0000","last_became_peered":"2023-07-19T20:44:38.566539+0000","last_unstale":"2023-07-19T20:44:39.966876+0000","last_undegraded":"2023-07-19T20:44:39.966876+0000","last_fullsized":"2023-07-19T20:44:39.966876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:57:34.828178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966584+0000","last_change":"2023-07-19T20:44:38.153301+0000","last_active":"2023-07-19T20:44:39.966584+0000","last_peered":"2023-07-19T20:44:39.966584+0000","last_clean":"2023-07-19T20:44:39.966584+0000","last_became_active":"2023-07-19T20:44:38.153036+0000","last_became_peered":"2023-07-19T20:44:38.153036+0000","last_unstale":"2023-07-19T20:44:39.966584+0000","last_undegraded":"2023-07-19T20:44:39.966584+0000","last_fullsized":"2023-07-19T20:44:39.966584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:29:36.129487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966373+0000","last_change":"2023-07-19T20:44:38.566702+0000","last_active":"2023-07-19T20:44:39.966373+0000","last_peered":"2023-07-19T20:44:39.966373+0000","last_clean":"2023-07-19T20:44:39.966373+0000","last_became_active":"2023-07-19T20:44:38.566298+0000","last_became_peered":"2023-07-19T20:44:38.566298+0000","last_unstale":"2023-07-19T20:44:39.966373+0000","last_undegraded":"2023-07-19T20:44:39.966373+0000","last_fullsized":"2023-07-19T20:44:39.966373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:40:21.960885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965195+0000","last_change":"2023-07-19T20:44:38.161123+0000","last_active":"2023-07-19T20:44:39.965195+0000","last_peered":"2023-07-19T20:44:39.965195+0000","last_clean":"2023-07-19T20:44:39.965195+0000","last_became_active":"2023-07-19T20:44:38.160828+0000","last_became_peered":"2023-07-19T20:44:38.160828+0000","last_unstale":"2023-07-19T20:44:39.965195+0000","last_undegraded":"2023-07-19T20:44:39.965195+0000","last_fullsized":"2023-07-19T20:44:39.965195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556893+0000","last_change":"2023-07-19T20:44:38.573695+0000","last_active":"2023-07-19T20:44:39.556893+0000","last_peered":"2023-07-19T20:44:39.556893+0000","last_clean":"2023-07-19T20:44:39.556893+0000","last_became_active":"2023-07-19T20:44:38.573109+0000","last_became_peered":"2023-07-19T20:44:38.573109+0000","last_unstale":"2023-07-19T20:44:39.556893+0000","last_undegraded":"2023-07-19T20:44:39.556893+0000","last_fullsized":"2023-07-19T20:44:39.556893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:10:27.373852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966776+0000","last_change":"2023-07-19T20:44:38.159710+0000","last_active":"2023-07-19T20:44:39.966776+0000","last_peered":"2023-07-19T20:44:39.966776+0000","last_clean":"2023-07-19T20:44:39.966776+0000","last_became_active":"2023-07-19T20:44:38.159491+0000","last_became_peered":"2023-07-19T20:44:38.159491+0000","last_unstale":"2023-07-19T20:44:39.966776+0000","last_undegraded":"2023-07-19T20:44:39.966776+0000","last_fullsized":"2023-07-19T20:44:39.966776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:48:53.708405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.556794+0000","last_change":"2023-07-19T20:44:33.123673+0000","last_active":"2023-07-19T20:44:38.556794+0000","last_peered":"2023-07-19T20:44:38.556794+0000","last_clean":"2023-07-19T20:44:38.556794+0000","last_became_active":"2023-07-19T20:44:33.123400+0000","last_became_peered":"2023-07-19T20:44:33.123400+0000","last_unstale":"2023-07-19T20:44:38.556794+0000","last_undegraded":"2023-07-19T20:44:38.556794+0000","last_fullsized":"2023-07-19T20:44:38.556794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:29:32.159769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965145+0000","last_change":"2023-07-19T20:44:38.578403+0000","last_active":"2023-07-19T20:44:39.965145+0000","last_peered":"2023-07-19T20:44:39.965145+0000","last_clean":"2023-07-19T20:44:39.965145+0000","last_became_active":"2023-07-19T20:44:38.578137+0000","last_became_peered":"2023-07-19T20:44:38.578137+0000","last_unstale":"2023-07-19T20:44:39.965145+0000","last_undegraded":"2023-07-19T20:44:39.965145+0000","last_fullsized":"2023-07-19T20:44:39.965145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:31:08.854923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.556588+0000","last_change":"2023-07-19T20:44:33.124105+0000","last_active":"2023-07-19T20:44:38.556588+0000","last_peered":"2023-07-19T20:44:38.556588+0000","last_clean":"2023-07-19T20:44:38.556588+0000","last_became_active":"2023-07-19T20:44:33.123795+0000","last_became_peered":"2023-07-19T20:44:33.123795+0000","last_unstale":"2023-07-19T20:44:38.556588+0000","last_undegraded":"2023-07-19T20:44:38.556588+0000","last_fullsized":"2023-07-19T20:44:38.556588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:14:19.759142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965980+0000","last_change":"2023-07-19T20:44:38.153628+0000","last_active":"2023-07-19T20:44:39.965980+0000","last_peered":"2023-07-19T20:44:39.965980+0000","last_clean":"2023-07-19T20:44:39.965980+0000","last_became_active":"2023-07-19T20:44:38.153300+0000","last_became_peered":"2023-07-19T20:44:38.153300+0000","last_unstale":"2023-07-19T20:44:39.965980+0000","last_undegraded":"2023-07-19T20:44:39.965980+0000","last_fullsized":"2023-07-19T20:44:39.965980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966636+0000","last_change":"2023-07-19T20:44:38.565069+0000","last_active":"2023-07-19T20:44:39.966636+0000","last_peered":"2023-07-19T20:44:39.966636+0000","last_clean":"2023-07-19T20:44:39.966636+0000","last_became_active":"2023-07-19T20:44:38.564602+0000","last_became_peered":"2023-07-19T20:44:38.564602+0000","last_unstale":"2023-07-19T20:44:39.966636+0000","last_undegraded":"2023-07-19T20:44:39.966636+0000","last_fullsized":"2023-07-19T20:44:39.966636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:16:09.390291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.576773+0000","last_change":"2023-07-19T20:44:33.124619+0000","last_active":"2023-07-19T20:44:38.576773+0000","last_peered":"2023-07-19T20:44:38.576773+0000","last_clean":"2023-07-19T20:44:38.576773+0000","last_became_active":"2023-07-19T20:44:33.124278+0000","last_became_peered":"2023-07-19T20:44:33.124278+0000","last_unstale":"2023-07-19T20:44:38.576773+0000","last_undegraded":"2023-07-19T20:44:38.576773+0000","last_fullsized":"2023-07-19T20:44:38.576773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:57:12.956476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.570350+0000","last_change":"2023-07-19T20:44:33.129185+0000","last_active":"2023-07-19T20:44:38.570350+0000","last_peered":"2023-07-19T20:44:38.570350+0000","last_clean":"2023-07-19T20:44:38.570350+0000","last_became_active":"2023-07-19T20:44:33.128873+0000","last_became_peered":"2023-07-19T20:44:33.128873+0000","last_unstale":"2023-07-19T20:44:38.570350+0000","last_undegraded":"2023-07-19T20:44:38.570350+0000","last_fullsized":"2023-07-19T20:44:38.570350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:59:43.504158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965507+0000","last_change":"2023-07-19T20:44:38.157781+0000","last_active":"2023-07-19T20:44:39.965507+0000","last_peered":"2023-07-19T20:44:39.965507+0000","last_clean":"2023-07-19T20:44:39.965507+0000","last_became_active":"2023-07-19T20:44:38.157521+0000","last_became_peered":"2023-07-19T20:44:38.157521+0000","last_unstale":"2023-07-19T20:44:39.965507+0000","last_undegraded":"2023-07-19T20:44:39.965507+0000","last_fullsized":"2023-07-19T20:44:39.965507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:48:53.708405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965790+0000","last_change":"2023-07-19T20:44:38.569844+0000","last_active":"2023-07-19T20:44:39.965790+0000","last_peered":"2023-07-19T20:44:39.965790+0000","last_clean":"2023-07-19T20:44:39.965790+0000","last_became_active":"2023-07-19T20:44:38.569612+0000","last_became_peered":"2023-07-19T20:44:38.569612+0000","last_unstale":"2023-07-19T20:44:39.965790+0000","last_undegraded":"2023-07-19T20:44:39.965790+0000","last_fullsized":"2023-07-19T20:44:39.965790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:30:42.451874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.571549+0000","last_change":"2023-07-19T20:44:33.746155+0000","last_active":"2023-07-19T20:44:38.571549+0000","last_peered":"2023-07-19T20:44:38.571549+0000","last_clean":"2023-07-19T20:44:38.571549+0000","last_became_active":"2023-07-19T20:44:33.745839+0000","last_became_peered":"2023-07-19T20:44:33.745839+0000","last_unstale":"2023-07-19T20:44:38.571549+0000","last_undegraded":"2023-07-19T20:44:38.571549+0000","last_fullsized":"2023-07-19T20:44:38.571549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:27:53.622247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556163+0000","last_change":"2023-07-19T20:44:38.156539+0000","last_active":"2023-07-19T20:44:39.556163+0000","last_peered":"2023-07-19T20:44:39.556163+0000","last_clean":"2023-07-19T20:44:39.556163+0000","last_became_active":"2023-07-19T20:44:38.156248+0000","last_became_peered":"2023-07-19T20:44:38.156248+0000","last_unstale":"2023-07-19T20:44:39.556163+0000","last_undegraded":"2023-07-19T20:44:39.556163+0000","last_fullsized":"2023-07-19T20:44:39.556163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:27:24.261526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556806+0000","last_change":"2023-07-19T20:44:38.574341+0000","last_active":"2023-07-19T20:44:39.556806+0000","last_peered":"2023-07-19T20:44:39.556806+0000","last_clean":"2023-07-19T20:44:39.556806+0000","last_became_active":"2023-07-19T20:44:38.574094+0000","last_became_peered":"2023-07-19T20:44:38.574094+0000","last_unstale":"2023-07-19T20:44:39.556806+0000","last_undegraded":"2023-07-19T20:44:39.556806+0000","last_fullsized":"2023-07-19T20:44:39.556806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:47:25.794801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.569883+0000","last_change":"2023-07-19T20:44:33.746397+0000","last_active":"2023-07-19T20:44:38.569883+0000","last_peered":"2023-07-19T20:44:38.569883+0000","last_clean":"2023-07-19T20:44:38.569883+0000","last_became_active":"2023-07-19T20:44:33.746140+0000","last_became_peered":"2023-07-19T20:44:33.746140+0000","last_unstale":"2023-07-19T20:44:38.569883+0000","last_undegraded":"2023-07-19T20:44:38.569883+0000","last_fullsized":"2023-07-19T20:44:38.569883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:56:34.826030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965682+0000","last_change":"2023-07-19T20:44:38.155907+0000","last_active":"2023-07-19T20:44:39.965682+0000","last_peered":"2023-07-19T20:44:39.965682+0000","last_clean":"2023-07-19T20:44:39.965682+0000","last_became_active":"2023-07-19T20:44:38.155624+0000","last_became_peered":"2023-07-19T20:44:38.155624+0000","last_unstale":"2023-07-19T20:44:39.965682+0000","last_undegraded":"2023-07-19T20:44:39.965682+0000","last_fullsized":"2023-07-19T20:44:39.965682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:58:48.815316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557161+0000","last_change":"2023-07-19T20:44:38.564337+0000","last_active":"2023-07-19T20:44:39.557161+0000","last_peered":"2023-07-19T20:44:39.557161+0000","last_clean":"2023-07-19T20:44:39.557161+0000","last_became_active":"2023-07-19T20:44:38.563991+0000","last_became_peered":"2023-07-19T20:44:38.563991+0000","last_unstale":"2023-07-19T20:44:39.557161+0000","last_undegraded":"2023-07-19T20:44:39.557161+0000","last_fullsized":"2023-07-19T20:44:39.557161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:48:50.207451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.554572+0000","last_change":"2023-07-19T20:44:33.746552+0000","last_active":"2023-07-19T20:44:38.554572+0000","last_peered":"2023-07-19T20:44:38.554572+0000","last_clean":"2023-07-19T20:44:38.554572+0000","last_became_active":"2023-07-19T20:44:33.745934+0000","last_became_peered":"2023-07-19T20:44:33.745934+0000","last_unstale":"2023-07-19T20:44:38.554572+0000","last_undegraded":"2023-07-19T20:44:38.554572+0000","last_fullsized":"2023-07-19T20:44:38.554572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:19:16.931517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966394+0000","last_change":"2023-07-19T20:44:38.152599+0000","last_active":"2023-07-19T20:44:39.966394+0000","last_peered":"2023-07-19T20:44:39.966394+0000","last_clean":"2023-07-19T20:44:39.966394+0000","last_became_active":"2023-07-19T20:44:38.152331+0000","last_became_peered":"2023-07-19T20:44:38.152331+0000","last_unstale":"2023-07-19T20:44:39.966394+0000","last_undegraded":"2023-07-19T20:44:39.966394+0000","last_fullsized":"2023-07-19T20:44:39.966394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:43:49.400337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556867+0000","last_change":"2023-07-19T20:44:38.573279+0000","last_active":"2023-07-19T20:44:39.556867+0000","last_peered":"2023-07-19T20:44:39.556867+0000","last_clean":"2023-07-19T20:44:39.556867+0000","last_became_active":"2023-07-19T20:44:38.572918+0000","last_became_peered":"2023-07-19T20:44:38.572918+0000","last_unstale":"2023-07-19T20:44:39.556867+0000","last_undegraded":"2023-07-19T20:44:39.556867+0000","last_fullsized":"2023-07-19T20:44:39.556867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:12:57.038089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.560127+0000","last_change":"2023-07-19T20:44:33.746879+0000","last_active":"2023-07-19T20:44:38.560127+0000","last_peered":"2023-07-19T20:44:38.560127+0000","last_clean":"2023-07-19T20:44:38.560127+0000","last_became_active":"2023-07-19T20:44:33.746120+0000","last_became_peered":"2023-07-19T20:44:33.746120+0000","last_unstale":"2023-07-19T20:44:38.560127+0000","last_undegraded":"2023-07-19T20:44:38.560127+0000","last_fullsized":"2023-07-19T20:44:38.560127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:34:22.791863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556786+0000","last_change":"2023-07-19T20:44:38.157438+0000","last_active":"2023-07-19T20:44:39.556786+0000","last_peered":"2023-07-19T20:44:39.556786+0000","last_clean":"2023-07-19T20:44:39.556786+0000","last_became_active":"2023-07-19T20:44:38.157152+0000","last_became_peered":"2023-07-19T20:44:38.157152+0000","last_unstale":"2023-07-19T20:44:39.556786+0000","last_undegraded":"2023-07-19T20:44:39.556786+0000","last_fullsized":"2023-07-19T20:44:39.556786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:51:22.297960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965788+0000","last_change":"2023-07-19T20:44:38.570259+0000","last_active":"2023-07-19T20:44:39.965788+0000","last_peered":"2023-07-19T20:44:39.965788+0000","last_clean":"2023-07-19T20:44:39.965788+0000","last_became_active":"2023-07-19T20:44:38.569979+0000","last_became_peered":"2023-07-19T20:44:38.569979+0000","last_unstale":"2023-07-19T20:44:39.965788+0000","last_undegraded":"2023-07-19T20:44:39.965788+0000","last_fullsized":"2023-07-19T20:44:39.965788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:54:57.194368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.561428+0000","last_change":"2023-07-19T20:44:33.129202+0000","last_active":"2023-07-19T20:44:38.561428+0000","last_peered":"2023-07-19T20:44:38.561428+0000","last_clean":"2023-07-19T20:44:38.561428+0000","last_became_active":"2023-07-19T20:44:33.128920+0000","last_became_peered":"2023-07-19T20:44:33.128920+0000","last_unstale":"2023-07-19T20:44:38.561428+0000","last_undegraded":"2023-07-19T20:44:38.561428+0000","last_fullsized":"2023-07-19T20:44:38.561428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:43:18.861932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967383+0000","last_change":"2023-07-19T20:44:38.161925+0000","last_active":"2023-07-19T20:44:39.967383+0000","last_peered":"2023-07-19T20:44:39.967383+0000","last_clean":"2023-07-19T20:44:39.967383+0000","last_became_active":"2023-07-19T20:44:38.161648+0000","last_became_peered":"2023-07-19T20:44:38.161648+0000","last_unstale":"2023-07-19T20:44:39.967383+0000","last_undegraded":"2023-07-19T20:44:39.967383+0000","last_fullsized":"2023-07-19T20:44:39.967383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:03:08.671248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556470+0000","last_change":"2023-07-19T20:44:38.570962+0000","last_active":"2023-07-19T20:44:39.556470+0000","last_peered":"2023-07-19T20:44:39.556470+0000","last_clean":"2023-07-19T20:44:39.556470+0000","last_became_active":"2023-07-19T20:44:38.570620+0000","last_became_peered":"2023-07-19T20:44:38.570620+0000","last_unstale":"2023-07-19T20:44:39.556470+0000","last_undegraded":"2023-07-19T20:44:39.556470+0000","last_fullsized":"2023-07-19T20:44:39.556470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:09:27.024650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965931+0000","last_change":"2023-07-19T20:44:38.158044+0000","last_active":"2023-07-19T20:44:39.965931+0000","last_peered":"2023-07-19T20:44:39.965931+0000","last_clean":"2023-07-19T20:44:39.965931+0000","last_became_active":"2023-07-19T20:44:38.157760+0000","last_became_peered":"2023-07-19T20:44:38.157760+0000","last_unstale":"2023-07-19T20:44:39.965931+0000","last_undegraded":"2023-07-19T20:44:39.965931+0000","last_fullsized":"2023-07-19T20:44:39.965931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:03:08.671248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557350+0000","last_change":"2023-07-19T20:44:38.569229+0000","last_active":"2023-07-19T20:44:39.557350+0000","last_peered":"2023-07-19T20:44:39.557350+0000","last_clean":"2023-07-19T20:44:39.557350+0000","last_became_active":"2023-07-19T20:44:38.568732+0000","last_became_peered":"2023-07-19T20:44:38.568732+0000","last_unstale":"2023-07-19T20:44:39.557350+0000","last_undegraded":"2023-07-19T20:44:39.557350+0000","last_fullsized":"2023-07-19T20:44:39.557350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:43:50.405654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967067+0000","last_change":"2023-07-19T20:44:38.158368+0000","last_active":"2023-07-19T20:44:39.967067+0000","last_peered":"2023-07-19T20:44:39.967067+0000","last_clean":"2023-07-19T20:44:39.967067+0000","last_became_active":"2023-07-19T20:44:38.158097+0000","last_became_peered":"2023-07-19T20:44:38.158097+0000","last_unstale":"2023-07-19T20:44:39.967067+0000","last_undegraded":"2023-07-19T20:44:39.967067+0000","last_fullsized":"2023-07-19T20:44:39.967067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966104+0000","last_change":"2023-07-19T20:44:38.574231+0000","last_active":"2023-07-19T20:44:39.966104+0000","last_peered":"2023-07-19T20:44:39.966104+0000","last_clean":"2023-07-19T20:44:39.966104+0000","last_became_active":"2023-07-19T20:44:38.573954+0000","last_became_peered":"2023-07-19T20:44:38.573954+0000","last_unstale":"2023-07-19T20:44:39.966104+0000","last_undegraded":"2023-07-19T20:44:39.966104+0000","last_fullsized":"2023-07-19T20:44:39.966104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:44:27.891825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967472+0000","last_change":"2023-07-19T20:44:38.158334+0000","last_active":"2023-07-19T20:44:39.967472+0000","last_peered":"2023-07-19T20:44:39.967472+0000","last_clean":"2023-07-19T20:44:39.967472+0000","last_became_active":"2023-07-19T20:44:38.158046+0000","last_became_peered":"2023-07-19T20:44:38.158046+0000","last_unstale":"2023-07-19T20:44:39.967472+0000","last_undegraded":"2023-07-19T20:44:39.967472+0000","last_fullsized":"2023-07-19T20:44:39.967472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:49:55.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966062+0000","last_change":"2023-07-19T20:44:38.574118+0000","last_active":"2023-07-19T20:44:39.966062+0000","last_peered":"2023-07-19T20:44:39.966062+0000","last_clean":"2023-07-19T20:44:39.966062+0000","last_became_active":"2023-07-19T20:44:38.573825+0000","last_became_peered":"2023-07-19T20:44:38.573825+0000","last_unstale":"2023-07-19T20:44:39.966062+0000","last_undegraded":"2023-07-19T20:44:39.966062+0000","last_fullsized":"2023-07-19T20:44:39.966062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:12:33.443843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965892+0000","last_change":"2023-07-19T20:44:38.158463+0000","last_active":"2023-07-19T20:44:39.965892+0000","last_peered":"2023-07-19T20:44:39.965892+0000","last_clean":"2023-07-19T20:44:39.965892+0000","last_became_active":"2023-07-19T20:44:38.158210+0000","last_became_peered":"2023-07-19T20:44:38.158210+0000","last_unstale":"2023-07-19T20:44:39.965892+0000","last_undegraded":"2023-07-19T20:44:39.965892+0000","last_fullsized":"2023-07-19T20:44:39.965892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:03:08.671248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965328+0000","last_change":"2023-07-19T20:44:38.561250+0000","last_active":"2023-07-19T20:44:39.965328+0000","last_peered":"2023-07-19T20:44:39.965328+0000","last_clean":"2023-07-19T20:44:39.965328+0000","last_became_active":"2023-07-19T20:44:38.561001+0000","last_became_peered":"2023-07-19T20:44:38.561001+0000","last_unstale":"2023-07-19T20:44:39.965328+0000","last_undegraded":"2023-07-19T20:44:39.965328+0000","last_fullsized":"2023-07-19T20:44:39.965328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965583+0000","last_change":"2023-07-19T20:44:38.156696+0000","last_active":"2023-07-19T20:44:39.965583+0000","last_peered":"2023-07-19T20:44:39.965583+0000","last_clean":"2023-07-19T20:44:39.965583+0000","last_became_active":"2023-07-19T20:44:38.156455+0000","last_became_peered":"2023-07-19T20:44:38.156455+0000","last_unstale":"2023-07-19T20:44:39.965583+0000","last_undegraded":"2023-07-19T20:44:39.965583+0000","last_fullsized":"2023-07-19T20:44:39.965583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:00:17.913421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965669+0000","last_change":"2023-07-19T20:44:38.568760+0000","last_active":"2023-07-19T20:44:39.965669+0000","last_peered":"2023-07-19T20:44:39.965669+0000","last_clean":"2023-07-19T20:44:39.965669+0000","last_became_active":"2023-07-19T20:44:38.568148+0000","last_became_peered":"2023-07-19T20:44:38.568148+0000","last_unstale":"2023-07-19T20:44:39.965669+0000","last_undegraded":"2023-07-19T20:44:39.965669+0000","last_fullsized":"2023-07-19T20:44:39.965669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:29:06.966551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556998+0000","last_change":"2023-07-19T20:44:38.574672+0000","last_active":"2023-07-19T20:44:39.556998+0000","last_peered":"2023-07-19T20:44:39.556998+0000","last_clean":"2023-07-19T20:44:39.556998+0000","last_became_active":"2023-07-19T20:44:38.574318+0000","last_became_peered":"2023-07-19T20:44:38.574318+0000","last_unstale":"2023-07-19T20:44:39.556998+0000","last_undegraded":"2023-07-19T20:44:39.556998+0000","last_fullsized":"2023-07-19T20:44:39.556998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:29:14.941818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965294+0000","last_change":"2023-07-19T20:44:38.574389+0000","last_active":"2023-07-19T20:44:39.965294+0000","last_peered":"2023-07-19T20:44:39.965294+0000","last_clean":"2023-07-19T20:44:39.965294+0000","last_became_active":"2023-07-19T20:44:38.574112+0000","last_became_peered":"2023-07-19T20:44:38.574112+0000","last_unstale":"2023-07-19T20:44:39.965294+0000","last_undegraded":"2023-07-19T20:44:39.965294+0000","last_fullsized":"2023-07-19T20:44:39.965294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:19:13.016609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966463+0000","last_change":"2023-07-19T20:44:38.566538+0000","last_active":"2023-07-19T20:44:39.966463+0000","last_peered":"2023-07-19T20:44:39.966463+0000","last_clean":"2023-07-19T20:44:39.966463+0000","last_became_active":"2023-07-19T20:44:38.566260+0000","last_became_peered":"2023-07-19T20:44:38.566260+0000","last_unstale":"2023-07-19T20:44:39.966463+0000","last_undegraded":"2023-07-19T20:44:39.966463+0000","last_fullsized":"2023-07-19T20:44:39.966463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:39:41.156243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965832+0000","last_change":"2023-07-19T20:44:38.583615+0000","last_active":"2023-07-19T20:44:39.965832+0000","last_peered":"2023-07-19T20:44:39.965832+0000","last_clean":"2023-07-19T20:44:39.965832+0000","last_became_active":"2023-07-19T20:44:38.583193+0000","last_became_peered":"2023-07-19T20:44:38.583193+0000","last_unstale":"2023-07-19T20:44:39.965832+0000","last_undegraded":"2023-07-19T20:44:39.965832+0000","last_fullsized":"2023-07-19T20:44:39.965832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:30:42.451874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556700+0000","last_change":"2023-07-19T20:44:38.578448+0000","last_active":"2023-07-19T20:44:39.556700+0000","last_peered":"2023-07-19T20:44:39.556700+0000","last_clean":"2023-07-19T20:44:39.556700+0000","last_became_active":"2023-07-19T20:44:38.578182+0000","last_became_peered":"2023-07-19T20:44:38.578182+0000","last_unstale":"2023-07-19T20:44:39.556700+0000","last_undegraded":"2023-07-19T20:44:39.556700+0000","last_fullsized":"2023-07-19T20:44:39.556700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:20:24.991572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":835584,"data_stored":667667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":82172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":819200,"data_stored":672540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":81211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":77139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":81863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-19T20:44:43.012 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-19T20:44:43.013 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-19T20:44:43.013 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-19T20:44:43.014 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-19T20:44:43.014 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-19T20:44:43.167 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.174+0000 7f1374126700 1 Processor -- start 2023-07-19T20:44:43.167 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.174+0000 7f1374126700 1 -- start start 2023-07-19T20:44:43.175 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1374126700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f136c0bab50 0x7f136c156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.175 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1374126700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c0bd340 con 0x7f136c0bce20 2023-07-19T20:44:43.175 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1374126700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c0b9500 con 0x7f136c14b7c0 2023-07-19T20:44:43.175 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1374126700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0b87b0 con 0x7f136c0bab50 2023-07-19T20:44:43.176 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f13716c1700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f136c0bce20 0x7f136c0c1200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41228/0 (socket says 172.21.15.117:41228) 2023-07-19T20:44:43.176 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f13716c1700 1 -- 172.21.15.117:0/1236585306 learned_addr learned my addr 172.21.15.117:0/1236585306 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:43.176 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 -- 172.21.15.117:0/1236585306 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218082261 0 0) 0x7f136c0bd340 con 0x7f136c0bce20 2023-07-19T20:44:43.176 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 -- 172.21.15.117:0/1236585306 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13580035b0 con 0x7f136c0bce20 2023-07-19T20:44:43.176 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f13726c3700 1 --2- 172.21.15.117:0/1236585306 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f136c0bab50 0x7f136c156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 -- 172.21.15.117:0/1236585306 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3939625225 0 0) 0x7f13580035b0 con 0x7f136c0bce20 2023-07-19T20:44:43.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 -- 172.21.15.117:0/1236585306 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f136c0bab50 msgr2=0x7f136c156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:43.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 --2- 172.21.15.117:0/1236585306 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f136c0bab50 0x7f136c156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 -- 172.21.15.117:0/1236585306 >> v1:172.21.15.124:6789/0 conn(0x7f136c14b7c0 legacy=0x7f136c0b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 -- 172.21.15.117:0/1236585306 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c0c1910 con 0x7f136c0bce20 2023-07-19T20:44:43.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 -- 172.21.15.117:0/1236585306 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f135c001670 con 0x7f136c0bce20 2023-07-19T20:44:43.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 -- 172.21.15.117:0/1236585306 >> v1:172.21.15.117:6789/0 conn(0x7f136c0bce20 legacy=0x7f136c0c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 --2- 172.21.15.117:0/1236585306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1358003a30 0x7f1358003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 --2- 172.21.15.117:0/1236585306 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f136c0bab50 0x7f1358004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 --2- 172.21.15.117:0/1236585306 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1358004eb0 0x7f1358005320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 -- 172.21.15.117:0/1236585306 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0b87b0 con 0x7f1358003a30 2023-07-19T20:44:43.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 -- 172.21.15.117:0/1236585306 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135800bd80 con 0x7f1358004eb0 2023-07-19T20:44:43.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1370ec0700 1 -- 172.21.15.117:0/1236585306 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135800bf40 con 0x7f136c0bab50 2023-07-19T20:44:43.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f1371ec2700 1 --2- 172.21.15.117:0/1236585306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1358003a30 0x7f1358003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.179 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f13716c1700 1 --2- 172.21.15.117:0/1236585306 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f136c0bab50 0x7f1358004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.179 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.175+0000 7f13726c3700 1 --2- 172.21.15.117:0/1236585306 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1358004eb0 0x7f1358005320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.179 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1371ec2700 1 -- 172.21.15.117:0/1236585306 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f136c0bab50 msgr2=0x7f1358004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:43.179 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1371ec2700 1 --2- 172.21.15.117:0/1236585306 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f136c0bab50 0x7f1358004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.179 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1371ec2700 1 -- 172.21.15.117:0/1236585306 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1358004eb0 msgr2=0x7f1358005320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:43.179 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1371ec2700 1 --2- 172.21.15.117:0/1236585306 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1358004eb0 0x7f1358005320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.179 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1371ec2700 1 -- 172.21.15.117:0/1236585306 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13580035b0 con 0x7f1358003a30 2023-07-19T20:44:43.179 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1371ec2700 1 --2- 172.21.15.117:0/1236585306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1358003a30 0x7f1358003e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1368001800 tx=0x7f1358005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545aad4b48e51773 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:43.180 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1370ec0700 1 -- 172.21.15.117:0/1236585306 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13680012f0 con 0x7f1358003a30 2023-07-19T20:44:43.180 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1370ec0700 1 -- 172.21.15.117:0/1236585306 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13680052f0 con 0x7f1358003a30 2023-07-19T20:44:43.180 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1370ec0700 1 -- 172.21.15.117:0/1236585306 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368006860 con 0x7f1358003a30 2023-07-19T20:44:43.180 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1374126700 1 -- 172.21.15.117:0/1236585306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1358003a30 msgr2=0x7f1358003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.180 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1374126700 1 --2- 172.21.15.117:0/1236585306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1358003a30 0x7f1358003e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1368001800 tx=0x7f1358005880 comp rx=0 tx=0).stop 2023-07-19T20:44:43.180 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f13726c3700 1 -- 172.21.15.117:0/1236585306 reap_dead start 2023-07-19T20:44:43.180 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1374126700 1 -- 172.21.15.117:0/1236585306 shutdown_connections 2023-07-19T20:44:43.181 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1374126700 1 -- 172.21.15.117:0/1236585306 >> 172.21.15.117:0/1236585306 conn(0x7f136c072920 msgr2=0x7f136c0c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:43.181 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1374126700 1 -- 172.21.15.117:0/1236585306 shutdown_connections 2023-07-19T20:44:43.181 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.176+0000 7f1374126700 1 -- 172.21.15.117:0/1236585306 wait complete. 2023-07-19T20:44:43.181 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.177+0000 7f1374126700 1 Processor -- start 2023-07-19T20:44:43.181 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f1374126700 1 -- start start 2023-07-19T20:44:43.181 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f1374126700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1358003a30 0x7f136c1d3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.181 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f1374126700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c1d50e0 0x7f136c1d6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f1374126700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f136c143ed0 0x7f136c144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f1374126700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c1d25b0 con 0x7f136c1d50e0 2023-07-19T20:44:43.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f1374126700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c1d75a0 con 0x7f136c143ed0 2023-07-19T20:44:43.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f1374126700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c1d48e0 con 0x7f1358003a30 2023-07-19T20:44:43.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f13716c1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c1d50e0 0x7f136c1d6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f13716c1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c1d50e0 0x7f136c1d6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43460/0 (socket says 172.21.15.117:43460) 2023-07-19T20:44:43.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f13716c1700 1 -- 172.21.15.117:0/12284752 learned_addr learned my addr 172.21.15.117:0/12284752 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:43.183 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f13726c3700 1 --2- 172.21.15.117:0/12284752 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f136c143ed0 0x7f136c144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.183 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f1371ec2700 1 --2- 172.21.15.117:0/12284752 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1358003a30 0x7f136c1d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.184 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f13716c1700 1 -- 172.21.15.117:0/12284752 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1358003a30 msgr2=0x7f136c1d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.185 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f13716c1700 1 --2- 172.21.15.117:0/12284752 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1358003a30 0x7f136c1d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.185 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f13716c1700 1 -- 172.21.15.117:0/12284752 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f136c143ed0 msgr2=0x7f136c144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.185 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f13716c1700 1 --2- 172.21.15.117:0/12284752 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f136c143ed0 0x7f136c144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.185 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.178+0000 7f13716c1700 1 -- 172.21.15.117:0/12284752 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c1d4bc0 con 0x7f136c1d50e0 2023-07-19T20:44:43.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.179+0000 7f13716c1700 1 --2- 172.21.15.117:0/12284752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c1d50e0 0x7f136c1d6d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f135c007090 tx=0x7f135c0073a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:43.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.179+0000 7f13627fc700 1 -- 172.21.15.117:0/12284752 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c012560 con 0x7f136c1d50e0 2023-07-19T20:44:43.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.179+0000 7f13627fc700 1 -- 172.21.15.117:0/12284752 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c012700 con 0x7f136c1d50e0 2023-07-19T20:44:43.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.179+0000 7f13627fc700 1 -- 172.21.15.117:0/12284752 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c012ab0 con 0x7f136c1d50e0 2023-07-19T20:44:43.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.179+0000 7f1374126700 1 -- 172.21.15.117:0/12284752 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c1d72c0 con 0x7f136c1d50e0 2023-07-19T20:44:43.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.179+0000 7f1374126700 1 -- 172.21.15.117:0/12284752 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c144880 con 0x7f136c1d50e0 2023-07-19T20:44:43.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.180+0000 7f1374126700 1 -- 172.21.15.117:0/12284752 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c074890 con 0x7f136c1d50e0 2023-07-19T20:44:43.187 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.180+0000 7f13627fc700 1 -- 172.21.15.117:0/12284752 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f135c012c10 con 0x7f136c1d50e0 2023-07-19T20:44:43.187 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.181+0000 7f13627fc700 1 --2- 172.21.15.117:0/12284752 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f135006a660 0x7f135006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.187 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.181+0000 7f13627fc700 1 -- 172.21.15.117:0/12284752 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f135c0888a0 con 0x7f136c1d50e0 2023-07-19T20:44:43.187 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.181+0000 7f1371ec2700 1 --2- 172.21.15.117:0/12284752 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f135006a660 0x7f135006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.187 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.181+0000 7f1371ec2700 1 --2- 172.21.15.117:0/12284752 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f135006a660 0x7f135006cb10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1368014040 tx=0x7f1368009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:43.188 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.185+0000 7f13627fc700 1 -- 172.21.15.117:0/12284752 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f135c053d30 con 0x7f136c1d50e0 2023-07-19T20:44:43.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.423+0000 7f1374126700 1 -- 172.21.15.117:0/12284752 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f136c148bd0 con 0x7f136c1d50e0 2023-07-19T20:44:43.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.426+0000 7f13627fc700 1 -- 172.21.15.117:0/12284752 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169780 (secure 0 0 0) 0x7f135c057350 con 0x7f136c1d50e0 2023-07-19T20:44:43.422 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:43.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.429+0000 7f1374126700 1 -- 172.21.15.117:0/12284752 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f135006a660 msgr2=0x7f135006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.429+0000 7f1374126700 1 --2- 172.21.15.117:0/12284752 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f135006a660 0x7f135006cb10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1368014040 tx=0x7f1368009030 comp rx=0 tx=0).stop 2023-07-19T20:44:43.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.429+0000 7f1374126700 1 -- 172.21.15.117:0/12284752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c1d50e0 msgr2=0x7f136c1d6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.429+0000 7f1374126700 1 --2- 172.21.15.117:0/12284752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c1d50e0 0x7f136c1d6d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f135c007090 tx=0x7f135c0073a0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.429+0000 7f1374126700 1 -- 172.21.15.117:0/12284752 shutdown_connections 2023-07-19T20:44:43.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.429+0000 7f1374126700 1 --2- 172.21.15.117:0/12284752 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f135006a660 0x7f135006cb10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.429+0000 7f1374126700 1 --2- 172.21.15.117:0/12284752 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f136c143ed0 0x7f136c144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.429+0000 7f1374126700 1 --2- 172.21.15.117:0/12284752 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1358003a30 0x7f136c1d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.429+0000 7f1374126700 1 --2- 172.21.15.117:0/12284752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c1d50e0 0x7f136c1d6d80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.429+0000 7f1374126700 1 -- 172.21.15.117:0/12284752 >> 172.21.15.117:0/12284752 conn(0x7f136c072920 msgr2=0x7f136c0bf580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:43.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.429+0000 7f1374126700 1 -- 172.21.15.117:0/12284752 shutdown_connections 2023-07-19T20:44:43.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.429+0000 7f1374126700 1 -- 172.21.15.117:0/12284752 wait complete. 2023-07-19T20:44:43.434 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":146126},{"type":"v1","addr":"172.21.15.117:6833","nonce":146126}]},"active_addr":"172.21.15.117:6833/146126","active_change":"2023-07-19T20:44:25.678665+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":686239674}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":1500413723}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":1619178792}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":1552104152}]}]} 2023-07-19T20:44:43.440 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-19T20:44:43.440 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-19T20:44:43.441 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:43.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.567+0000 7f61310c5700 1 Processor -- start 2023-07-19T20:44:43.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.567+0000 7f61310c5700 1 -- start start 2023-07-19T20:44:43.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.568+0000 7f61310c5700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f612c0bacb0 0x7f612c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.568+0000 7f61310c5700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f612c071be0 0x7f612c1446a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.568+0000 7f61310c5700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c0729d0 con 0x7f612c144be0 2023-07-19T20:44:43.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.568+0000 7f61310c5700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612c0715e0 con 0x7f612c071be0 2023-07-19T20:44:43.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.568+0000 7f61310c5700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c0717c0 con 0x7f612c0bacb0 2023-07-19T20:44:43.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.568+0000 7f612a59c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f612c071be0 0x7f612c1446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.568+0000 7f612b59e700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f612c144be0 0x7f612c0b8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41232/0 (socket says 172.21.15.117:41232) 2023-07-19T20:44:43.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.568+0000 7f612b59e700 1 -- 172.21.15.117:0/3197945906 learned_addr learned my addr 172.21.15.117:0/3197945906 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:43.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.568+0000 7f612ad9d700 1 --2- 172.21.15.117:0/3197945906 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f612c0bacb0 0x7f612c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.569+0000 7f612a59c700 1 -- 172.21.15.117:0/3197945906 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f612c0bacb0 msgr2=0x7f612c0702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:43.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.569+0000 7f612a59c700 1 --2- 172.21.15.117:0/3197945906 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f612c0bacb0 0x7f612c0702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.569+0000 7f612a59c700 1 -- 172.21.15.117:0/3197945906 >> v1:172.21.15.117:6789/0 conn(0x7f612c144be0 legacy=0x7f612c0b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.569+0000 7f612a59c700 1 -- 172.21.15.117:0/3197945906 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c072130 con 0x7f612c071be0 2023-07-19T20:44:43.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.569+0000 7f612a59c700 1 --2- 172.21.15.117:0/3197945906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c071be0 0x7f612c1446a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6120009840 tx=0x7f6120009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142d3d35fb66a9f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:43.568 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.570+0000 7f6129d9b700 1 -- 172.21.15.117:0/3197945906 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120011830 con 0x7f612c071be0 2023-07-19T20:44:43.568 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.570+0000 7f6129d9b700 1 -- 172.21.15.117:0/3197945906 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6120011990 con 0x7f612c071be0 2023-07-19T20:44:43.568 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.570+0000 7f6129d9b700 1 -- 172.21.15.117:0/3197945906 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120011d20 con 0x7f612c071be0 2023-07-19T20:44:43.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.570+0000 7f61310c5700 1 -- 172.21.15.117:0/3197945906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c071be0 msgr2=0x7f612c1446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.570+0000 7f61310c5700 1 --2- 172.21.15.117:0/3197945906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c071be0 0x7f612c1446a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6120009840 tx=0x7f6120009b50 comp rx=0 tx=0).stop 2023-07-19T20:44:43.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.570+0000 7f61310c5700 1 -- 172.21.15.117:0/3197945906 shutdown_connections 2023-07-19T20:44:43.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.570+0000 7f61310c5700 1 --2- 172.21.15.117:0/3197945906 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f612c0bacb0 0x7f612c0702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.570+0000 7f61310c5700 1 --2- 172.21.15.117:0/3197945906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c071be0 0x7f612c1446a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.570+0000 7f61310c5700 1 -- 172.21.15.117:0/3197945906 >> 172.21.15.117:0/3197945906 conn(0x7f612c0be4b0 msgr2=0x7f612c0ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:43.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.570+0000 7f61310c5700 1 -- 172.21.15.117:0/3197945906 shutdown_connections 2023-07-19T20:44:43.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.570+0000 7f61310c5700 1 -- 172.21.15.117:0/3197945906 wait complete. 2023-07-19T20:44:43.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.572+0000 7f61310c5700 1 Processor -- start 2023-07-19T20:44:43.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.572+0000 7f61310c5700 1 -- start start 2023-07-19T20:44:43.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.572+0000 7f61310c5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c071be0 0x7f612c138e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.572+0000 7f61310c5700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f612c0bacb0 0x7f612c1e08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.571 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.572+0000 7f61310c5700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f612c144be0 0x7f612c13c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.571 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.572+0000 7f61310c5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c139390 con 0x7f612c071be0 2023-07-19T20:44:43.571 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.572+0000 7f61310c5700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c1e3f30 con 0x7f612c0bacb0 2023-07-19T20:44:43.571 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.572+0000 7f61310c5700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c1e0df0 con 0x7f612c144be0 2023-07-19T20:44:43.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.572+0000 7f612ad9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c071be0 0x7f612c138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.572+0000 7f612ad9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c071be0 0x7f612c138e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43486/0 (socket says 172.21.15.117:43486) 2023-07-19T20:44:43.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.572+0000 7f612ad9d700 1 -- 172.21.15.117:0/2955324454 learned_addr learned my addr 172.21.15.117:0/2955324454 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:43.573 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.572+0000 7f612b59e700 1 --2- 172.21.15.117:0/2955324454 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f612c144be0 0x7f612c13c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.573 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.572+0000 7f612a59c700 1 --2- 172.21.15.117:0/2955324454 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f612c0bacb0 0x7f612c1e08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.573 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.573+0000 7f612ad9d700 1 -- 172.21.15.117:0/2955324454 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f612c144be0 msgr2=0x7f612c13c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.573 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.573+0000 7f612ad9d700 1 --2- 172.21.15.117:0/2955324454 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f612c144be0 0x7f612c13c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.574 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.573+0000 7f612ad9d700 1 -- 172.21.15.117:0/2955324454 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f612c0bacb0 msgr2=0x7f612c1e08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.574 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.573+0000 7f612ad9d700 1 --2- 172.21.15.117:0/2955324454 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f612c0bacb0 0x7f612c1e08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.574 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.573+0000 7f612ad9d700 1 -- 172.21.15.117:0/2955324454 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61200094a0 con 0x7f612c071be0 2023-07-19T20:44:43.574 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.573+0000 7f612ad9d700 1 --2- 172.21.15.117:0/2955324454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c071be0 0x7f612c138e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f611c00e9b0 tx=0x7f611c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:43.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.573+0000 7f61137fe700 1 -- 172.21.15.117:0/2955324454 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c009710 con 0x7f612c071be0 2023-07-19T20:44:43.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.573+0000 7f61137fe700 1 -- 172.21.15.117:0/2955324454 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c00ee50 con 0x7f612c071be0 2023-07-19T20:44:43.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.573+0000 7f61137fe700 1 -- 172.21.15.117:0/2955324454 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c00ca50 con 0x7f612c071be0 2023-07-19T20:44:43.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.573+0000 7f61310c5700 1 -- 172.21.15.117:0/2955324454 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c1e41d0 con 0x7f612c071be0 2023-07-19T20:44:43.576 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.573+0000 7f61310c5700 1 -- 172.21.15.117:0/2955324454 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c13d2e0 con 0x7f612c071be0 2023-07-19T20:44:43.576 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.574+0000 7f61310c5700 1 -- 172.21.15.117:0/2955324454 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c067940 con 0x7f612c071be0 2023-07-19T20:44:43.576 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.574+0000 7f61137fe700 1 -- 172.21.15.117:0/2955324454 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f611c00cbb0 con 0x7f612c071be0 2023-07-19T20:44:43.576 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.575+0000 7f61137fe700 1 --2- 172.21.15.117:0/2955324454 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f611806a660 0x7f611806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.577 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.575+0000 7f61137fe700 1 -- 172.21.15.117:0/2955324454 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f611c088a00 con 0x7f612c071be0 2023-07-19T20:44:43.578 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.575+0000 7f612a59c700 1 --2- 172.21.15.117:0/2955324454 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f611806a660 0x7f611806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.578 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.575+0000 7f612a59c700 1 --2- 172.21.15.117:0/2955324454 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f611806a660 0x7f611806cb10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6120000c00 tx=0x7f6120008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:43.578 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.579+0000 7f61137fe700 1 -- 172.21.15.117:0/2955324454 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f611c057920 con 0x7f612c071be0 2023-07-19T20:44:43.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.770+0000 7f61310c5700 1 -- 172.21.15.117:0/2955324454 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f612c0b9d00 con 0x7f612c071be0 2023-07-19T20:44:43.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.771+0000 7f61137fe700 1 -- 172.21.15.117:0/2955324454 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17897 (secure 0 0 0) 0x7f611c00ce60 con 0x7f612c071be0 2023-07-19T20:44:43.765 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:43.766 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:39.549566+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:43.768 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.773+0000 7f61310c5700 1 -- 172.21.15.117:0/2955324454 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f611806a660 msgr2=0x7f611806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.768 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.773+0000 7f61310c5700 1 --2- 172.21.15.117:0/2955324454 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f611806a660 0x7f611806cb10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6120000c00 tx=0x7f6120008030 comp rx=0 tx=0).stop 2023-07-19T20:44:43.768 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.773+0000 7f61310c5700 1 -- 172.21.15.117:0/2955324454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c071be0 msgr2=0x7f612c138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.768 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.773+0000 7f61310c5700 1 --2- 172.21.15.117:0/2955324454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c071be0 0x7f612c138e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f611c00e9b0 tx=0x7f611c00ecc0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.768 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.773+0000 7f61310c5700 1 -- 172.21.15.117:0/2955324454 shutdown_connections 2023-07-19T20:44:43.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.773+0000 7f61310c5700 1 --2- 172.21.15.117:0/2955324454 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f611806a660 0x7f611806cb10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.773+0000 7f61310c5700 1 --2- 172.21.15.117:0/2955324454 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f612c144be0 0x7f612c13c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.773+0000 7f61310c5700 1 --2- 172.21.15.117:0/2955324454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f612c071be0 0x7f612c138e50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.773+0000 7f61310c5700 1 --2- 172.21.15.117:0/2955324454 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f612c0bacb0 0x7f612c1e08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.773+0000 7f61310c5700 1 -- 172.21.15.117:0/2955324454 >> 172.21.15.117:0/2955324454 conn(0x7f612c0be4b0 msgr2=0x7f612c143910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:43.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.773+0000 7f61310c5700 1 -- 172.21.15.117:0/2955324454 shutdown_connections 2023-07-19T20:44:43.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.773+0000 7f61310c5700 1 -- 172.21.15.117:0/2955324454 wait complete. 2023-07-19T20:44:43.780 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-19T20:44:43.780 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:43.901 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.907+0000 7f29cb9c9700 1 Processor -- start 2023-07-19T20:44:43.901 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.907+0000 7f29cb9c9700 1 -- start start 2023-07-19T20:44:43.902 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.908+0000 7f29cb9c9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29c41447e0 0x7f29c40b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.903 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.908+0000 7f29cb9c9700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29c406baf0 0x7f29c4070110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.903 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.908+0000 7f29cb9c9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c40b9770 con 0x7f29c406f560 2023-07-19T20:44:43.903 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.908+0000 7f29cb9c9700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c4070db0 con 0x7f29c406baf0 2023-07-19T20:44:43.903 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.908+0000 7f29cb9c9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c406b6a0 con 0x7f29c41447e0 2023-07-19T20:44:43.903 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.909+0000 7f29c8f64700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29c406baf0 0x7f29c4070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.903 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.909+0000 7f29c9f66700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f29c406f560 0x7f29c40b7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41238/0 (socket says 172.21.15.117:41238) 2023-07-19T20:44:43.904 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.909+0000 7f29c9f66700 1 -- 172.21.15.117:0/2962112779 learned_addr learned my addr 172.21.15.117:0/2962112779 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:43.904 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.909+0000 7f29c9765700 1 --2- 172.21.15.117:0/2962112779 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29c41447e0 0x7f29c40b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.904 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.909+0000 7f29c8f64700 1 -- 172.21.15.117:0/2962112779 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29c41447e0 msgr2=0x7f29c40b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:43.904 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.909+0000 7f29c8f64700 1 --2- 172.21.15.117:0/2962112779 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29c41447e0 0x7f29c40b9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.904 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.909+0000 7f29c8f64700 1 -- 172.21.15.117:0/2962112779 >> v1:172.21.15.117:6789/0 conn(0x7f29c406f560 legacy=0x7f29c40b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.904 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.909+0000 7f29c8f64700 1 -- 172.21.15.117:0/2962112779 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c40b8a70 con 0x7f29c406baf0 2023-07-19T20:44:43.904 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.909+0000 7f29bbfff700 1 -- 172.21.15.117:0/2962112779 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043157112 0 0) 0x7f29c40b9770 con 0x7f29c406f560 2023-07-19T20:44:43.905 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.909+0000 7f29c8f64700 1 --2- 172.21.15.117:0/2962112779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c406baf0 0x7f29c4070110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009840 tx=0x7f29b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78161f3b0861fb7a server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:43.905 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.909+0000 7f29bbfff700 1 -- 172.21.15.117:0/2962112779 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4011830 con 0x7f29c406baf0 2023-07-19T20:44:43.905 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.909+0000 7f29bbfff700 1 -- 172.21.15.117:0/2962112779 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4011990 con 0x7f29c406baf0 2023-07-19T20:44:43.905 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.909+0000 7f29bbfff700 1 -- 172.21.15.117:0/2962112779 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4011d20 con 0x7f29c406baf0 2023-07-19T20:44:43.907 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.910+0000 7f29cb9c9700 1 -- 172.21.15.117:0/2962112779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c406baf0 msgr2=0x7f29c4070110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.907 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.910+0000 7f29cb9c9700 1 --2- 172.21.15.117:0/2962112779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c406baf0 0x7f29c4070110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009840 tx=0x7f29b4009b50 comp rx=0 tx=0).stop 2023-07-19T20:44:43.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.910+0000 7f29cb9c9700 1 -- 172.21.15.117:0/2962112779 shutdown_connections 2023-07-19T20:44:43.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.910+0000 7f29cb9c9700 1 --2- 172.21.15.117:0/2962112779 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29c41447e0 0x7f29c40b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.910+0000 7f29cb9c9700 1 --2- 172.21.15.117:0/2962112779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c406baf0 0x7f29c4070110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.910+0000 7f29cb9c9700 1 -- 172.21.15.117:0/2962112779 >> 172.21.15.117:0/2962112779 conn(0x7f29c40bdc00 msgr2=0x7f29c40b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:43.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.910+0000 7f29cb9c9700 1 -- 172.21.15.117:0/2962112779 shutdown_connections 2023-07-19T20:44:43.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.910+0000 7f29cb9c9700 1 -- 172.21.15.117:0/2962112779 wait complete. 2023-07-19T20:44:43.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.911+0000 7f29cb9c9700 1 Processor -- start 2023-07-19T20:44:43.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.911+0000 7f29cb9c9700 1 -- start start 2023-07-19T20:44:43.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29cb9c9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29c406baf0 0x7f29c40b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29cb9c9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29c406f560 0x7f29c4136ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29cb9c9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c41447e0 0x7f29c4136750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29cb9c9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40b4700 con 0x7f29c41447e0 2023-07-19T20:44:43.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29cb9c9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4136c90 con 0x7f29c406baf0 2023-07-19T20:44:43.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29cb9c9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4142f40 con 0x7f29c406f560 2023-07-19T20:44:43.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29c9f66700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c41447e0 0x7f29c4136750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29c9f66700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c41447e0 0x7f29c4136750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43496/0 (socket says 172.21.15.117:43496) 2023-07-19T20:44:43.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29c9f66700 1 -- 172.21.15.117:0/3671075355 learned_addr learned my addr 172.21.15.117:0/3671075355 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:43.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29c9765700 1 --2- 172.21.15.117:0/3671075355 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29c406baf0 0x7f29c40b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29c8f64700 1 --2- 172.21.15.117:0/3671075355 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29c406f560 0x7f29c4136ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29c9f66700 1 -- 172.21.15.117:0/3671075355 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29c406f560 msgr2=0x7f29c4136ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29c9f66700 1 --2- 172.21.15.117:0/3671075355 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29c406f560 0x7f29c4136ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29c9f66700 1 -- 172.21.15.117:0/3671075355 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29c406baf0 msgr2=0x7f29c40b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:43.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29c9f66700 1 --2- 172.21.15.117:0/3671075355 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29c406baf0 0x7f29c40b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:43.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.912+0000 7f29c9f66700 1 -- 172.21.15.117:0/3671075355 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40094a0 con 0x7f29c41447e0 2023-07-19T20:44:43.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.913+0000 7f29c9f66700 1 --2- 172.21.15.117:0/3671075355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c41447e0 0x7f29c4136750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00cc70 tx=0x7f29bc00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:43.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.913+0000 7f29b9ffb700 1 -- 172.21.15.117:0/3671075355 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00ab70 con 0x7f29c41447e0 2023-07-19T20:44:43.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.913+0000 7f29b9ffb700 1 -- 172.21.15.117:0/3671075355 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc00acf0 con 0x7f29c41447e0 2023-07-19T20:44:43.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.913+0000 7f29cb9c9700 1 -- 172.21.15.117:0/3671075355 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c41431e0 con 0x7f29c41447e0 2023-07-19T20:44:43.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.913+0000 7f29b9ffb700 1 -- 172.21.15.117:0/3671075355 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc007310 con 0x7f29c41447e0 2023-07-19T20:44:43.912 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.913+0000 7f29cb9c9700 1 -- 172.21.15.117:0/3671075355 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c40b4340 con 0x7f29c41447e0 2023-07-19T20:44:43.912 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.914+0000 7f29cb9c9700 1 -- 172.21.15.117:0/3671075355 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c4137540 con 0x7f29c41447e0 2023-07-19T20:44:43.912 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.914+0000 7f29b9ffb700 1 -- 172.21.15.117:0/3671075355 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f29bc007470 con 0x7f29c41447e0 2023-07-19T20:44:43.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.915+0000 7f29b9ffb700 1 --2- 172.21.15.117:0/3671075355 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f29a806a660 0x7f29a806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:43.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.915+0000 7f29b9ffb700 1 -- 172.21.15.117:0/3671075355 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29bc0884e0 con 0x7f29c41447e0 2023-07-19T20:44:43.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.915+0000 7f29c9765700 1 --2- 172.21.15.117:0/3671075355 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f29a806a660 0x7f29a806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:43.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.915+0000 7f29c9765700 1 --2- 172.21.15.117:0/3671075355 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f29a806a660 0x7f29a806cb10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29c0006fd0 tx=0x7f29c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:43.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:43.919+0000 7f29b9ffb700 1 -- 172.21.15.117:0/3671075355 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f29c4137540 con 0x7f29c41447e0 2023-07-19T20:44:44.098 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.104+0000 7f29cb9c9700 1 -- 172.21.15.117:0/3671075355 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29c4137540 con 0x7f29c41447e0 2023-07-19T20:44:44.099 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.106+0000 7f29b9ffb700 1 -- 172.21.15.117:0/3671075355 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17897 (secure 0 0 0) 0x7f29c4137540 con 0x7f29c41447e0 2023-07-19T20:44:44.100 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:44.100 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:39.549566+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:44.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.108+0000 7f29cb9c9700 1 -- 172.21.15.117:0/3671075355 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f29a806a660 msgr2=0x7f29a806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.108+0000 7f29cb9c9700 1 --2- 172.21.15.117:0/3671075355 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f29a806a660 0x7f29a806cb10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29c0006fd0 tx=0x7f29c0008040 comp rx=0 tx=0).stop 2023-07-19T20:44:44.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.108+0000 7f29cb9c9700 1 -- 172.21.15.117:0/3671075355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c41447e0 msgr2=0x7f29c4136750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.108+0000 7f29cb9c9700 1 --2- 172.21.15.117:0/3671075355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c41447e0 0x7f29c4136750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00cc70 tx=0x7f29bc00cf80 comp rx=0 tx=0).stop 2023-07-19T20:44:44.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.108+0000 7f29cb9c9700 1 -- 172.21.15.117:0/3671075355 shutdown_connections 2023-07-19T20:44:44.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.108+0000 7f29cb9c9700 1 --2- 172.21.15.117:0/3671075355 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f29a806a660 0x7f29a806cb10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.108+0000 7f29cb9c9700 1 --2- 172.21.15.117:0/3671075355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c41447e0 0x7f29c4136750 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.108+0000 7f29cb9c9700 1 --2- 172.21.15.117:0/3671075355 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29c406baf0 0x7f29c40b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.108+0000 7f29cb9c9700 1 --2- 172.21.15.117:0/3671075355 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29c406f560 0x7f29c4136ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.108+0000 7f29cb9c9700 1 -- 172.21.15.117:0/3671075355 >> 172.21.15.117:0/3671075355 conn(0x7f29c40bdc00 msgr2=0x7f29c40b9020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.108+0000 7f29cb9c9700 1 -- 172.21.15.117:0/3671075355 shutdown_connections 2023-07-19T20:44:44.104 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.108+0000 7f29cb9c9700 1 -- 172.21.15.117:0/3671075355 wait complete. 2023-07-19T20:44:44.116 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-19T20:44:44.117 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-19T20:44:44.118 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-19T20:44:44.120 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-19T20:44:44.120 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-19T20:44:44.121 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-19T20:44:44.121 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-19T20:44:44.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-19T20:44:44.232 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:44:44.267 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:44:44.268 INFO:tasks.ceph.mds.c.smithi117.stderr:2023-07-19T20:44:44.268+0000 7f8823f97700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-19T20:44:44.270 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:44:44.338 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.341+0000 7fc1f811f700 1 Processor -- start 2023-07-19T20:44:44.338 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.341+0000 7fc1f811f700 1 -- start start 2023-07-19T20:44:44.338 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.342+0000 7fc1f811f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc1f0140950 0x7fc1f00b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.342+0000 7fc1f811f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc1f0140da0 0x7fc1f0151260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.342+0000 7fc1f811f700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f014a800 con 0x7fc1f00b3de0 2023-07-19T20:44:44.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.342+0000 7fc1f811f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f00b7800 con 0x7fc1f0140950 2023-07-19T20:44:44.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.342+0000 7fc1f811f700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0149ed0 con 0x7fc1f0140da0 2023-07-19T20:44:44.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.342+0000 7fc1f56ba700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc1f0140950 0x7fc1f00b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.342+0000 7fc1f56ba700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc1f0140950 0x7fc1f00b4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:57994/0 (socket says 172.21.15.117:57994) 2023-07-19T20:44:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.342+0000 7fc1f56ba700 1 -- 172.21.15.117:0/822003941 learned_addr learned my addr 172.21.15.117:0/822003941 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.342+0000 7fc1f66bc700 1 --2- 172.21.15.117:0/822003941 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc1f0140da0 0x7fc1f0151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.343+0000 7fc1f66bc700 1 -- 172.21.15.117:0/822003941 >> v2:172.21.15.124:3300/0 conn(0x7fc1f0140950 msgr2=0x7fc1f00b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.343+0000 7fc1f66bc700 1 --2- 172.21.15.117:0/822003941 >> v2:172.21.15.124:3300/0 conn(0x7fc1f0140950 0x7fc1f00b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.343+0000 7fc1f66bc700 1 -- 172.21.15.117:0/822003941 >> v1:172.21.15.124:6789/0 conn(0x7fc1f00b3de0 legacy=0x7fc1f00b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.343+0000 7fc1f66bc700 1 -- 172.21.15.117:0/822003941 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f014a1b0 con 0x7fc1f0140da0 2023-07-19T20:44:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.343+0000 7fc1f66bc700 1 --2- 172.21.15.117:0/822003941 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc1f0140da0 0x7fc1f0151260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009b10 tx=0x7fc1e800b050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72f9e0bb9a3ca6e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.343+0000 7f4351ee9700 1 Processor -- start 2023-07-19T20:44:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.343+0000 7f4351ee9700 1 -- start start 2023-07-19T20:44:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.344+0000 7f4351ee9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f434c0b53c0 0x7f434c0b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.344+0000 7f4351ee9700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f434c0b4990 0x7f434c0b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.344+0000 7f4351ee9700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434c14a440 con 0x7f434c14af20 2023-07-19T20:44:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.344+0000 7f4351ee9700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434c0b5ff0 con 0x7f434c0b4990 2023-07-19T20:44:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.344+0000 7f4351ee9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434c14a230 con 0x7f434c0b53c0 2023-07-19T20:44:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.344+0000 7f434b7fe700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f434c0b53c0 0x7f434c0b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.344+0000 7f434b7fe700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f434c0b53c0 0x7f434c0b5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:39542/0 (socket says 172.21.15.117:39542) 2023-07-19T20:44:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.344+0000 7f434b7fe700 1 -- 172.21.15.117:0/2998964356 learned_addr learned my addr 172.21.15.117:0/2998964356 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.343 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.344+0000 7f434b7fe700 1 -- 172.21.15.117:0/2998964356 >> v2:172.21.15.117:3300/0 conn(0x7f434c0b4990 msgr2=0x7f434c0b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.343 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.344+0000 7f434b7fe700 1 --2- 172.21.15.117:0/2998964356 >> v2:172.21.15.117:3300/0 conn(0x7f434c0b4990 0x7f434c0b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.343 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.344+0000 7f434b7fe700 1 -- 172.21.15.117:0/2998964356 >> v1:172.21.15.124:6789/0 conn(0x7f434c14af20 legacy=0x7f434c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.343 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.344+0000 7f434b7fe700 1 -- 172.21.15.117:0/2998964356 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c14a720 con 0x7f434c0b53c0 2023-07-19T20:44:44.343 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.338+0000 7fb810898700 1 Processor -- start 2023-07-19T20:44:44.344 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.339+0000 7fb810898700 1 -- start start 2023-07-19T20:44:44.344 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.339+0000 7fb810898700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb80c08a0c0 0x7fb80c09bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.344 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.340+0000 7fb810898700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80c157aa0 con 0x7fb80c157f30 2023-07-19T20:44:44.344 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.340+0000 7fb810898700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80c09f2a0 con 0x7fb80c1583b0 2023-07-19T20:44:44.344 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.340+0000 7fb810898700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80c0bbe40 con 0x7fb80c08a0c0 2023-07-19T20:44:44.344 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.341+0000 7fb809d9b700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb80c157f30 0x7fb80c09eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41248/0 (socket says 172.21.15.117:41248) 2023-07-19T20:44:44.344 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.341+0000 7fb809d9b700 1 -- 172.21.15.117:0/3774713408 learned_addr learned my addr 172.21.15.117:0/3774713408 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:44.345 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.341+0000 7fb80a59c700 1 --2- 172.21.15.117:0/3774713408 >> v2:172.21.15.117:3300/0 conn(0x7fb80c08a0c0 0x7fb80c09bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.345 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.341+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352025114 0 0) 0x7fb80c157aa0 con 0x7fb80c157f30 2023-07-19T20:44:44.345 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7f434b7fe700 1 --2- 172.21.15.117:0/2998964356 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f434c0b53c0 0x7f434c0b5790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f433c00bb90 tx=0x7f433c00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=813328448667015f server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.345 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7f4003a00 con 0x7fb80c157f30 2023-07-19T20:44:44.346 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795488279 0 0) 0x7fb80c09f2a0 con 0x7fb80c1583b0 2023-07-19T20:44:44.346 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb80c157aa0 con 0x7fb80c1583b0 2023-07-19T20:44:44.346 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7f434a7fc700 1 -- 172.21.15.117:0/2998964356 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c00dc00 con 0x7f434c0b53c0 2023-07-19T20:44:44.346 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7f434a7fc700 1 -- 172.21.15.117:0/2998964356 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c00dd60 con 0x7f434c0b53c0 2023-07-19T20:44:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7f434a7fc700 1 -- 172.21.15.117:0/2998964356 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c004270 con 0x7f434c0b53c0 2023-07-19T20:44:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 <== mon.1 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 288946792 0 0) 0x7fb80c157aa0 con 0x7fb80c1583b0 2023-07-19T20:44:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 >> v2:172.21.15.117:3300/0 conn(0x7fb80c08a0c0 msgr2=0x7fb80c09bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 --2- 172.21.15.117:0/3774713408 >> v2:172.21.15.117:3300/0 conn(0x7fb80c08a0c0 0x7fb80c09bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 >> v1:172.21.15.117:6789/0 conn(0x7fb80c157f30 legacy=0x7fb80c09eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c0bc0e0 con 0x7fb80c1583b0 2023-07-19T20:44:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 <== mon.1 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7fb8040019f0 con 0x7fb80c1583b0 2023-07-19T20:44:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 >> v1:172.21.15.124:6789/0 conn(0x7fb80c1583b0 legacy=0x7fb80c161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 --2- 172.21.15.117:0/3774713408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7f40058d0 0x7fb7f4003c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 --2- 172.21.15.117:0/3774713408 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb7f4004180 0x7fb7f40045f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 --2- 172.21.15.117:0/3774713408 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7f4009e50 0x7fb7f400c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc001230 con 0x7fb7f40058d0 2023-07-19T20:44:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0bbe40 con 0x7fb7f4009e50 2023-07-19T20:44:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40050f0 con 0x7fb7f4004180 2023-07-19T20:44:44.349 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb809d9b700 1 --2- 172.21.15.117:0/3774713408 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb7f4004180 0x7fb7f40045f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.349 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80ad9d700 1 --2- 172.21.15.117:0/3774713408 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7f4009e50 0x7fb7f400c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.349 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.345+0000 7fb80a59c700 1 --2- 172.21.15.117:0/3774713408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7f40058d0 0x7fb7f4003c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.349 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7f4351ee9700 1 -- 172.21.15.117:0/2998964356 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f434c0b53c0 msgr2=0x7f434c0b5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.349 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7f4351ee9700 1 --2- 172.21.15.117:0/2998964356 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f434c0b53c0 0x7f434c0b5790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f433c00bb90 tx=0x7f433c00bea0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.350 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7fb80ad9d700 1 -- 172.21.15.117:0/3774713408 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb7f4004180 msgr2=0x7fb7f40045f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.350 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7fb80ad9d700 1 --2- 172.21.15.117:0/3774713408 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb7f4004180 0x7fb7f40045f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.350 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7fb80ad9d700 1 -- 172.21.15.117:0/3774713408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7f40058d0 msgr2=0x7fb7f4003c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.350 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7fb80ad9d700 1 --2- 172.21.15.117:0/3774713408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7f40058d0 0x7fb7f4003c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.350 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7fb80ad9d700 1 -- 172.21.15.117:0/3774713408 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c157aa0 con 0x7fb7f4009e50 2023-07-19T20:44:44.351 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7fb80ad9d700 1 -- 172.21.15.117:0/3774713408 reap_dead start 2023-07-19T20:44:44.351 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7f4351ee9700 1 -- 172.21.15.117:0/2998964356 shutdown_connections 2023-07-19T20:44:44.351 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7f4351ee9700 1 --2- 172.21.15.117:0/2998964356 >> v2:172.21.15.117:3300/0 conn(0x7f434c0b4990 0x7f434c0b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.351 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7f4351ee9700 1 --2- 172.21.15.117:0/2998964356 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f434c0b53c0 0x7f434c0b5790 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.352 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7f4351ee9700 1 -- 172.21.15.117:0/2998964356 >> 172.21.15.117:0/2998964356 conn(0x7f434c06b1f0 msgr2=0x7f434c0bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.352 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7f4351ee9700 1 -- 172.21.15.117:0/2998964356 shutdown_connections 2023-07-19T20:44:44.352 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7fc1f4eb9700 1 -- 172.21.15.117:0/822003941 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8003c20 con 0x7fc1f0140da0 2023-07-19T20:44:44.352 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7fc1f4eb9700 1 -- 172.21.15.117:0/822003941 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e8003d80 con 0x7fc1f0140da0 2023-07-19T20:44:44.352 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7fc1f4eb9700 1 -- 172.21.15.117:0/822003941 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8010870 con 0x7fc1f0140da0 2023-07-19T20:44:44.353 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7fb80ad9d700 1 --2- 172.21.15.117:0/3774713408 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7f4009e50 0x7fb7f400c230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb80400a7d0 tx=0x7fb7f4005cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=260508be90eeacdd server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.353 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb804012620 con 0x7fb7f4009e50 2023-07-19T20:44:44.353 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb804012780 con 0x7fb7f4009e50 2023-07-19T20:44:44.353 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7fb80959a700 1 -- 172.21.15.117:0/3774713408 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb804012b30 con 0x7fb7f4009e50 2023-07-19T20:44:44.354 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.347+0000 7fc1f811f700 1 -- 172.21.15.117:0/822003941 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc1f0140da0 msgr2=0x7fc1f0151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.354 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.347+0000 7fc1f811f700 1 --2- 172.21.15.117:0/822003941 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc1f0140da0 0x7fc1f0151260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009b10 tx=0x7fc1e800b050 comp rx=0 tx=0).stop 2023-07-19T20:44:44.354 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.347+0000 7fc1f811f700 1 -- 172.21.15.117:0/822003941 shutdown_connections 2023-07-19T20:44:44.354 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.347+0000 7fc1f811f700 1 --2- 172.21.15.117:0/822003941 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc1f0140da0 0x7fc1f0151260 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.347+0000 7fc1f811f700 1 --2- 172.21.15.117:0/822003941 >> v2:172.21.15.124:3300/0 conn(0x7fc1f0140950 0x7fc1f00b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.347+0000 7fc1f811f700 1 -- 172.21.15.117:0/822003941 >> 172.21.15.117:0/822003941 conn(0x7fc1f006b1f0 msgr2=0x7fc1f00bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.346+0000 7f4351ee9700 1 -- 172.21.15.117:0/2998964356 wait complete. 2023-07-19T20:44:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.347+0000 7f4351ee9700 1 Processor -- start 2023-07-19T20:44:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.347+0000 7fb810898700 1 -- 172.21.15.117:0/3774713408 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7f4009e50 msgr2=0x7fb7f400c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.347+0000 7fb810898700 1 --2- 172.21.15.117:0/3774713408 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7f4009e50 0x7fb7f400c230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb80400a7d0 tx=0x7fb7f4005cd0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.348+0000 7fc1f811f700 1 -- 172.21.15.117:0/822003941 shutdown_connections 2023-07-19T20:44:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.348+0000 7fb810898700 1 -- 172.21.15.117:0/3774713408 shutdown_connections 2023-07-19T20:44:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.348+0000 7fb810898700 1 --2- 172.21.15.117:0/3774713408 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7f4009e50 0x7fb7f400c230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.348+0000 7fb810898700 1 -- 172.21.15.117:0/3774713408 >> 172.21.15.117:0/3774713408 conn(0x7fb80c06b160 msgr2=0x7fb80c09e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.348+0000 7f4351ee9700 1 -- start start 2023-07-19T20:44:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f4351ee9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f434c0b4990 0x7f434c070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f4351ee9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f434c0b53c0 0x7f434c1d4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f4351ee9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f434c14af20 0x7f434c1e2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f4351ee9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c071220 con 0x7f434c0b4990 2023-07-19T20:44:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f4351ee9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c1d2b30 con 0x7f434c0b53c0 2023-07-19T20:44:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f4351ee9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434c1d4680 con 0x7f434c14af20 2023-07-19T20:44:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f434affd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f434c0b53c0 0x7f434c1d4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f434affd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f434c0b53c0 0x7f434c1d4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58018/0 (socket says 172.21.15.117:58018) 2023-07-19T20:44:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f434affd700 1 -- 172.21.15.117:0/2576946808 learned_addr learned my addr 172.21.15.117:0/2576946808 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.359 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f434bfff700 1 --2- 172.21.15.117:0/2576946808 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f434c14af20 0x7f434c1e2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.359 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f434affd700 1 -- 172.21.15.117:0/2576946808 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f434c14af20 msgr2=0x7f434c1e2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.359 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f434affd700 1 --2- 172.21.15.117:0/2576946808 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f434c14af20 0x7f434c1e2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.359 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f434affd700 1 -- 172.21.15.117:0/2576946808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f434c0b4990 msgr2=0x7f434c070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.359 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f434affd700 1 --2- 172.21.15.117:0/2576946808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f434c0b4990 0x7f434c070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.359 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f434affd700 1 -- 172.21.15.117:0/2576946808 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c00b7f0 con 0x7f434c0b53c0 2023-07-19T20:44:44.360 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7fb810898700 1 -- 172.21.15.117:0/3774713408 shutdown_connections 2023-07-19T20:44:44.360 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7f434affd700 1 --2- 172.21.15.117:0/2576946808 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f434c0b53c0 0x7f434c1d4140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f434400b9f0 tx=0x7f434400bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.360 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.349+0000 7fb810898700 1 -- 172.21.15.117:0/3774713408 wait complete. 2023-07-19T20:44:44.361 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.348+0000 7fc1f811f700 1 -- 172.21.15.117:0/822003941 wait complete. 2023-07-19T20:44:44.361 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.350+0000 7fc1f811f700 1 Processor -- start 2023-07-19T20:44:44.361 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.351+0000 7faa2186b700 1 Processor -- start 2023-07-19T20:44:44.361 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.351+0000 7f702618d700 1 Processor -- start 2023-07-19T20:44:44.362 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.351+0000 7faa2186b700 1 -- start start 2023-07-19T20:44:44.362 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.351+0000 7fb810898700 1 Processor -- start 2023-07-19T20:44:44.362 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.351+0000 7fb810898700 1 -- start start 2023-07-19T20:44:44.363 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.350+0000 7fc1f811f700 1 -- start start 2023-07-19T20:44:44.363 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.351+0000 7fc1f811f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc1f00b3de0 0x7fc1f01e7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.363 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.351+0000 7fc1f811f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1f0140950 0x7fc1f00b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.363 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.351+0000 7fc1f811f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1f0140da0 0x7fc1f00baca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.363 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.351+0000 7fc1f811f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00bb1e0 con 0x7fc1f0140950 2023-07-19T20:44:44.364 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.351+0000 7fc1f811f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0072020 con 0x7fc1f0140da0 2023-07-19T20:44:44.364 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.351+0000 7fc1f811f700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00bb750 con 0x7fc1f00b3de0 2023-07-19T20:44:44.364 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fc1f5ebb700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc1f00b3de0 0x7fc1f01e7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.364 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fc1f56ba700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1f0140950 0x7fc1f00b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.364 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fc1f56ba700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1f0140950 0x7fc1f00b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43554/0 (socket says 172.21.15.117:43554) 2023-07-19T20:44:44.364 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fc1f56ba700 1 -- 172.21.15.117:0/2520461711 learned_addr learned my addr 172.21.15.117:0/2520461711 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.364 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fc1f66bc700 1 --2- 172.21.15.117:0/2520461711 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1f0140da0 0x7fc1f00baca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.365 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7faa2186b700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa1c0c0110 0x7faa1c0be920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.365 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7faa2186b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1c0c0f70 con 0x7faa1c1532d0 2023-07-19T20:44:44.365 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7faa2186b700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1c0c1400 con 0x7faa1c0c04e0 2023-07-19T20:44:44.365 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7faa2186b700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0bbdc0 con 0x7faa1c0c0110 2023-07-19T20:44:44.365 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7faa1affd700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa1c0c0110 0x7faa1c0be920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.366 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7faa1a7fc700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7faa1c0c04e0 0x7faa1c14a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.117:34364/0 (socket says 172.21.15.117:34364) 2023-07-19T20:44:44.366 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7faa1a7fc700 1 -- 172.21.15.117:0/784051353 learned_addr learned my addr 172.21.15.117:0/784051353 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:44.366 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fc1f66bc700 1 -- 172.21.15.117:0/2520461711 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc1f00b3de0 msgr2=0x7fc1f01e7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.366 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fc1f66bc700 1 --2- 172.21.15.117:0/2520461711 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc1f00b3de0 0x7fc1f01e7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.366 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fc1f66bc700 1 -- 172.21.15.117:0/2520461711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1f0140950 msgr2=0x7fc1f00b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.366 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fc1f66bc700 1 --2- 172.21.15.117:0/2520461711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1f0140950 0x7fc1f00b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fc1f66bc700 1 -- 172.21.15.117:0/2520461711 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e8009770 con 0x7fc1f0140da0 2023-07-19T20:44:44.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fc1f66bc700 1 --2- 172.21.15.117:0/2520461711 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1f0140da0 0x7fc1f00baca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8018000 tx=0x7fc1e8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fc1e67fc700 1 -- 172.21.15.117:0/2520461711 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8004030 con 0x7fc1f0140da0 2023-07-19T20:44:44.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fc1e67fc700 1 -- 172.21.15.117:0/2520461711 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e8004190 con 0x7fc1f0140da0 2023-07-19T20:44:44.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fc1e67fc700 1 -- 172.21.15.117:0/2520461711 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8004340 con 0x7fc1f0140da0 2023-07-19T20:44:44.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fc1f5ebb700 1 --2- 172.21.15.117:0/2520461711 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc1f00b3de0 0x7fc1f01e7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:44.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fc1f811f700 1 -- 172.21.15.117:0/2520461711 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f0145770 con 0x7fc1f0140da0 2023-07-19T20:44:44.368 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fc1f811f700 1 -- 172.21.15.117:0/2520461711 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f00b2ca0 con 0x7fc1f0140da0 2023-07-19T20:44:44.368 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7fc1f811f700 1 -- 172.21.15.117:0/2520461711 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1f00b6850 con 0x7fc1f0140da0 2023-07-19T20:44:44.368 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7f1134f40700 1 Processor -- start 2023-07-19T20:44:44.368 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7f1134f40700 1 -- start start 2023-07-19T20:44:44.368 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f1134f40700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11301447e0 0x7f11300b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.369 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f1134f40700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f113006baf0 0x7f1130070110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.369 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f1134f40700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f113006f560 0x7f11300b7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.369 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f1134f40700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1130070db0 con 0x7f113006f560 2023-07-19T20:44:44.369 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f1134f40700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113006b6a0 con 0x7f113006baf0 2023-07-19T20:44:44.369 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f1134f40700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11300b9770 con 0x7f11301447e0 2023-07-19T20:44:44.369 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f112dd9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f113006baf0 0x7f1130070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.369 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f112dd9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f113006baf0 0x7f1130070110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58046/0 (socket says 172.21.15.117:58046) 2023-07-19T20:44:44.369 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f112dd9b700 1 -- 172.21.15.117:0/3418747533 learned_addr learned my addr 172.21.15.117:0/3418747533 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.370 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.351+0000 7f4333fff700 1 -- 172.21.15.117:0/2576946808 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434400ca30 con 0x7f434c0b53c0 2023-07-19T20:44:44.370 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.351+0000 7f4333fff700 1 -- 172.21.15.117:0/2576946808 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434400cb90 con 0x7f434c0b53c0 2023-07-19T20:44:44.370 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.351+0000 7f4333fff700 1 -- 172.21.15.117:0/2576946808 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344014440 con 0x7f434c0b53c0 2023-07-19T20:44:44.370 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7f4351ee9700 1 -- 172.21.15.117:0/2576946808 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434c071700 con 0x7f434c0b53c0 2023-07-19T20:44:44.370 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7f4351ee9700 1 -- 172.21.15.117:0/2576946808 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434c0b3770 con 0x7f434c0b53c0 2023-07-19T20:44:44.370 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7f4351ee9700 1 -- 172.21.15.117:0/2576946808 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f434c14aa00 con 0x7f434c0b53c0 2023-07-19T20:44:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fb810898700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb7f4009e50 0x7fb80c1f8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fb810898700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb80c1f91d0 0x7fb80c0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fb810898700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb80c0b2250 0x7fb80c0b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fb810898700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c1f99d0 con 0x7fb80c1f91d0 2023-07-19T20:44:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fb810898700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c071770 con 0x7fb80c0b2250 2023-07-19T20:44:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fb810898700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c1f96f0 con 0x7fb7f4009e50 2023-07-19T20:44:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fb80a59c700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb7f4009e50 0x7fb80c1f8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fb80a59c700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb7f4009e50 0x7fb80c1f8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:39572/0 (socket says 172.21.15.117:39572) 2023-07-19T20:44:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fb80a59c700 1 -- 172.21.15.117:0/2769606857 learned_addr learned my addr 172.21.15.117:0/2769606857 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fb809d9b700 1 --2- 172.21.15.117:0/2769606857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb80c1f91d0 0x7fb80c0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fb809d9b700 1 -- 172.21.15.117:0/2769606857 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb7f4009e50 msgr2=0x7fb80c1f8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fb809d9b700 1 --2- 172.21.15.117:0/2769606857 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb7f4009e50 0x7fb80c1f8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fb809d9b700 1 -- 172.21.15.117:0/2769606857 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb80c0b2250 msgr2=0x7fb80c0b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fb809d9b700 1 --2- 172.21.15.117:0/2769606857 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb80c0b2250 0x7fb80c0b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fb809d9b700 1 -- 172.21.15.117:0/2769606857 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c071a10 con 0x7fb80c1f91d0 2023-07-19T20:44:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7fb809d9b700 1 --2- 172.21.15.117:0/2769606857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb80c1f91d0 0x7fb80c0b5e60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb80c069400 tx=0x7fb7fc007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7fb7faffd700 1 -- 172.21.15.117:0/2769606857 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc00f590 con 0x7fb80c1f91d0 2023-07-19T20:44:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7fb7faffd700 1 -- 172.21.15.117:0/2769606857 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc00f6f0 con 0x7fb80c1f91d0 2023-07-19T20:44:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7fb7faffd700 1 -- 172.21.15.117:0/2769606857 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc00fa80 con 0x7fb80c1f91d0 2023-07-19T20:44:44.374 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7faa1affd700 1 -- 172.21.15.117:0/784051353 >> v1:172.21.15.124:6789/0 conn(0x7faa1c0c04e0 legacy=0x7faa1c14a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.374 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7faa1affd700 1 -- 172.21.15.117:0/784051353 >> v1:172.21.15.117:6789/0 conn(0x7faa1c1532d0 legacy=0x7faa1c1556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.374 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7faa1affd700 1 -- 172.21.15.117:0/784051353 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c06b470 con 0x7faa1c0c0110 2023-07-19T20:44:44.374 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7faa1affd700 1 --2- 172.21.15.117:0/784051353 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa1c0c0110 0x7faa1c0be920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faa14009dc0 tx=0x7faa1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c16c1db03c8e1d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.374 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7fc1e67fc700 1 -- 172.21.15.117:0/2520461711 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fc1e8045b80 con 0x7fc1f0140da0 2023-07-19T20:44:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fea5d6c8700 1 Processor -- start 2023-07-19T20:44:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.352+0000 7fea5d6c8700 1 -- start start 2023-07-19T20:44:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fea5d6c8700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea58072990 0x7fea580b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fea5d6c8700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fea580b8da0 0x7fea58159590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fea5d6c8700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea580b7630 con 0x7fea58149220 2023-07-19T20:44:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fea5d6c8700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea580b8310 con 0x7fea580b8da0 2023-07-19T20:44:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.353+0000 7fea5d6c8700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea580bd590 con 0x7fea58072990 2023-07-19T20:44:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7fea577fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fea580b8da0 0x7fea58159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7fea577fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fea580b8da0 0x7fea58159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58044/0 (socket says 172.21.15.117:58044) 2023-07-19T20:44:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7fea577fe700 1 -- 172.21.15.117:0/3577420219 learned_addr learned my addr 172.21.15.117:0/3577420219 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7fea567fc700 1 --2- 172.21.15.117:0/3577420219 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea58072990 0x7fea580b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7fea577fe700 1 -- 172.21.15.117:0/3577420219 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea58072990 msgr2=0x7fea580b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7fea577fe700 1 --2- 172.21.15.117:0/3577420219 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea58072990 0x7fea580b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7fea577fe700 1 -- 172.21.15.117:0/3577420219 >> v1:172.21.15.117:6789/0 conn(0x7fea58149220 legacy=0x7fea580bce80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-19T20:44:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7fea577fe700 1 -- 172.21.15.117:0/3577420219 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea581523a0 con 0x7fea580b8da0 2023-07-19T20:44:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7fb810898700 1 -- 172.21.15.117:0/2769606857 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80c071320 con 0x7fb80c1f91d0 2023-07-19T20:44:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7fb810898700 1 -- 172.21.15.117:0/2769606857 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80c06fbb0 con 0x7fb80c1f91d0 2023-07-19T20:44:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7fb810898700 1 -- 172.21.15.117:0/2769606857 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb80c0b8330 con 0x7fb80c1f91d0 2023-07-19T20:44:44.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f112e59c700 1 --2- 172.21.15.117:0/3418747533 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11301447e0 0x7f11300b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f112ed9d700 1 --2- 172.21.15.117:0/3418747533 >> v2:172.21.15.117:3300/0 conn(0x7f113006f560 0x7f11300b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f112e59c700 1 -- 172.21.15.117:0/3418747533 >> v2:172.21.15.124:3300/0 conn(0x7f113006baf0 msgr2=0x7f1130070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f112e59c700 1 --2- 172.21.15.117:0/3418747533 >> v2:172.21.15.124:3300/0 conn(0x7f113006baf0 0x7f1130070110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f112e59c700 1 -- 172.21.15.117:0/3418747533 >> v2:172.21.15.117:3300/0 conn(0x7f113006f560 msgr2=0x7f11300b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f112e59c700 1 --2- 172.21.15.117:0/3418747533 >> v2:172.21.15.117:3300/0 conn(0x7f113006f560 0x7f11300b7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.354+0000 7f112e59c700 1 -- 172.21.15.117:0/3418747533 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11300b8a70 con 0x7f11301447e0 2023-07-19T20:44:44.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7f112e59c700 1 --2- 172.21.15.117:0/3418747533 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11301447e0 0x7f11300b9230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1130066c00 tx=0x7f112400fc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b6e3a01b58de37f server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7f112d59a700 1 -- 172.21.15.117:0/3418747533 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124009b00 con 0x7f11301447e0 2023-07-19T20:44:44.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7f112d59a700 1 -- 172.21.15.117:0/3418747533 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1124009c60 con 0x7f11301447e0 2023-07-19T20:44:44.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7f112d59a700 1 -- 172.21.15.117:0/3418747533 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124018850 con 0x7f11301447e0 2023-07-19T20:44:44.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7f112ed9d700 1 --2- 172.21.15.117:0/3418747533 >> v2:172.21.15.117:3300/0 conn(0x7f113006f560 0x7f11300b7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:44.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7fea577fe700 1 --2- 172.21.15.117:0/3577420219 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea580b8da0 0x7fea58159590 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fea50009e80 tx=0x7fea5000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74fb9926101a7739 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7fea55ffb700 1 -- 172.21.15.117:0/3577420219 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5000e070 con 0x7fea580b8da0 2023-07-19T20:44:44.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7fea55ffb700 1 -- 172.21.15.117:0/3577420219 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea50003a20 con 0x7fea580b8da0 2023-07-19T20:44:44.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7fea55ffb700 1 -- 172.21.15.117:0/3577420219 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50003dd0 con 0x7fea580b8da0 2023-07-19T20:44:44.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7faa19ffb700 1 -- 172.21.15.117:0/784051353 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1400e070 con 0x7faa1c0c0110 2023-07-19T20:44:44.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7faa19ffb700 1 -- 172.21.15.117:0/784051353 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa14003a20 con 0x7faa1c0c0110 2023-07-19T20:44:44.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7faa19ffb700 1 -- 172.21.15.117:0/784051353 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14003db0 con 0x7faa1c0c0110 2023-07-19T20:44:44.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7faa2186b700 1 -- 172.21.15.117:0/784051353 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa1c0c0110 msgr2=0x7faa1c0be920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7faa2186b700 1 --2- 172.21.15.117:0/784051353 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa1c0c0110 0x7faa1c0be920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faa14009dc0 tx=0x7faa1400b330 comp rx=0 tx=0).stop 2023-07-19T20:44:44.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7faa2186b700 1 -- 172.21.15.117:0/784051353 shutdown_connections 2023-07-19T20:44:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7faa2186b700 1 --2- 172.21.15.117:0/784051353 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa1c0c0110 0x7faa1c0be920 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7faa2186b700 1 -- 172.21.15.117:0/784051353 >> 172.21.15.117:0/784051353 conn(0x7faa1c071c90 msgr2=0x7faa1c072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7faa2186b700 1 -- 172.21.15.117:0/784051353 shutdown_connections 2023-07-19T20:44:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7f4333fff700 1 -- 172.21.15.117:0/2576946808 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f434401d3b0 con 0x7f434c0b53c0 2023-07-19T20:44:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.355+0000 7f4333fff700 1 --2- 172.21.15.117:0/2576946808 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f433806a730 0x7f433806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7f4333fff700 1 -- 172.21.15.117:0/2576946808 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43440886c0 con 0x7f434c0b53c0 2023-07-19T20:44:44.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7f4333fff700 1 --2- 172.21.15.117:0/2576946808 >> [v2:172.21.15.124:6801/146672,v1:172.21.15.124:6802/146672] conn(0x7f4338072fe0 0x7f43380753f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7f4333fff700 1 -- 172.21.15.117:0/2576946808 --> [v2:172.21.15.124:6801/146672,v1:172.21.15.124:6802/146672] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4338075aa0 con 0x7f4338072fe0 2023-07-19T20:44:44.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7f4333fff700 1 -- 172.21.15.117:0/2576946808 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f434408ac80 con 0x7f434c0b53c0 2023-07-19T20:44:44.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7f434bfff700 1 --2- 172.21.15.117:0/2576946808 >> [v2:172.21.15.124:6801/146672,v1:172.21.15.124:6802/146672] conn(0x7f4338072fe0 0x7f43380753f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.357+0000 7f702618d700 1 -- start start 2023-07-19T20:44:44.384 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.357+0000 7f1134f40700 1 -- 172.21.15.117:0/3418747533 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11301447e0 msgr2=0x7f11300b9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.384 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.357+0000 7f1134f40700 1 --2- 172.21.15.117:0/3418747533 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11301447e0 0x7f11300b9230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1130066c00 tx=0x7f112400fc90 comp rx=0 tx=0).stop 2023-07-19T20:44:44.384 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f1134f40700 1 -- 172.21.15.117:0/3418747533 shutdown_connections 2023-07-19T20:44:44.384 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f1134f40700 1 --2- 172.21.15.117:0/3418747533 >> v2:172.21.15.117:3300/0 conn(0x7f113006f560 0x7f11300b7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f1134f40700 1 --2- 172.21.15.117:0/3418747533 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11301447e0 0x7f11300b9230 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f1134f40700 1 --2- 172.21.15.117:0/3418747533 >> v2:172.21.15.124:3300/0 conn(0x7f113006baf0 0x7f1130070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f1134f40700 1 -- 172.21.15.117:0/3418747533 >> 172.21.15.117:0/3418747533 conn(0x7f11300bdc00 msgr2=0x7f11300b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f1134f40700 1 -- 172.21.15.117:0/3418747533 shutdown_connections 2023-07-19T20:44:44.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f1134f40700 1 -- 172.21.15.117:0/3418747533 wait complete. 2023-07-19T20:44:44.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f434bfff700 1 --2- 172.21.15.117:0/2576946808 >> [v2:172.21.15.124:6801/146672,v1:172.21.15.124:6802/146672] conn(0x7f4338072fe0 0x7f43380753f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f702618d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70201475e0 0x7f702014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f702618d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f70200b8a20 0x7f7020152430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f702618d700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70200b7900 con 0x7f70200baa40 2023-07-19T20:44:44.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f702618d700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7020147a70 con 0x7f70200b8a20 2023-07-19T20:44:44.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f702618d700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7020147d50 con 0x7f70201475e0 2023-07-19T20:44:44.387 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.356+0000 7faa2186b700 1 -- 172.21.15.117:0/784051353 wait complete. 2023-07-19T20:44:44.387 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7fb7faffd700 1 -- 172.21.15.117:0/2769606857 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fb7fc00fbe0 con 0x7fb80c1f91d0 2023-07-19T20:44:44.387 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7faa2186b700 1 Processor -- start 2023-07-19T20:44:44.388 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7fb7faffd700 1 --2- 172.21.15.117:0/2769606857 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb7ec06a720 0x7fb7ec06cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.388 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7fb7faffd700 1 -- 172.21.15.117:0/2769606857 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb7fc089310 con 0x7fb80c1f91d0 2023-07-19T20:44:44.388 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7fb7faffd700 1 --2- 172.21.15.117:0/2769606857 >> [v2:172.21.15.124:6800/146673,v1:172.21.15.124:6803/146673] conn(0x7fb7ec072fd0 0x7fb7ec0753e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.388 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7fb7faffd700 1 -- 172.21.15.117:0/2769606857 --> [v2:172.21.15.124:6800/146673,v1:172.21.15.124:6803/146673] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7ec075a90 con 0x7fb7ec072fd0 2023-07-19T20:44:44.388 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7fb7faffd700 1 -- 172.21.15.117:0/2769606857 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7fc0896c0 con 0x7fb80c1f91d0 2023-07-19T20:44:44.389 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7f4333fff700 1 -- 172.21.15.117:0/2576946808 <== osd.4 v2:172.21.15.124:6801/146672 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4338075aa0 con 0x7f4338072fe0 2023-07-19T20:44:44.389 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7fb80ad9d700 1 --2- 172.21.15.117:0/2769606857 >> [v2:172.21.15.124:6800/146673,v1:172.21.15.124:6803/146673] conn(0x7fb7ec072fd0 0x7fb7ec0753e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.390 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f701ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f70200b8a20 0x7f7020152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.390 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f701ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f70200b8a20 0x7f7020152430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58060/0 (socket says 172.21.15.117:58060) 2023-07-19T20:44:44.390 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7f701ffff700 1 -- 172.21.15.117:0/1010845025 learned_addr learned my addr 172.21.15.117:0/1010845025 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.390 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7f701ffff700 1 -- 172.21.15.117:0/1010845025 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70201475e0 msgr2=0x7f702014fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.391 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7f701ffff700 1 --2- 172.21.15.117:0/1010845025 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70201475e0 0x7f702014fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.391 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7f701ffff700 1 -- 172.21.15.117:0/1010845025 >> v1:172.21.15.124:6789/0 conn(0x7f70200baa40 legacy=0x7f70200b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.391 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7f701ffff700 1 -- 172.21.15.117:0/1010845025 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7020148030 con 0x7f70200b8a20 2023-07-19T20:44:44.391 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7f701ffff700 1 --2- 172.21.15.117:0/1010845025 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70200b8a20 0x7f7020152430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f701800bef0 tx=0x7f7018008600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa8ce033e376272a server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.391 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7fea5d6c8700 1 -- 172.21.15.117:0/3577420219 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea580b8da0 msgr2=0x7fea58159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.392 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7fea5d6c8700 1 --2- 172.21.15.117:0/3577420219 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea580b8da0 0x7fea58159590 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fea50009e80 tx=0x7fea5000b330 comp rx=0 tx=0).stop 2023-07-19T20:44:44.392 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7fea5d6c8700 1 -- 172.21.15.117:0/3577420219 shutdown_connections 2023-07-19T20:44:44.392 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7fea5d6c8700 1 --2- 172.21.15.117:0/3577420219 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea580b8da0 0x7fea58159590 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.392 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7fea5d6c8700 1 --2- 172.21.15.117:0/3577420219 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea58072990 0x7fea580b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.392 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7fea5d6c8700 1 -- 172.21.15.117:0/3577420219 >> 172.21.15.117:0/3577420219 conn(0x7fea5806b1f0 msgr2=0x7fea580bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.392 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7f701e7fc700 1 -- 172.21.15.117:0/1010845025 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701800b2e0 con 0x7f70200b8a20 2023-07-19T20:44:44.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7f1134f40700 1 Processor -- start 2023-07-19T20:44:44.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7fb80ad9d700 1 --2- 172.21.15.117:0/2769606857 >> [v2:172.21.15.124:6800/146673,v1:172.21.15.124:6803/146673] conn(0x7fb7ec072fd0 0x7fb7ec0753e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.358+0000 7faa2186b700 1 -- start start 2023-07-19T20:44:44.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7faa2186b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa1c0c0110 0x7faa1c0ba000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7faa2186b700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa1c0c04e0 0x7faa1c14e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7faa2186b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa1c1532d0 0x7faa1c146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7faa2186b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c14ebb0 con 0x7faa1c1532d0 2023-07-19T20:44:44.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7faa2186b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0ba9b0 con 0x7faa1c0c0110 2023-07-19T20:44:44.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7faa2186b700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0b6d80 con 0x7faa1c0c04e0 2023-07-19T20:44:44.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7faa1affd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa1c0c0110 0x7faa1c0ba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7faa1affd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa1c0c0110 0x7faa1c0ba000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58072/0 (socket says 172.21.15.117:58072) 2023-07-19T20:44:44.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7faa1affd700 1 -- 172.21.15.117:0/3532532248 learned_addr learned my addr 172.21.15.117:0/3532532248 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7faa1a7fc700 1 --2- 172.21.15.117:0/3532532248 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa1c0c04e0 0x7faa1c14e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7faa1b7fe700 1 --2- 172.21.15.117:0/3532532248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa1c1532d0 0x7faa1c146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7faa1affd700 1 -- 172.21.15.117:0/3532532248 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa1c0c04e0 msgr2=0x7faa1c14e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.396 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7faa1affd700 1 --2- 172.21.15.117:0/3532532248 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa1c0c04e0 0x7faa1c14e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.396 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7faa1affd700 1 -- 172.21.15.117:0/3532532248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa1c1532d0 msgr2=0x7faa1c146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.396 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7faa1affd700 1 --2- 172.21.15.117:0/3532532248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa1c1532d0 0x7faa1c146af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.396 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7f1134f40700 1 -- start start 2023-07-19T20:44:44.396 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f1134f40700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f113006baf0 0x7f11301d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.397 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7faa1affd700 1 -- 172.21.15.117:0/3532532248 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa14009a70 con 0x7faa1c0c0110 2023-07-19T20:44:44.397 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f1134f40700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f113006f560 0x7f1130145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.397 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f1134f40700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11301447e0 0x7f1130146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.397 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f1134f40700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11301d1f80 con 0x7f11301447e0 2023-07-19T20:44:44.397 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f1134f40700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1130146430 con 0x7f113006f560 2023-07-19T20:44:44.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f1134f40700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11300b5940 con 0x7f113006baf0 2023-07-19T20:44:44.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7f701e7fc700 1 -- 172.21.15.117:0/1010845025 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701800b440 con 0x7f70200b8a20 2023-07-19T20:44:44.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.359+0000 7f701e7fc700 1 -- 172.21.15.117:0/1010845025 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018008d50 con 0x7f70200b8a20 2023-07-19T20:44:44.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f702618d700 1 -- 172.21.15.117:0/1010845025 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70200b8a20 msgr2=0x7f7020152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f702618d700 1 --2- 172.21.15.117:0/1010845025 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70200b8a20 0x7f7020152430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f701800bef0 tx=0x7f7018008600 comp rx=0 tx=0).stop 2023-07-19T20:44:44.399 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f112e59c700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f113006baf0 0x7f11301d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.399 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f112e59c700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f113006baf0 0x7f11301d1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:39628/0 (socket says 172.21.15.117:39628) 2023-07-19T20:44:44.399 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f112e59c700 1 -- 172.21.15.117:0/2078285538 learned_addr learned my addr 172.21.15.117:0/2078285538 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.399 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f702618d700 1 -- 172.21.15.117:0/1010845025 shutdown_connections 2023-07-19T20:44:44.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f702618d700 1 --2- 172.21.15.117:0/1010845025 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70200b8a20 0x7f7020152430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f702618d700 1 --2- 172.21.15.117:0/1010845025 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70201475e0 0x7f702014fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f702618d700 1 -- 172.21.15.117:0/1010845025 >> 172.21.15.117:0/1010845025 conn(0x7f70200be4b0 msgr2=0x7f70200ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7fea5d6c8700 1 -- 172.21.15.117:0/3577420219 shutdown_connections 2023-07-19T20:44:44.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7faa1affd700 1 --2- 172.21.15.117:0/3532532248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa1c0c0110 0x7faa1c0ba000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faa14000f80 tx=0x7faa14004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.401 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f112ed9d700 1 --2- 172.21.15.117:0/2078285538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11301447e0 0x7f1130146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.401 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f434b7fe700 1 --2- 172.21.15.117:0/2576946808 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f433806a730 0x7f433806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7fb80a59c700 1 --2- 172.21.15.117:0/2769606857 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb7ec06a720 0x7fb7ec06cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7fb7faffd700 1 -- 172.21.15.117:0/2769606857 <== osd.5 v2:172.21.15.124:6800/146673 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb7ec075a90 con 0x7fb7ec072fd0 2023-07-19T20:44:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.361+0000 7faa03fff700 1 -- 172.21.15.117:0/3532532248 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa140045f0 con 0x7faa1c0c0110 2023-07-19T20:44:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f112dd9b700 1 --2- 172.21.15.117:0/2078285538 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f113006f560 0x7f1130145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.361+0000 7f112e59c700 1 -- 172.21.15.117:0/2078285538 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f113006f560 msgr2=0x7f1130145440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.361+0000 7f112e59c700 1 --2- 172.21.15.117:0/2078285538 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f113006f560 0x7f1130145440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.361+0000 7f112e59c700 1 -- 172.21.15.117:0/2078285538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11301447e0 msgr2=0x7f1130146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.361+0000 7f112e59c700 1 --2- 172.21.15.117:0/2078285538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11301447e0 0x7f1130146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.406 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.361+0000 7f112e59c700 1 -- 172.21.15.117:0/2078285538 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112400f610 con 0x7f113006baf0 2023-07-19T20:44:44.406 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.361+0000 7f112e59c700 1 --2- 172.21.15.117:0/2078285538 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f113006baf0 0x7f11301d1a40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f112401b040 tx=0x7f1124004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.407 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.361+0000 7f434b7fe700 1 --2- 172.21.15.117:0/2576946808 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f433806a730 0x7f433806cbe0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f433c019040 tx=0x7f433c010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.407 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.362+0000 7fc1e67fc700 1 --2- 172.21.15.117:0/2520461711 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc1d406a660 0x7fc1d406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.407 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.361+0000 7fb80a59c700 1 --2- 172.21.15.117:0/2769606857 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb7ec06a720 0x7fb7ec06cbd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb800009a40 tx=0x7fb800008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.408 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.361+0000 7faa03fff700 1 -- 172.21.15.117:0/3532532248 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa14004770 con 0x7faa1c0c0110 2023-07-19T20:44:44.408 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.361+0000 7faa03fff700 1 -- 172.21.15.117:0/3532532248 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14012690 con 0x7faa1c0c0110 2023-07-19T20:44:44.408 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.361+0000 7faa2186b700 1 -- 172.21.15.117:0/3532532248 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c0ba6d0 con 0x7faa1c0c0110 2023-07-19T20:44:44.408 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.361+0000 7faa2186b700 1 -- 172.21.15.117:0/3532532248 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c147030 con 0x7faa1c0c0110 2023-07-19T20:44:44.408 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.361+0000 7faa2186b700 1 -- 172.21.15.117:0/3532532248 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa9fc000fb0 con 0x7faa1c0c0110 2023-07-19T20:44:44.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.362+0000 7fc1e67fc700 1 -- 172.21.15.117:0/2520461711 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1e8014070 con 0x7fc1f0140da0 2023-07-19T20:44:44.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.362+0000 7fc1e67fc700 1 --2- 172.21.15.117:0/2520461711 >> [v2:172.21.15.117:6800/146435,v1:172.21.15.117:6801/146435] conn(0x7fc1d4072e90 0x7fc1d40752a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.362+0000 7fc1f5ebb700 1 --2- 172.21.15.117:0/2520461711 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc1d406a660 0x7fc1d406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.362+0000 7fc1e67fc700 1 -- 172.21.15.117:0/2520461711 --> [v2:172.21.15.117:6800/146435,v1:172.21.15.117:6801/146435] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1d4075950 con 0x7fc1d4072e90 2023-07-19T20:44:44.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.362+0000 7fc1e67fc700 1 -- 172.21.15.117:0/2520461711 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1e808a9d0 con 0x7fc1f0140da0 2023-07-19T20:44:44.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7f702618d700 1 -- 172.21.15.117:0/1010845025 shutdown_connections 2023-07-19T20:44:44.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.360+0000 7fea5d6c8700 1 -- 172.21.15.117:0/3577420219 wait complete. 2023-07-19T20:44:44.411 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.362+0000 7fea5d6c8700 1 Processor -- start 2023-07-19T20:44:44.411 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.363+0000 7fc1f5ebb700 1 --2- 172.21.15.117:0/2520461711 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc1d406a660 0x7fc1d406cb10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec001940 tx=0x7fc1ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.412 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.364+0000 7fc1f56ba700 1 --2- 172.21.15.117:0/2520461711 >> [v2:172.21.15.117:6800/146435,v1:172.21.15.117:6801/146435] conn(0x7fc1d4072e90 0x7fc1d40752a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.412 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.364+0000 7faa03fff700 1 -- 172.21.15.117:0/3532532248 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7faa14019070 con 0x7faa1c0c0110 2023-07-19T20:44:44.412 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.365+0000 7faa03fff700 1 --2- 172.21.15.117:0/3532532248 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faa0806a730 0x7faa0806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.365+0000 7faa03fff700 1 -- 172.21.15.117:0/3532532248 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa1408aa50 con 0x7faa1c0c0110 2023-07-19T20:44:44.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.365+0000 7faa03fff700 1 --2- 172.21.15.117:0/3532532248 >> [v2:172.21.15.124:6816/146674,v1:172.21.15.124:6817/146674] conn(0x7faa08072fe0 0x7faa080753f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.365+0000 7faa03fff700 1 -- 172.21.15.117:0/3532532248 --> [v2:172.21.15.124:6816/146674,v1:172.21.15.124:6817/146674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa08075aa0 con 0x7faa08072fe0 2023-07-19T20:44:44.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.365+0000 7faa03fff700 1 -- 172.21.15.117:0/3532532248 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa1408ae00 con 0x7faa1c0c0110 2023-07-19T20:44:44.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.365+0000 7fea5d6c8700 1 -- start start 2023-07-19T20:44:44.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.365+0000 7fea5d6c8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea580b8da0 0x7fea58149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.365+0000 7fea5d6c8700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea58149220 0x7fea5814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.365+0000 7fea5d6c8700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea581384b0 0x7fea5814a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.365+0000 7fea5d6c8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea58149dd0 con 0x7fea580b8da0 2023-07-19T20:44:44.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.365+0000 7fea5d6c8700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5814e0f0 con 0x7fea58149220 2023-07-19T20:44:44.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.365+0000 7fea5d6c8700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5814e670 con 0x7fea581384b0 2023-07-19T20:44:44.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7fc1f56ba700 1 --2- 172.21.15.117:0/2520461711 >> [v2:172.21.15.117:6800/146435,v1:172.21.15.117:6801/146435] conn(0x7fc1d4072e90 0x7fc1d40752a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7fea567fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea58149220 0x7fea5814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7fea567fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea58149220 0x7fea5814cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58086/0 (socket says 172.21.15.117:58086) 2023-07-19T20:44:44.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7fea567fc700 1 -- 172.21.15.117:0/4113041241 learned_addr learned my addr 172.21.15.117:0/4113041241 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.362+0000 7f111effd700 1 -- 172.21.15.117:0/2078285538 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124016070 con 0x7f113006baf0 2023-07-19T20:44:44.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.364+0000 7f702618d700 1 -- 172.21.15.117:0/1010845025 wait complete. 2023-07-19T20:44:44.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7f702618d700 1 Processor -- start 2023-07-19T20:44:44.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7fea567fc700 1 -- 172.21.15.117:0/4113041241 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea581384b0 msgr2=0x7fea5814a3d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-19T20:44:44.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7fea567fc700 1 --2- 172.21.15.117:0/4113041241 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea581384b0 0x7fea5814a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7fea567fc700 1 -- 172.21.15.117:0/4113041241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea580b8da0 msgr2=0x7fea58149890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7fea567fc700 1 --2- 172.21.15.117:0/4113041241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea580b8da0 0x7fea58149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7fea567fc700 1 -- 172.21.15.117:0/4113041241 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea50009b30 con 0x7fea58149220 2023-07-19T20:44:44.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7fea567fc700 1 --2- 172.21.15.117:0/4113041241 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea58149220 0x7fea5814cb20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fea4800e9b0 tx=0x7fea4800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.419 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7faa1b7fe700 1 --2- 172.21.15.117:0/3532532248 >> [v2:172.21.15.124:6816/146674,v1:172.21.15.124:6817/146674] conn(0x7faa08072fe0 0x7faa080753f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.419 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7ff90e296700 1 Processor -- start 2023-07-19T20:44:44.419 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.367+0000 7fc1e67fc700 1 -- 172.21.15.117:0/2520461711 <== osd.1 v2:172.21.15.117:6800/146435 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc1d4075950 con 0x7fc1d4072e90 2023-07-19T20:44:44.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7ff90e296700 1 -- start start 2023-07-19T20:44:44.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.367+0000 7ff90e296700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff9080befb0 0x7ff90814fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.367+0000 7ff90e296700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff90806ac10 con 0x7ff9080be2d0 2023-07-19T20:44:44.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.367+0000 7ff90e296700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff90808b0b0 con 0x7ff9080bebe0 2023-07-19T20:44:44.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.367+0000 7ff90e296700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9080bbe10 con 0x7ff9080befb0 2023-07-19T20:44:44.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.367+0000 7ff907fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff9080bebe0 0x7ff9080bf8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.117:34392/0 (socket says 172.21.15.117:34392) 2023-07-19T20:44:44.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.367+0000 7ff907fff700 1 -- 172.21.15.117:0/2462436514 learned_addr learned my addr 172.21.15.117:0/2462436514 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:44.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.367+0000 7ff90c833700 1 --2- 172.21.15.117:0/2462436514 >> v2:172.21.15.124:3300/0 conn(0x7ff9080befb0 0x7ff90814fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.366+0000 7f702618d700 1 -- start start 2023-07-19T20:44:44.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.367+0000 7f702618d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70200b8a20 0x7f70201e2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.367+0000 7f702618d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70200baa40 0x7f702013f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.367+0000 7f702618d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70201475e0 0x7f70201ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.367+0000 7f702618d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702013f800 con 0x7f70201475e0 2023-07-19T20:44:44.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.367+0000 7f702618d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70201f0650 con 0x7f70200baa40 2023-07-19T20:44:44.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.367+0000 7f702618d700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70201f0930 con 0x7f70200b8a20 2023-07-19T20:44:44.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7faa1b7fe700 1 --2- 172.21.15.117:0/3532532248 >> [v2:172.21.15.124:6816/146674,v1:172.21.15.124:6817/146674] conn(0x7faa08072fe0 0x7faa080753f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7f701effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70200baa40 0x7f702013f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7f701effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70200baa40 0x7f702013f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58098/0 (socket says 172.21.15.117:58098) 2023-07-19T20:44:44.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7f701effd700 1 -- 172.21.15.117:0/2777041619 learned_addr learned my addr 172.21.15.117:0/2777041619 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7ff90c833700 1 -- 172.21.15.117:0/2462436514 >> v1:172.21.15.124:6789/0 conn(0x7ff9080bebe0 legacy=0x7ff9080bf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7ff90c833700 1 -- 172.21.15.117:0/2462436514 >> v1:172.21.15.117:6789/0 conn(0x7ff9080be2d0 legacy=0x7ff90814f6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-19T20:44:44.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7ff90c833700 1 -- 172.21.15.117:0/2462436514 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9080a0120 con 0x7ff9080befb0 2023-07-19T20:44:44.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7ff90c833700 1 --2- 172.21.15.117:0/2462436514 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9080befb0 0x7ff90814fe00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff900009d90 tx=0x7ff90000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=392d4759b29a6bf7 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7f701effd700 1 -- 172.21.15.117:0/2777041619 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70200b8a20 msgr2=0x7f70201e2640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-19T20:44:44.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7f701effd700 1 --2- 172.21.15.117:0/2777041619 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70200b8a20 0x7f70201e2640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7f701effd700 1 -- 172.21.15.117:0/2777041619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70201475e0 msgr2=0x7f70201ecfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7f701effd700 1 --2- 172.21.15.117:0/2777041619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70201475e0 0x7f70201ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7f701effd700 1 -- 172.21.15.117:0/2777041619 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701800bb50 con 0x7f70200baa40 2023-07-19T20:44:44.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7f701effd700 1 --2- 172.21.15.117:0/2777041619 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70200baa40 0x7f702013f2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f700c00b4a0 tx=0x7f700c00b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7f7017fff700 1 -- 172.21.15.117:0/2777041619 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c011830 con 0x7f70200baa40 2023-07-19T20:44:44.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7f7017fff700 1 -- 172.21.15.117:0/2777041619 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c011990 con 0x7f70200baa40 2023-07-19T20:44:44.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7f702618d700 1 -- 172.21.15.117:0/2777041619 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70201f0c10 con 0x7f70200baa40 2023-07-19T20:44:44.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7faa03fff700 1 -- 172.21.15.117:0/3532532248 <== osd.6 v2:172.21.15.124:6816/146674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7faa08075aa0 con 0x7faa08072fe0 2023-07-19T20:44:44.427 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.368+0000 7f7017fff700 1 -- 172.21.15.117:0/2777041619 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c011d40 con 0x7f70200baa40 2023-07-19T20:44:44.427 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.369+0000 7ff906ffd700 1 -- 172.21.15.117:0/2462436514 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90000e070 con 0x7ff9080befb0 2023-07-19T20:44:44.427 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.369+0000 7ff906ffd700 1 -- 172.21.15.117:0/2462436514 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90000bad0 con 0x7ff9080befb0 2023-07-19T20:44:44.427 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.369+0000 7ff906ffd700 1 -- 172.21.15.117:0/2462436514 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90000be60 con 0x7ff9080befb0 2023-07-19T20:44:44.428 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.369+0000 7f702618d700 1 -- 172.21.15.117:0/2777041619 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70201ddff0 con 0x7f70200baa40 2023-07-19T20:44:44.428 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.370+0000 7ff90e296700 1 -- 172.21.15.117:0/2462436514 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9080befb0 msgr2=0x7ff90814fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.428 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.370+0000 7ff90e296700 1 --2- 172.21.15.117:0/2462436514 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9080befb0 0x7ff90814fe00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff900009d90 tx=0x7ff90000b330 comp rx=0 tx=0).stop 2023-07-19T20:44:44.428 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.370+0000 7ff90e296700 1 -- 172.21.15.117:0/2462436514 shutdown_connections 2023-07-19T20:44:44.428 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.370+0000 7ff90e296700 1 --2- 172.21.15.117:0/2462436514 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9080befb0 0x7ff90814fe00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.429 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.370+0000 7ff90e296700 1 -- 172.21.15.117:0/2462436514 >> 172.21.15.117:0/2462436514 conn(0x7ff9080a26a0 msgr2=0x7ff9080a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.429 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.371+0000 7f7017fff700 1 -- 172.21.15.117:0/2777041619 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f700c01a400 con 0x7f70200baa40 2023-07-19T20:44:44.429 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.372+0000 7f7017fff700 1 --2- 172.21.15.117:0/2777041619 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f700806a660 0x7f700806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.429 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.372+0000 7f7017fff700 1 -- 172.21.15.117:0/2777041619 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f700c088b90 con 0x7f70200baa40 2023-07-19T20:44:44.430 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.362+0000 7f111effd700 1 -- 172.21.15.117:0/2078285538 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11240038b0 con 0x7f113006baf0 2023-07-19T20:44:44.430 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.362+0000 7f111effd700 1 -- 172.21.15.117:0/2078285538 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124003c80 con 0x7f113006baf0 2023-07-19T20:44:44.430 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.362+0000 7f1134f40700 1 -- 172.21.15.117:0/2078285538 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11300b5c20 con 0x7f113006baf0 2023-07-19T20:44:44.430 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.362+0000 7f1134f40700 1 -- 172.21.15.117:0/2078285538 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1130145980 con 0x7f113006baf0 2023-07-19T20:44:44.430 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.363+0000 7f1134f40700 1 -- 172.21.15.117:0/2078285538 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1130071a10 con 0x7f113006baf0 2023-07-19T20:44:44.430 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.373+0000 7faa1a7fc700 1 --2- 172.21.15.117:0/3532532248 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faa0806a730 0x7faa0806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.431 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.373+0000 7f702618d700 1 --2- 172.21.15.117:0/2777041619 >> [v2:172.21.15.117:6820/146436,v1:172.21.15.117:6822/146436] conn(0x7f70201f1130 0x7f70201de560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.431 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.373+0000 7f702618d700 1 -- 172.21.15.117:0/2777041619 --> [v2:172.21.15.117:6820/146436,v1:172.21.15.117:6822/146436] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70201f04b0 con 0x7f70201f1130 2023-07-19T20:44:44.431 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.373+0000 7f701f7fe700 1 --2- 172.21.15.117:0/2777041619 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f700806a660 0x7f700806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.431 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.374+0000 7f701f7fe700 1 --2- 172.21.15.117:0/2777041619 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f700806a660 0x7f700806cb10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7010000f60 tx=0x7f7010007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.373+0000 7fea3f7fe700 1 -- 172.21.15.117:0/4113041241 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4800c850 con 0x7fea58149220 2023-07-19T20:44:44.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.373+0000 7fea3f7fe700 1 -- 172.21.15.117:0/4113041241 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4800c9b0 con 0x7fea58149220 2023-07-19T20:44:44.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.373+0000 7fea3f7fe700 1 -- 172.21.15.117:0/4113041241 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4800cd20 con 0x7fea58149220 2023-07-19T20:44:44.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.373+0000 7fea5d6c8700 1 -- 172.21.15.117:0/4113041241 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5814e390 con 0x7fea58149220 2023-07-19T20:44:44.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.373+0000 7fea5d6c8700 1 -- 172.21.15.117:0/4113041241 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea58137f90 con 0x7fea58149220 2023-07-19T20:44:44.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.374+0000 7fea5d6c8700 1 -- 172.21.15.117:0/4113041241 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea58152960 con 0x7fea58149220 2023-07-19T20:44:44.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.374+0000 7faa1a7fc700 1 --2- 172.21.15.117:0/3532532248 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faa0806a730 0x7faa0806cbe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faa1c148510 tx=0x7faa0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.373+0000 7ff90e296700 1 -- 172.21.15.117:0/2462436514 shutdown_connections 2023-07-19T20:44:44.434 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.373+0000 7ff90e296700 1 -- 172.21.15.117:0/2462436514 wait complete. 2023-07-19T20:44:44.434 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.375+0000 7ff90e296700 1 Processor -- start 2023-07-19T20:44:44.434 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.375+0000 7ff90e296700 1 -- start start 2023-07-19T20:44:44.434 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.376+0000 7ff90e296700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9080bebe0 0x7ff9080b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.434 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.376+0000 7ff90e296700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9080befb0 0x7ff9081ecb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.434 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.376+0000 7ff90e296700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080ba900 0x7ff9081e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.434 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.376+0000 7ff90e296700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9080bf3d0 con 0x7ff9080ba900 2023-07-19T20:44:44.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.376+0000 7ff90e296700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9080b72c0 con 0x7ff9080befb0 2023-07-19T20:44:44.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.376+0000 7ff90e296700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90806df70 con 0x7ff9080bebe0 2023-07-19T20:44:44.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.376+0000 7ff90c833700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080ba900 0x7ff9081e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.376+0000 7ff907fff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9080bebe0 0x7ff9080b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.376+0000 7ff90c833700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080ba900 0x7ff9081e68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43620/0 (socket says 172.21.15.117:43620) 2023-07-19T20:44:44.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.376+0000 7ff90c833700 1 -- 172.21.15.117:0/550930906 learned_addr learned my addr 172.21.15.117:0/550930906 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.377+0000 7ff9077fe700 1 --2- 172.21.15.117:0/550930906 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9080befb0 0x7ff9081ecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.377+0000 7ff907fff700 1 -- 172.21.15.117:0/550930906 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9080befb0 msgr2=0x7ff9081ecb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.436 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.377+0000 7ff907fff700 1 --2- 172.21.15.117:0/550930906 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9080befb0 0x7ff9081ecb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.436 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.377+0000 7ff907fff700 1 -- 172.21.15.117:0/550930906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080ba900 msgr2=0x7ff9081e68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.436 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.377+0000 7ff907fff700 1 --2- 172.21.15.117:0/550930906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080ba900 0x7ff9081e68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.436 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.377+0000 7ff907fff700 1 -- 172.21.15.117:0/550930906 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff900009a70 con 0x7ff9080bebe0 2023-07-19T20:44:44.436 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.377+0000 7ff9077fe700 1 --2- 172.21.15.117:0/550930906 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9080befb0 0x7ff9081ecb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:44.436 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.377+0000 7ff907fff700 1 --2- 172.21.15.117:0/550930906 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9080bebe0 0x7ff9080b6d80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00c780 tx=0x7ff8fc00ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.436 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.377+0000 7ff904ff9700 1 -- 172.21.15.117:0/550930906 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc004c80 con 0x7ff9080bebe0 2023-07-19T20:44:44.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.377+0000 7ff904ff9700 1 -- 172.21.15.117:0/550930906 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc004de0 con 0x7ff9080bebe0 2023-07-19T20:44:44.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.377+0000 7ff904ff9700 1 -- 172.21.15.117:0/550930906 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0072f0 con 0x7ff9080bebe0 2023-07-19T20:44:44.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.380+0000 7f701ffff700 1 --2- 172.21.15.117:0/2777041619 >> [v2:172.21.15.117:6820/146436,v1:172.21.15.117:6822/146436] conn(0x7f70201f1130 0x7f70201de560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.381+0000 7f701ffff700 1 --2- 172.21.15.117:0/2777041619 >> [v2:172.21.15.117:6820/146436,v1:172.21.15.117:6822/146436] conn(0x7f70201f1130 0x7f70201de560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.382+0000 7f7017fff700 1 -- 172.21.15.117:0/2777041619 <== osd.0 v2:172.21.15.117:6820/146436 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f70201f04b0 con 0x7f70201f1130 2023-07-19T20:44:44.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.380+0000 7fea3f7fe700 1 -- 172.21.15.117:0/4113041241 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fea48013470 con 0x7fea58149220 2023-07-19T20:44:44.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.380+0000 7fea3f7fe700 1 --2- 172.21.15.117:0/4113041241 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fea4406a730 0x7fea4406cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.380+0000 7fea3f7fe700 1 -- 172.21.15.117:0/4113041241 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea48088bd0 con 0x7fea58149220 2023-07-19T20:44:44.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.380+0000 7fea3f7fe700 1 --2- 172.21.15.117:0/4113041241 >> [v2:172.21.15.117:6808/146434,v1:172.21.15.117:6809/146434] conn(0x7fea44072fe0 0x7fea440753f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.380+0000 7fea3f7fe700 1 -- 172.21.15.117:0/4113041241 --> [v2:172.21.15.117:6808/146434,v1:172.21.15.117:6809/146434] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea44075aa0 con 0x7fea44072fe0 2023-07-19T20:44:44.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.380+0000 7fea3f7fe700 1 -- 172.21.15.117:0/4113041241 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea4808d2a0 con 0x7fea58149220 2023-07-19T20:44:44.439 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.381+0000 7fea577fe700 1 --2- 172.21.15.117:0/4113041241 >> [v2:172.21.15.117:6808/146434,v1:172.21.15.117:6809/146434] conn(0x7fea44072fe0 0x7fea440753f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.439 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.381+0000 7fea577fe700 1 --2- 172.21.15.117:0/4113041241 >> [v2:172.21.15.117:6808/146434,v1:172.21.15.117:6809/146434] conn(0x7fea44072fe0 0x7fea440753f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.439 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.383+0000 7fea3f7fe700 1 -- 172.21.15.117:0/4113041241 <== osd.2 v2:172.21.15.117:6808/146434 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fea44075aa0 con 0x7fea44072fe0 2023-07-19T20:44:44.439 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.378+0000 7f111effd700 1 -- 172.21.15.117:0/2078285538 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f1124019370 con 0x7f113006baf0 2023-07-19T20:44:44.440 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.378+0000 7f111effd700 1 --2- 172.21.15.117:0/2078285538 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f111006a660 0x7f111006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.440 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.378+0000 7f111effd700 1 -- 172.21.15.117:0/2078285538 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f11240898c0 con 0x7f113006baf0 2023-07-19T20:44:44.440 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.378+0000 7f112dd9b700 1 --2- 172.21.15.117:0/2078285538 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f111006a660 0x7f111006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.440 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.378+0000 7f111effd700 1 --2- 172.21.15.117:0/2078285538 >> [v2:172.21.15.117:6816/146439,v1:172.21.15.117:6817/146439] conn(0x7f1110072f10 0x7f1110075320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.440 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.378+0000 7f111effd700 1 -- 172.21.15.117:0/2078285538 --> [v2:172.21.15.117:6816/146439,v1:172.21.15.117:6817/146439] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11100759d0 con 0x7f1110072f10 2023-07-19T20:44:44.440 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.378+0000 7f111effd700 1 -- 172.21.15.117:0/2078285538 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1124089c70 con 0x7f113006baf0 2023-07-19T20:44:44.440 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.379+0000 7f112ed9d700 1 --2- 172.21.15.117:0/2078285538 >> [v2:172.21.15.117:6816/146439,v1:172.21.15.117:6817/146439] conn(0x7f1110072f10 0x7f1110075320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.440 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.379+0000 7f112ed9d700 1 --2- 172.21.15.117:0/2078285538 >> [v2:172.21.15.117:6816/146439,v1:172.21.15.117:6817/146439] conn(0x7f1110072f10 0x7f1110075320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.379+0000 7f112dd9b700 1 --2- 172.21.15.117:0/2078285538 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f111006a660 0x7f111006cb10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f113006bee0 tx=0x7f112000b2a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.381+0000 7f111effd700 1 -- 172.21.15.117:0/2078285538 <== osd.3 v2:172.21.15.117:6816/146439 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f11100759d0 con 0x7f1110072f10 2023-07-19T20:44:44.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.378+0000 7ff90e296700 1 -- 172.21.15.117:0/550930906 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90806e460 con 0x7ff9080bebe0 2023-07-19T20:44:44.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.378+0000 7ff90e296700 1 -- 172.21.15.117:0/550930906 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff908070150 con 0x7ff9080bebe0 2023-07-19T20:44:44.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.381+0000 7ff90e296700 1 -- 172.21.15.117:0/550930906 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff90806aeb0 con 0x7ff9080bebe0 2023-07-19T20:44:44.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.382+0000 7ff904ff9700 1 -- 172.21.15.117:0/550930906 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7ff8fc007450 con 0x7ff9080bebe0 2023-07-19T20:44:44.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.382+0000 7ff904ff9700 1 --2- 172.21.15.117:0/550930906 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff8f006a7e0 0x7ff8f006cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.382+0000 7ff904ff9700 1 -- 172.21.15.117:0/550930906 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8fc0888c0 con 0x7ff9080bebe0 2023-07-19T20:44:44.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.382+0000 7ff904ff9700 1 --2- 172.21.15.117:0/550930906 >> [v2:172.21.15.124:6824/146717,v1:172.21.15.124:6825/146717] conn(0x7ff8f0073010 0x7ff8f0075420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.382+0000 7ff904ff9700 1 -- 172.21.15.117:0/550930906 --> [v2:172.21.15.124:6824/146717,v1:172.21.15.124:6825/146717] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8f0075ad0 con 0x7ff8f0073010 2023-07-19T20:44:44.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.382+0000 7ff904ff9700 1 -- 172.21.15.117:0/550930906 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8fc053c20 con 0x7ff9080bebe0 2023-07-19T20:44:44.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.383+0000 7ff90c833700 1 --2- 172.21.15.117:0/550930906 >> [v2:172.21.15.124:6824/146717,v1:172.21.15.124:6825/146717] conn(0x7ff8f0073010 0x7ff8f0075420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.383+0000 7ff9077fe700 1 --2- 172.21.15.117:0/550930906 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff8f006a7e0 0x7ff8f006cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.383+0000 7ff90c833700 1 --2- 172.21.15.117:0/550930906 >> [v2:172.21.15.124:6824/146717,v1:172.21.15.124:6825/146717] conn(0x7ff8f0073010 0x7ff8f0075420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.384+0000 7ff9077fe700 1 --2- 172.21.15.117:0/550930906 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff8f006a7e0 0x7ff8f006cc90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8006fd0 tx=0x7ff8f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.389+0000 7faa2186b700 1 -- 172.21.15.117:0/3532532248 --> [v2:172.21.15.124:6816/146674,v1:172.21.15.124:6817/146674] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa9fc002d30 con 0x7faa08072fe0 2023-07-19T20:44:44.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.389+0000 7fea56ffd700 1 --2- 172.21.15.117:0/4113041241 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fea4406a730 0x7fea4406cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.389+0000 7ff904ff9700 1 -- 172.21.15.117:0/550930906 <== osd.7 v2:172.21.15.124:6824/146717 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff8f0075ad0 con 0x7ff8f0073010 2023-07-19T20:44:44.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.389+0000 7fb810898700 1 -- 172.21.15.117:0/2769606857 --> [v2:172.21.15.124:6800/146673,v1:172.21.15.124:6803/146673] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb80c0bc3c0 con 0x7fb7ec072fd0 2023-07-19T20:44:44.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.390+0000 7faa03fff700 1 -- 172.21.15.117:0/3532532248 <== osd.6 v2:172.21.15.124:6816/146674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa9fc002d30 con 0x7faa08072fe0 2023-07-19T20:44:44.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.391+0000 7fea56ffd700 1 --2- 172.21.15.117:0/4113041241 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fea4406a730 0x7fea4406cbe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0015f0 tx=0x7fea4c007ae0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.390+0000 7fb7faffd700 1 -- 172.21.15.117:0/2769606857 <== osd.5 v2:172.21.15.124:6800/146673 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb804012420 con 0x7fb7ec072fd0 2023-07-19T20:44:44.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.391+0000 7faa2186b700 1 -- 172.21.15.117:0/3532532248 >> [v2:172.21.15.124:6816/146674,v1:172.21.15.124:6817/146674] conn(0x7faa08072fe0 msgr2=0x7faa080753f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.391+0000 7faa2186b700 1 --2- 172.21.15.117:0/3532532248 >> [v2:172.21.15.124:6816/146674,v1:172.21.15.124:6817/146674] conn(0x7faa08072fe0 0x7faa080753f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.391+0000 7faa2186b700 1 -- 172.21.15.117:0/3532532248 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faa0806a730 msgr2=0x7faa0806cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.391+0000 7faa2186b700 1 --2- 172.21.15.117:0/3532532248 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faa0806a730 0x7faa0806cbe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faa1c148510 tx=0x7faa0c009040 comp rx=0 tx=0).stop 2023-07-19T20:44:44.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.391+0000 7faa2186b700 1 -- 172.21.15.117:0/3532532248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa1c0c0110 msgr2=0x7faa1c0ba000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.391+0000 7faa2186b700 1 --2- 172.21.15.117:0/3532532248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa1c0c0110 0x7faa1c0ba000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faa14000f80 tx=0x7faa14004ad0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.448 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.391+0000 7faa1b7fe700 1 -- 172.21.15.117:0/3532532248 reap_dead start 2023-07-19T20:44:44.448 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.392+0000 7faa2186b700 1 -- 172.21.15.117:0/3532532248 shutdown_connections 2023-07-19T20:44:44.448 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.392+0000 7faa2186b700 1 -- 172.21.15.117:0/3532532248 >> 172.21.15.117:0/3532532248 conn(0x7faa1c071c90 msgr2=0x7faa1c148960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.448 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.395+0000 7fb810898700 1 -- 172.21.15.117:0/2769606857 >> [v2:172.21.15.124:6800/146673,v1:172.21.15.124:6803/146673] conn(0x7fb7ec072fd0 msgr2=0x7fb7ec0753e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.449 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.395+0000 7fb810898700 1 --2- 172.21.15.117:0/2769606857 >> [v2:172.21.15.124:6800/146673,v1:172.21.15.124:6803/146673] conn(0x7fb7ec072fd0 0x7fb7ec0753e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.449 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.395+0000 7fb810898700 1 -- 172.21.15.117:0/2769606857 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb7ec06a720 msgr2=0x7fb7ec06cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.449 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.395+0000 7fb810898700 1 --2- 172.21.15.117:0/2769606857 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb7ec06a720 0x7fb7ec06cbd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb800009a40 tx=0x7fb800008040 comp rx=0 tx=0).stop 2023-07-19T20:44:44.449 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.395+0000 7fb810898700 1 -- 172.21.15.117:0/2769606857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb80c1f91d0 msgr2=0x7fb80c0b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.449 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.395+0000 7fb810898700 1 --2- 172.21.15.117:0/2769606857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb80c1f91d0 0x7fb80c0b5e60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb80c069400 tx=0x7fb7fc007570 comp rx=0 tx=0).stop 2023-07-19T20:44:44.449 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.395+0000 7fb80ad9d700 1 -- 172.21.15.117:0/2769606857 reap_dead start 2023-07-19T20:44:44.449 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.395+0000 7fb810898700 1 -- 172.21.15.117:0/2769606857 shutdown_connections 2023-07-19T20:44:44.450 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.395+0000 7fb810898700 1 -- 172.21.15.117:0/2769606857 >> 172.21.15.117:0/2769606857 conn(0x7fb80c06b160 msgr2=0x7fb80c155db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.450 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.393+0000 7f4351ee9700 1 -- 172.21.15.117:0/2576946808 --> [v2:172.21.15.124:6801/146672,v1:172.21.15.124:6802/146672] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f434c074890 con 0x7f4338072fe0 2023-07-19T20:44:44.450 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.395+0000 7f4333fff700 1 -- 172.21.15.117:0/2576946808 <== osd.4 v2:172.21.15.124:6801/146672 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f434c074890 con 0x7f4338072fe0 2023-07-19T20:44:44.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.397+0000 7f4351ee9700 1 -- 172.21.15.117:0/2576946808 >> [v2:172.21.15.124:6801/146672,v1:172.21.15.124:6802/146672] conn(0x7f4338072fe0 msgr2=0x7f43380753f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.397+0000 7f4351ee9700 1 --2- 172.21.15.117:0/2576946808 >> [v2:172.21.15.124:6801/146672,v1:172.21.15.124:6802/146672] conn(0x7f4338072fe0 0x7f43380753f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.397+0000 7f4351ee9700 1 -- 172.21.15.117:0/2576946808 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f433806a730 msgr2=0x7f433806cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.397+0000 7f4351ee9700 1 --2- 172.21.15.117:0/2576946808 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f433806a730 0x7f433806cbe0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f433c019040 tx=0x7f433c010000 comp rx=0 tx=0).stop 2023-07-19T20:44:44.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.397+0000 7f4351ee9700 1 -- 172.21.15.117:0/2576946808 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f434c0b53c0 msgr2=0x7f434c1d4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.397+0000 7f4351ee9700 1 --2- 172.21.15.117:0/2576946808 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f434c0b53c0 0x7f434c1d4140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f434400b9f0 tx=0x7f434400bdb0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.397+0000 7f434bfff700 1 -- 172.21.15.117:0/2576946808 reap_dead start 2023-07-19T20:44:44.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.397+0000 7f4351ee9700 1 -- 172.21.15.117:0/2576946808 shutdown_connections 2023-07-19T20:44:44.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.397+0000 7f4351ee9700 1 -- 172.21.15.117:0/2576946808 >> 172.21.15.117:0/2576946808 conn(0x7f434c06b1f0 msgr2=0x7f434c1d5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.398+0000 7f4351ee9700 1 -- 172.21.15.117:0/2576946808 shutdown_connections 2023-07-19T20:44:44.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.399+0000 7f4351ee9700 1 -- 172.21.15.117:0/2576946808 wait complete. 2023-07-19T20:44:44.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.399+0000 7fc1f811f700 1 -- 172.21.15.117:0/2520461711 --> [v2:172.21.15.117:6800/146435,v1:172.21.15.117:6801/146435] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc1f014a490 con 0x7fc1d4072e90 2023-07-19T20:44:44.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.400+0000 7faa2186b700 1 -- 172.21.15.117:0/3532532248 shutdown_connections 2023-07-19T20:44:44.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.400+0000 7faa2186b700 1 -- 172.21.15.117:0/3532532248 wait complete. 2023-07-19T20:44:44.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.400+0000 7fb810898700 1 -- 172.21.15.117:0/2769606857 shutdown_connections 2023-07-19T20:44:44.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.400+0000 7fb810898700 1 -- 172.21.15.117:0/2769606857 wait complete. 2023-07-19T20:44:44.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.400+0000 7fc1e67fc700 1 -- 172.21.15.117:0/2520461711 <== osd.1 v2:172.21.15.117:6800/146435 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc1e0009980 con 0x7fc1d4072e90 2023-07-19T20:44:44.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.400+0000 7fc1f811f700 1 -- 172.21.15.117:0/2520461711 >> [v2:172.21.15.117:6800/146435,v1:172.21.15.117:6801/146435] conn(0x7fc1d4072e90 msgr2=0x7fc1d40752a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.401+0000 7fc1f811f700 1 --2- 172.21.15.117:0/2520461711 >> [v2:172.21.15.117:6800/146435,v1:172.21.15.117:6801/146435] conn(0x7fc1d4072e90 0x7fc1d40752a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.401+0000 7fc1f811f700 1 -- 172.21.15.117:0/2520461711 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc1d406a660 msgr2=0x7fc1d406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.401+0000 7fc1f811f700 1 --2- 172.21.15.117:0/2520461711 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc1d406a660 0x7fc1d406cb10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec001940 tx=0x7fc1ec009040 comp rx=0 tx=0).stop 2023-07-19T20:44:44.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.401+0000 7fc1f811f700 1 -- 172.21.15.117:0/2520461711 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1f0140da0 msgr2=0x7fc1f00baca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.401+0000 7fc1f811f700 1 --2- 172.21.15.117:0/2520461711 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc1f0140da0 0x7fc1f00baca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8018000 tx=0x7fc1e8004ad0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.401+0000 7fc1f66bc700 1 -- 172.21.15.117:0/2520461711 reap_dead start 2023-07-19T20:44:44.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.404+0000 7fea5d6c8700 1 -- 172.21.15.117:0/4113041241 --> [v2:172.21.15.117:6808/146434,v1:172.21.15.117:6809/146434] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fea58152680 con 0x7fea44072fe0 2023-07-19T20:44:44.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.405+0000 7fea3f7fe700 1 -- 172.21.15.117:0/4113041241 <== osd.2 v2:172.21.15.117:6808/146434 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fea50003b90 con 0x7fea44072fe0 2023-07-19T20:44:44.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.406+0000 7fc1f811f700 1 -- 172.21.15.117:0/2520461711 shutdown_connections 2023-07-19T20:44:44.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.406+0000 7fc1f811f700 1 -- 172.21.15.117:0/2520461711 >> 172.21.15.117:0/2520461711 conn(0x7fc1f006b1f0 msgr2=0x7fc1f00b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.406+0000 7fea5d6c8700 1 -- 172.21.15.117:0/4113041241 >> [v2:172.21.15.117:6808/146434,v1:172.21.15.117:6809/146434] conn(0x7fea44072fe0 msgr2=0x7fea440753f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.406+0000 7fea5d6c8700 1 --2- 172.21.15.117:0/4113041241 >> [v2:172.21.15.117:6808/146434,v1:172.21.15.117:6809/146434] conn(0x7fea44072fe0 0x7fea440753f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.406+0000 7fea5d6c8700 1 -- 172.21.15.117:0/4113041241 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fea4406a730 msgr2=0x7fea4406cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.406+0000 7fea5d6c8700 1 --2- 172.21.15.117:0/4113041241 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fea4406a730 0x7fea4406cbe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0015f0 tx=0x7fea4c007ae0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.406+0000 7fea5d6c8700 1 -- 172.21.15.117:0/4113041241 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea58149220 msgr2=0x7fea5814cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.406+0000 7fea5d6c8700 1 --2- 172.21.15.117:0/4113041241 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea58149220 0x7fea5814cb20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fea4800e9b0 tx=0x7fea4800ed70 comp rx=0 tx=0).stop 2023-07-19T20:44:44.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.406+0000 7fea577fe700 1 -- 172.21.15.117:0/4113041241 reap_dead start 2023-07-19T20:44:44.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.408+0000 7fea5d6c8700 1 -- 172.21.15.117:0/4113041241 shutdown_connections 2023-07-19T20:44:44.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.408+0000 7fea5d6c8700 1 -- 172.21.15.117:0/4113041241 >> 172.21.15.117:0/4113041241 conn(0x7fea5806b1f0 msgr2=0x7fea580bbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.414+0000 7fc1f811f700 1 -- 172.21.15.117:0/2520461711 shutdown_connections 2023-07-19T20:44:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.414+0000 7f702618d700 1 -- 172.21.15.117:0/2777041619 --> [v2:172.21.15.117:6820/146436,v1:172.21.15.117:6822/146436] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7020145280 con 0x7f70201f1130 2023-07-19T20:44:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.414+0000 7fc1f811f700 1 -- 172.21.15.117:0/2520461711 wait complete. 2023-07-19T20:44:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.414+0000 7f1134f40700 1 -- 172.21.15.117:0/2078285538 --> [v2:172.21.15.117:6816/146439,v1:172.21.15.117:6817/146439] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1130072210 con 0x7f1110072f10 2023-07-19T20:44:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.414+0000 7f111effd700 1 -- 172.21.15.117:0/2078285538 <== osd.3 v2:172.21.15.117:6816/146439 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1128018cf0 con 0x7f1110072f10 2023-07-19T20:44:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.414+0000 7f7017fff700 1 -- 172.21.15.117:0/2777041619 <== osd.0 v2:172.21.15.117:6820/146436 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7020145280 con 0x7f70201f1130 2023-07-19T20:44:44.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.415+0000 7fea5d6c8700 1 -- 172.21.15.117:0/4113041241 shutdown_connections 2023-07-19T20:44:44.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.415+0000 7fea5d6c8700 1 -- 172.21.15.117:0/4113041241 wait complete. 2023-07-19T20:44:44.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.416+0000 7f702618d700 1 -- 172.21.15.117:0/2777041619 >> [v2:172.21.15.117:6820/146436,v1:172.21.15.117:6822/146436] conn(0x7f70201f1130 msgr2=0x7f70201de560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.416+0000 7f702618d700 1 --2- 172.21.15.117:0/2777041619 >> [v2:172.21.15.117:6820/146436,v1:172.21.15.117:6822/146436] conn(0x7f70201f1130 0x7f70201de560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.416+0000 7f1134f40700 1 -- 172.21.15.117:0/2078285538 >> [v2:172.21.15.117:6816/146439,v1:172.21.15.117:6817/146439] conn(0x7f1110072f10 msgr2=0x7f1110075320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.416+0000 7f1134f40700 1 --2- 172.21.15.117:0/2078285538 >> [v2:172.21.15.117:6816/146439,v1:172.21.15.117:6817/146439] conn(0x7f1110072f10 0x7f1110075320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.416+0000 7f1134f40700 1 -- 172.21.15.117:0/2078285538 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f111006a660 msgr2=0x7f111006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.416+0000 7f1134f40700 1 --2- 172.21.15.117:0/2078285538 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f111006a660 0x7f111006cb10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f113006bee0 tx=0x7f112000b2a0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.416+0000 7f1134f40700 1 -- 172.21.15.117:0/2078285538 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f113006baf0 msgr2=0x7f11301d1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.416+0000 7f1134f40700 1 --2- 172.21.15.117:0/2078285538 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f113006baf0 0x7f11301d1a40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f112401b040 tx=0x7f1124004750 comp rx=0 tx=0).stop 2023-07-19T20:44:44.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.416+0000 7f112ed9d700 1 -- 172.21.15.117:0/2078285538 reap_dead start 2023-07-19T20:44:44.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.416+0000 7f1134f40700 1 -- 172.21.15.117:0/2078285538 shutdown_connections 2023-07-19T20:44:44.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.416+0000 7f1134f40700 1 -- 172.21.15.117:0/2078285538 >> 172.21.15.117:0/2078285538 conn(0x7f11300bdc00 msgr2=0x7f11300b9020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.418+0000 7f702618d700 1 -- 172.21.15.117:0/2777041619 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f700806a660 msgr2=0x7f700806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.418+0000 7f702618d700 1 --2- 172.21.15.117:0/2777041619 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f700806a660 0x7f700806cb10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7010000f60 tx=0x7f7010007a40 comp rx=0 tx=0).stop 2023-07-19T20:44:44.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.418+0000 7f702618d700 1 -- 172.21.15.117:0/2777041619 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70200baa40 msgr2=0x7f702013f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.418+0000 7f702618d700 1 --2- 172.21.15.117:0/2777041619 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70200baa40 0x7f702013f2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f700c00b4a0 tx=0x7f700c00b860 comp rx=0 tx=0).stop 2023-07-19T20:44:44.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.418+0000 7f701ffff700 1 -- 172.21.15.117:0/2777041619 reap_dead start 2023-07-19T20:44:44.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.419+0000 7f1134f40700 1 -- 172.21.15.117:0/2078285538 shutdown_connections 2023-07-19T20:44:44.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.419+0000 7f1134f40700 1 -- 172.21.15.117:0/2078285538 wait complete. 2023-07-19T20:44:44.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.419+0000 7ff90e296700 1 -- 172.21.15.117:0/550930906 --> [v2:172.21.15.124:6824/146717,v1:172.21.15.124:6825/146717] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff9080bfff0 con 0x7ff8f0073010 2023-07-19T20:44:44.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.420+0000 7f702618d700 1 -- 172.21.15.117:0/2777041619 shutdown_connections 2023-07-19T20:44:44.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.420+0000 7f702618d700 1 -- 172.21.15.117:0/2777041619 >> 172.21.15.117:0/2777041619 conn(0x7f70200be4b0 msgr2=0x7f7020146440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.420+0000 7f702618d700 1 -- 172.21.15.117:0/2777041619 shutdown_connections 2023-07-19T20:44:44.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.420+0000 7f702618d700 1 -- 172.21.15.117:0/2777041619 wait complete. 2023-07-19T20:44:44.468 INFO:teuthology.orchestra.run.smithi117.stdout:60129542149 2023-07-19T20:44:44.469 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-19T20:44:44.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.426+0000 7ff904ff9700 1 -- 172.21.15.117:0/550930906 <== osd.7 v2:172.21.15.124:6824/146717 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff90000be40 con 0x7ff8f0073010 2023-07-19T20:44:44.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.427+0000 7ff90e296700 1 -- 172.21.15.117:0/550930906 >> [v2:172.21.15.124:6824/146717,v1:172.21.15.124:6825/146717] conn(0x7ff8f0073010 msgr2=0x7ff8f0075420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.427+0000 7ff90e296700 1 --2- 172.21.15.117:0/550930906 >> [v2:172.21.15.124:6824/146717,v1:172.21.15.124:6825/146717] conn(0x7ff8f0073010 0x7ff8f0075420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.470 INFO:teuthology.orchestra.run.smithi117.stdout:60129542149 2023-07-19T20:44:44.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-19T20:44:44.472 INFO:teuthology.orchestra.run.smithi117.stdout:60129542151 2023-07-19T20:44:44.472 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-19T20:44:44.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.427+0000 7ff90e296700 1 -- 172.21.15.117:0/550930906 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff8f006a7e0 msgr2=0x7ff8f006cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.427+0000 7ff90e296700 1 --2- 172.21.15.117:0/550930906 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff8f006a7e0 0x7ff8f006cc90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8006fd0 tx=0x7ff8f8008040 comp rx=0 tx=0).stop 2023-07-19T20:44:44.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.427+0000 7ff90e296700 1 -- 172.21.15.117:0/550930906 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9080bebe0 msgr2=0x7ff9080b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.427+0000 7ff90e296700 1 --2- 172.21.15.117:0/550930906 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9080bebe0 0x7ff9080b6d80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00c780 tx=0x7ff8fc00ca90 comp rx=0 tx=0).stop 2023-07-19T20:44:44.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.427+0000 7ff90c833700 1 -- 172.21.15.117:0/550930906 reap_dead start 2023-07-19T20:44:44.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.427+0000 7ff90e296700 1 -- 172.21.15.117:0/550930906 shutdown_connections 2023-07-19T20:44:44.474 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.427+0000 7ff90e296700 1 -- 172.21.15.117:0/550930906 >> 172.21.15.117:0/550930906 conn(0x7ff9080a26a0 msgr2=0x7ff9080a2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.474 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.427+0000 7ff90e296700 1 -- 172.21.15.117:0/550930906 shutdown_connections 2023-07-19T20:44:44.474 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.427+0000 7ff90e296700 1 -- 172.21.15.117:0/550930906 wait complete. 2023-07-19T20:44:44.475 INFO:teuthology.orchestra.run.smithi117.stdout:60129542150 2023-07-19T20:44:44.475 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-19T20:44:44.477 INFO:teuthology.orchestra.run.smithi117.stdout:60129542150 2023-07-19T20:44:44.478 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-19T20:44:44.479 INFO:teuthology.orchestra.run.smithi117.stdout:60129542150 2023-07-19T20:44:44.479 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-19T20:44:44.480 INFO:teuthology.orchestra.run.smithi117.stdout:60129542150 2023-07-19T20:44:44.480 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-19T20:44:44.481 INFO:teuthology.orchestra.run.smithi117.stdout:60129542150 2023-07-19T20:44:44.481 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-19T20:44:44.722 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.729+0000 7f4d870ff700 1 Processor -- start 2023-07-19T20:44:44.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.729+0000 7f4d870ff700 1 -- start start 2023-07-19T20:44:44.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.730+0000 7f4d870ff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4d800b3de0 0x7f4d800b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.730+0000 7f4d870ff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4d80140950 0x7f4d800b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.730+0000 7f4d870ff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d80140da0 0x7f4d80146920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.730+0000 7f4d870ff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8014a800 con 0x7f4d800b3de0 2023-07-19T20:44:44.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.730+0000 7f4d870ff700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d80149ed0 con 0x7f4d80140950 2023-07-19T20:44:44.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.730+0000 7f4d870ff700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8014a1b0 con 0x7f4d80140da0 2023-07-19T20:44:44.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.728+0000 7fdf3a7d1700 1 Processor -- start 2023-07-19T20:44:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.728+0000 7fdf3a7d1700 1 -- start start 2023-07-19T20:44:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.730+0000 7fdf3a7d1700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf34072990 0x7fdf340b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.730+0000 7fdf3a7d1700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf340b7630 con 0x7fdf340b8da0 2023-07-19T20:44:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.730+0000 7fdf3a7d1700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf340bd590 con 0x7fdf34149220 2023-07-19T20:44:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.730+0000 7fdf3a7d1700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf340b8310 con 0x7fdf34072990 2023-07-19T20:44:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.730+0000 7fdf38d6e700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fdf340b8da0 0x7fdf34159590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41262/0 (socket says 172.21.15.117:41262) 2023-07-19T20:44:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.730+0000 7fdf38d6e700 1 -- 172.21.15.117:0/1139842881 learned_addr learned my addr 172.21.15.117:0/1139842881 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.730+0000 7fdf32ffd700 1 -- 172.21.15.117:0/1139842881 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426244524 0 0) 0x7fdf340b7630 con 0x7fdf340b8da0 2023-07-19T20:44:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.730+0000 7fdf32ffd700 1 -- 172.21.15.117:0/1139842881 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf1c0035b0 con 0x7fdf340b8da0 2023-07-19T20:44:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf337fe700 1 --2- 172.21.15.117:0/1139842881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf34072990 0x7fdf340b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7f4d8569c700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d80140da0 0x7f4d80146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7f4d8569c700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d80140da0 0x7f4d80146920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:39662/0 (socket says 172.21.15.117:39662) 2023-07-19T20:44:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7f4d8569c700 1 -- 172.21.15.117:0/2358473932 learned_addr learned my addr 172.21.15.117:0/2358473932 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf32ffd700 1 -- 172.21.15.117:0/1139842881 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 421994944 0 0) 0x7fdf1c0035b0 con 0x7fdf340b8da0 2023-07-19T20:44:44.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf32ffd700 1 -- 172.21.15.117:0/1139842881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf34072990 msgr2=0x7fdf340b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf32ffd700 1 --2- 172.21.15.117:0/1139842881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf34072990 0x7fdf340b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf32ffd700 1 -- 172.21.15.117:0/1139842881 >> v1:172.21.15.124:6789/0 conn(0x7fdf34149220 legacy=0x7fdf340bce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf32ffd700 1 -- 172.21.15.117:0/1139842881 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf341523a0 con 0x7fdf340b8da0 2023-07-19T20:44:44.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf32ffd700 1 -- 172.21.15.117:0/1139842881 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7fdf2c0019f0 con 0x7fdf340b8da0 2023-07-19T20:44:44.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf32ffd700 1 -- 172.21.15.117:0/1139842881 >> v1:172.21.15.117:6789/0 conn(0x7fdf340b8da0 legacy=0x7fdf34159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.730 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf32ffd700 1 --2- 172.21.15.117:0/1139842881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf1c003a30 0x7fdf1c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.730 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7f4d8569c700 1 -- 172.21.15.117:0/2358473932 >> v2:172.21.15.124:3300/0 conn(0x7f4d80140950 msgr2=0x7f4d800b4e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-19T20:44:44.730 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7f4d8569c700 1 --2- 172.21.15.117:0/2358473932 >> v2:172.21.15.124:3300/0 conn(0x7f4d80140950 0x7f4d800b4e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.731 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7f4d8569c700 1 -- 172.21.15.117:0/2358473932 >> v2:172.21.15.117:3300/0 conn(0x7f4d800b3de0 msgr2=0x7f4d800b70f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-19T20:44:44.731 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7f4d8569c700 1 --2- 172.21.15.117:0/2358473932 >> v2:172.21.15.117:3300/0 conn(0x7f4d800b3de0 0x7f4d800b70f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.731 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7f4d8569c700 1 -- 172.21.15.117:0/2358473932 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8014a490 con 0x7f4d80140da0 2023-07-19T20:44:44.731 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7f4d8569c700 1 --2- 172.21.15.117:0/2358473932 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d80140da0 0x7f4d80146920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4d8006ecf0 tx=0x7f4d7800d650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbc20be81232387e server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.732 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf32ffd700 1 --2- 172.21.15.117:0/1139842881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf1c004850 0x7fdf1c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf32ffd700 1 --2- 172.21.15.117:0/1139842881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf1c005320 0x7fdf1c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf32ffd700 1 -- 172.21.15.117:0/1139842881 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c00c160 con 0x7fdf1c003a30 2023-07-19T20:44:44.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf32ffd700 1 -- 172.21.15.117:0/1139842881 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c00c2d0 con 0x7fdf1c004850 2023-07-19T20:44:44.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf32ffd700 1 -- 172.21.15.117:0/1139842881 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c00c490 con 0x7fdf1c005320 2023-07-19T20:44:44.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf33fff700 1 --2- 172.21.15.117:0/1139842881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf1c003a30 0x7fdf1c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf38d6e700 1 --2- 172.21.15.117:0/1139842881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf1c005320 0x7fdf1c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.731+0000 7fdf337fe700 1 --2- 172.21.15.117:0/1139842881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf1c004850 0x7fdf1c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.732+0000 7fdf33fff700 1 -- 172.21.15.117:0/1139842881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf1c005320 msgr2=0x7fdf1c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.732+0000 7fdf33fff700 1 --2- 172.21.15.117:0/1139842881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf1c005320 0x7fdf1c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.732+0000 7fdf33fff700 1 -- 172.21.15.117:0/1139842881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf1c004850 msgr2=0x7fdf1c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.732+0000 7fdf33fff700 1 --2- 172.21.15.117:0/1139842881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf1c004850 0x7fdf1c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.732+0000 7fdf33fff700 1 -- 172.21.15.117:0/1139842881 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf341523a0 con 0x7fdf1c003a30 2023-07-19T20:44:44.736 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.732+0000 7fdf33fff700 1 --2- 172.21.15.117:0/1139842881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf1c003a30 0x7fdf1c003e40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdf240017c0 tx=0x7fdf1c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a292411fd59ef47 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.732+0000 7f4d777fe700 1 -- 172.21.15.117:0/2358473932 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78007d30 con 0x7f4d80140da0 2023-07-19T20:44:44.737 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.733+0000 7f4d777fe700 1 -- 172.21.15.117:0/2358473932 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d78007e90 con 0x7f4d80140da0 2023-07-19T20:44:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.733+0000 7f4d777fe700 1 -- 172.21.15.117:0/2358473932 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78012710 con 0x7f4d80140da0 2023-07-19T20:44:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.732+0000 7fdf32ffd700 1 -- 172.21.15.117:0/1139842881 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240052d0 con 0x7fdf1c003a30 2023-07-19T20:44:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.732+0000 7fdf32ffd700 1 -- 172.21.15.117:0/1139842881 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf24005430 con 0x7fdf1c003a30 2023-07-19T20:44:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.732+0000 7fdf32ffd700 1 -- 172.21.15.117:0/1139842881 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240038c0 con 0x7fdf1c003a30 2023-07-19T20:44:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.733+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1139842881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf1c003a30 msgr2=0x7fdf1c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.733+0000 7fdf3a7d1700 1 --2- 172.21.15.117:0/1139842881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf1c003a30 0x7fdf1c003e40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdf240017c0 tx=0x7fdf1c005880 comp rx=0 tx=0).stop 2023-07-19T20:44:44.740 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.733+0000 7fdf38d6e700 1 -- 172.21.15.117:0/1139842881 reap_dead start 2023-07-19T20:44:44.740 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.734+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1139842881 shutdown_connections 2023-07-19T20:44:44.740 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.734+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1139842881 >> 172.21.15.117:0/1139842881 conn(0x7fdf3406b1f0 msgr2=0x7fdf340bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.740 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.734+0000 7f4d870ff700 1 -- 172.21.15.117:0/2358473932 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d80140da0 msgr2=0x7f4d80146920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.740 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.734+0000 7f4d870ff700 1 --2- 172.21.15.117:0/2358473932 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d80140da0 0x7f4d80146920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4d8006ecf0 tx=0x7f4d7800d650 comp rx=0 tx=0).stop 2023-07-19T20:44:44.741 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.734+0000 7f4d870ff700 1 -- 172.21.15.117:0/2358473932 shutdown_connections 2023-07-19T20:44:44.741 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.734+0000 7f4d870ff700 1 --2- 172.21.15.117:0/2358473932 >> v2:172.21.15.117:3300/0 conn(0x7f4d800b3de0 0x7f4d800b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.741 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.734+0000 7f4d870ff700 1 --2- 172.21.15.117:0/2358473932 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d80140da0 0x7f4d80146920 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.741 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.734+0000 7f4d870ff700 1 --2- 172.21.15.117:0/2358473932 >> v2:172.21.15.124:3300/0 conn(0x7f4d80140950 0x7f4d800b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.741 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.734+0000 7f4d870ff700 1 -- 172.21.15.117:0/2358473932 >> 172.21.15.117:0/2358473932 conn(0x7f4d8006b1f0 msgr2=0x7f4d800bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.742 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.734+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1139842881 shutdown_connections 2023-07-19T20:44:44.743 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.734+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1139842881 wait complete. 2023-07-19T20:44:44.743 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.734+0000 7f22b320b700 1 Processor -- start 2023-07-19T20:44:44.743 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.735+0000 7f7a910a9700 1 Processor -- start 2023-07-19T20:44:44.744 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.735+0000 7f7a910a9700 1 -- start start 2023-07-19T20:44:44.744 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.735+0000 7f4d870ff700 1 -- 172.21.15.117:0/2358473932 shutdown_connections 2023-07-19T20:44:44.745 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.734+0000 7f22b320b700 1 -- start start 2023-07-19T20:44:44.745 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.735+0000 7f22b320b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f22ac0b3de0 0x7f22ac0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.745 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.735+0000 7f22b320b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f22ac140da0 0x7f22ac151260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.745 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.735+0000 7f22b320b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ac14a800 con 0x7f22ac140950 2023-07-19T20:44:44.745 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.735+0000 7f22b320b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac149ed0 con 0x7f22ac0b3de0 2023-07-19T20:44:44.745 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.735+0000 7f22b320b700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac14a1b0 con 0x7f22ac140da0 2023-07-19T20:44:44.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.735+0000 7fdf3a7d1700 1 Processor -- start 2023-07-19T20:44:44.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7fdf3a7d1700 1 -- start start 2023-07-19T20:44:44.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7f22abfff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f22ac140950 0x7f22ac0b4e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41268/0 (socket says 172.21.15.117:41268) 2023-07-19T20:44:44.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7f22abfff700 1 -- 172.21.15.117:0/3364165186 learned_addr learned my addr 172.21.15.117:0/3364165186 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:44.747 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7f7a910a9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a8c0b4560 0x7f7a8c0b5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.748 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7f7a910a9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8c0b4ba0 con 0x7f7a8c0b68c0 2023-07-19T20:44:44.749 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7f7a910a9700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8c0b88e0 con 0x7f7a8c0bd0f0 2023-07-19T20:44:44.749 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7f7a910a9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0b8bc0 con 0x7f7a8c0b4560 2023-07-19T20:44:44.749 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7f7a8a59c700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7a8c0b68c0 0x7f7a8c153170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41276/0 (socket says 172.21.15.117:41276) 2023-07-19T20:44:44.749 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7f7a8a59c700 1 -- 172.21.15.117:0/992159577 learned_addr learned my addr 172.21.15.117:0/992159577 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:44.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7fdf3a7d1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf34134080 0x7fdf3412f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7fdf3a7d1700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf3406fa80 0x7fdf341332f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7fdf3a7d1700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf3414f200 0x7fdf34131fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7fdf3a7d1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3406fef0 con 0x7fdf34134080 2023-07-19T20:44:44.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7fdf3a7d1700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3406ed40 con 0x7fdf3414f200 2023-07-19T20:44:44.751 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7fdf3a7d1700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3412f120 con 0x7fdf3406fa80 2023-07-19T20:44:44.751 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7fdf337fe700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf3406fa80 0x7fdf341332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.751 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7fdf38d6e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf3414f200 0x7fdf34131fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.751 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7fdf337fe700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf3406fa80 0x7fdf341332f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:39694/0 (socket says 172.21.15.117:39694) 2023-07-19T20:44:44.751 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7fdf38d6e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf3414f200 0x7fdf34131fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58132/0 (socket says 172.21.15.117:58132) 2023-07-19T20:44:44.751 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7fdf337fe700 1 -- 172.21.15.117:0/1656236914 learned_addr learned my addr 172.21.15.117:0/1656236914 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.752 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7f3a49b26700 1 Processor -- start 2023-07-19T20:44:44.752 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.736+0000 7f22b17a8700 1 --2- 172.21.15.117:0/3364165186 >> v2:172.21.15.124:3300/0 conn(0x7f22ac140da0 0x7f22ac151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.752 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f3a49b26700 1 -- start start 2023-07-19T20:44:44.753 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 -- 172.21.15.117:0/3364165186 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170000757 0 0) 0x7f22ac14a800 con 0x7f22ac140950 2023-07-19T20:44:44.753 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 -- 172.21.15.117:0/3364165186 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22940034d0 con 0x7f22ac140950 2023-07-19T20:44:44.753 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7fdf33fff700 1 --2- 172.21.15.117:0/1656236914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf34134080 0x7fdf3412f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.754 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f7a8b59e700 1 --2- 172.21.15.117:0/992159577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a8c0b4560 0x7f7a8c0b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.754 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f7a89d9b700 1 -- 172.21.15.117:0/992159577 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668029040 0 0) 0x7f7a8c0b88e0 con 0x7f7a8c0bd0f0 2023-07-19T20:44:44.754 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f7a89d9b700 1 -- 172.21.15.117:0/992159577 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a780035b0 con 0x7f7a8c0bd0f0 2023-07-19T20:44:44.755 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7fdf337fe700 1 -- 172.21.15.117:0/1656236914 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf3414f200 msgr2=0x7fdf34131fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.755 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7fdf337fe700 1 --2- 172.21.15.117:0/1656236914 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf3414f200 0x7fdf34131fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.755 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7fdf337fe700 1 -- 172.21.15.117:0/1656236914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf34134080 msgr2=0x7fdf3412f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.755 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7fdf337fe700 1 --2- 172.21.15.117:0/1656236914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf34134080 0x7fdf3412f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.755 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7fdf337fe700 1 -- 172.21.15.117:0/1656236914 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3406ef90 con 0x7fdf3406fa80 2023-07-19T20:44:44.756 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7fdf33fff700 1 --2- 172.21.15.117:0/1656236914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf34134080 0x7fdf3412f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:44.756 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f7a8b59e700 1 -- 172.21.15.117:0/992159577 >> v1:172.21.15.124:6789/0 conn(0x7f7a8c0bd0f0 legacy=0x7f7a8c144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.756 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f7a8b59e700 1 -- 172.21.15.117:0/992159577 >> v1:172.21.15.117:6789/0 conn(0x7f7a8c0b68c0 legacy=0x7f7a8c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.756 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f7a8b59e700 1 -- 172.21.15.117:0/992159577 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c0b8ea0 con 0x7f7a8c0b4560 2023-07-19T20:44:44.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7fdf337fe700 1 --2- 172.21.15.117:0/1656236914 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf3406fa80 0x7fdf341332f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800f810 tx=0x7fdf2800fb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7fdf30ff9700 1 -- 172.21.15.117:0/1656236914 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28013850 con 0x7fdf3406fa80 2023-07-19T20:44:44.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7fdf30ff9700 1 -- 172.21.15.117:0/1656236914 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2800c040 con 0x7fdf3406fa80 2023-07-19T20:44:44.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7fdf30ff9700 1 -- 172.21.15.117:0/1656236914 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28013bd0 con 0x7fdf3406fa80 2023-07-19T20:44:44.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 -- 172.21.15.117:0/3364165186 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2892514320 0 0) 0x7f22940034d0 con 0x7f22ac140950 2023-07-19T20:44:44.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 -- 172.21.15.117:0/3364165186 >> v2:172.21.15.124:3300/0 conn(0x7f22ac140da0 msgr2=0x7f22ac151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 --2- 172.21.15.117:0/3364165186 >> v2:172.21.15.124:3300/0 conn(0x7f22ac140da0 0x7f22ac151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 -- 172.21.15.117:0/3364165186 >> v2:172.21.15.117:3300/0 conn(0x7f22ac0b3de0 msgr2=0x7f22ac0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 --2- 172.21.15.117:0/3364165186 >> v2:172.21.15.117:3300/0 conn(0x7f22ac0b3de0 0x7f22ac0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 -- 172.21.15.117:0/3364165186 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac14a490 con 0x7f22ac140950 2023-07-19T20:44:44.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 -- 172.21.15.117:0/3364165186 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f22a0004d60 con 0x7f22ac140950 2023-07-19T20:44:44.759 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 -- 172.21.15.117:0/3364165186 >> v1:172.21.15.117:6789/0 conn(0x7f22ac140950 legacy=0x7f22ac0b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.759 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 --2- 172.21.15.117:0/3364165186 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2294003b40 0x7f2294003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.759 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 --2- 172.21.15.117:0/3364165186 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22940068d0 0x7f2294008d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.759 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 --2- 172.21.15.117:0/3364165186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22940094c0 0x7f2294009960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.759 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 -- 172.21.15.117:0/3364165186 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac149ed0 con 0x7f22940094c0 2023-07-19T20:44:44.759 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 -- 172.21.15.117:0/3364165186 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac14a1b0 con 0x7f22940068d0 2023-07-19T20:44:44.759 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f22ab7fe700 1 -- 172.21.15.117:0/3364165186 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229400a2b0 con 0x7f2294003b40 2023-07-19T20:44:44.760 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f3a49b26700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3a4406baf0 0x7f3a441447e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.760 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f3a49b26700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3a44073530 0x7f3a4406f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.760 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f3a49b26700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a440b8a70 con 0x7f3a440b9230 2023-07-19T20:44:44.760 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f3a49b26700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a44070db0 con 0x7f3a4406baf0 2023-07-19T20:44:44.760 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.737+0000 7f3a49b26700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4406b6a0 con 0x7f3a44073530 2023-07-19T20:44:44.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f22b0fa7700 1 --2- 172.21.15.117:0/3364165186 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2294003b40 0x7f2294003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f3a43fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3a44073530 0x7f3a4406f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f7a8b59e700 1 --2- 172.21.15.117:0/992159577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a8c0b4560 0x7f7a8c0b5030 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009dc0 tx=0x7f7a8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=969d5a8e8ed57eba server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.762 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f3a43fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3a44073530 0x7f3a4406f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58160/0 (socket says 172.21.15.117:58160) 2023-07-19T20:44:44.762 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f3a43fff700 1 -- 172.21.15.117:0/2142397684 learned_addr learned my addr 172.21.15.117:0/2142397684 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.762 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f3a437fe700 1 --2- 172.21.15.117:0/2142397684 >> v2:172.21.15.117:3300/0 conn(0x7f3a4406baf0 0x7f3a441447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.762 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f22abfff700 1 --2- 172.21.15.117:0/3364165186 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22940068d0 0x7f2294008d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f22b17a8700 1 --2- 172.21.15.117:0/3364165186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22940094c0 0x7f2294009960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f7a89d9b700 1 -- 172.21.15.117:0/992159577 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8400e070 con 0x7f7a8c0b4560 2023-07-19T20:44:44.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f7a89d9b700 1 -- 172.21.15.117:0/992159577 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a84003a20 con 0x7f7a8c0b4560 2023-07-19T20:44:44.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f7a89d9b700 1 -- 172.21.15.117:0/992159577 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84003dd0 con 0x7f7a8c0b4560 2023-07-19T20:44:44.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1656236914 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf340700e0 con 0x7fdf3406fa80 2023-07-19T20:44:44.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f3a427fc700 1 -- 172.21.15.117:0/2142397684 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610192165 0 0) 0x7f3a440b8a70 con 0x7f3a440b9230 2023-07-19T20:44:44.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f3a427fc700 1 -- 172.21.15.117:0/2142397684 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a2c0035b0 con 0x7f3a440b9230 2023-07-19T20:44:44.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f22abfff700 1 -- 172.21.15.117:0/3364165186 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2294003b40 msgr2=0x7f2294003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.765 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f22abfff700 1 --2- 172.21.15.117:0/3364165186 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2294003b40 0x7f2294003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.765 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f22abfff700 1 -- 172.21.15.117:0/3364165186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22940094c0 msgr2=0x7f2294009960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.765 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f22abfff700 1 --2- 172.21.15.117:0/3364165186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22940094c0 0x7f2294009960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.765 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f22abfff700 1 -- 172.21.15.117:0/3364165186 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22940034d0 con 0x7f22940068d0 2023-07-19T20:44:44.765 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.738+0000 7f22b17a8700 1 -- 172.21.15.117:0/3364165186 reap_dead start 2023-07-19T20:44:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a427fc700 1 -- 172.21.15.117:0/2142397684 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2903015087 0 0) 0x7f3a2c0035b0 con 0x7f3a440b9230 2023-07-19T20:44:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a427fc700 1 -- 172.21.15.117:0/2142397684 >> v2:172.21.15.124:3300/0 conn(0x7f3a44073530 msgr2=0x7f3a4406f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a427fc700 1 --2- 172.21.15.117:0/2142397684 >> v2:172.21.15.124:3300/0 conn(0x7f3a44073530 0x7f3a4406f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a427fc700 1 -- 172.21.15.117:0/2142397684 >> v2:172.21.15.117:3300/0 conn(0x7f3a4406baf0 msgr2=0x7f3a441447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a427fc700 1 --2- 172.21.15.117:0/2142397684 >> v2:172.21.15.117:3300/0 conn(0x7f3a4406baf0 0x7f3a441447e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a427fc700 1 -- 172.21.15.117:0/2142397684 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a44072210 con 0x7f3a440b9230 2023-07-19T20:44:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a427fc700 1 -- 172.21.15.117:0/2142397684 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f3a34001670 con 0x7f3a440b9230 2023-07-19T20:44:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f22abfff700 1 --2- 172.21.15.117:0/3364165186 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22940068d0 0x7f2294008d50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f22a0001e10 tx=0x7f2294003780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e6319a5decb0f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f7a910a9700 1 -- 172.21.15.117:0/992159577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a8c0b4560 msgr2=0x7f7a8c0b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f7a910a9700 1 --2- 172.21.15.117:0/992159577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a8c0b4560 0x7f7a8c0b5030 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009dc0 tx=0x7f7a8400b330 comp rx=0 tx=0).stop 2023-07-19T20:44:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a427fc700 1 -- 172.21.15.117:0/2142397684 >> v1:172.21.15.117:6789/0 conn(0x7f3a440b9230 legacy=0x7f3a44070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a427fc700 1 --2- 172.21.15.117:0/2142397684 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3a2c003a00 0x7f3a2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a427fc700 1 --2- 172.21.15.117:0/2142397684 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3a2c0043f0 0x7f3a2c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a427fc700 1 --2- 172.21.15.117:0/2142397684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a2c004fd0 0x7f3a2c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a427fc700 1 -- 172.21.15.117:0/2142397684 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4406b6a0 con 0x7f3a2c004fd0 2023-07-19T20:44:44.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a427fc700 1 -- 172.21.15.117:0/2142397684 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c00bf50 con 0x7f3a2c0043f0 2023-07-19T20:44:44.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a427fc700 1 -- 172.21.15.117:0/2142397684 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c00c0c0 con 0x7f3a2c003a00 2023-07-19T20:44:44.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1656236914 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3412edb0 con 0x7fdf3406fa80 2023-07-19T20:44:44.770 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a437fe700 1 --2- 172.21.15.117:0/2142397684 >> v2:172.21.15.117:3300/0 conn(0x7f3a4406baf0 0x7f3a441447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:44.770 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a43fff700 1 --2- 172.21.15.117:0/2142397684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a2c004fd0 0x7f3a2c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.770 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a437fe700 1 --2- 172.21.15.117:0/2142397684 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3a2c003a00 0x7f3a2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.770 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a43fff700 1 -- 172.21.15.117:0/2142397684 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3a2c003a00 msgr2=0x7f3a2c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.770 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a43fff700 1 --2- 172.21.15.117:0/2142397684 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3a2c003a00 0x7f3a2c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.770 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a43fff700 1 -- 172.21.15.117:0/2142397684 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3a2c0043f0 msgr2=0x7f3a2c0048b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-19T20:44:44.771 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f3a43fff700 1 --2- 172.21.15.117:0/2142397684 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3a2c0043f0 0x7f3a2c0048b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.771 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.740+0000 7f3a43fff700 1 -- 172.21.15.117:0/2142397684 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c0035b0 con 0x7f3a2c004fd0 2023-07-19T20:44:44.771 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.740+0000 7f3a43fff700 1 -- 172.21.15.117:0/2142397684 reap_dead start 2023-07-19T20:44:44.771 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.740+0000 7f3a43fff700 1 --2- 172.21.15.117:0/2142397684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a2c004fd0 0x7f3a2c00ba10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00e1c0 tx=0x7f3a2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e70231c2e94e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.771 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f22ab7fe700 1 -- 172.21.15.117:0/3364165186 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a00018d0 con 0x7f22940068d0 2023-07-19T20:44:44.771 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f22ab7fe700 1 -- 172.21.15.117:0/3364165186 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a000de30 con 0x7f22940068d0 2023-07-19T20:44:44.772 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f22ab7fe700 1 -- 172.21.15.117:0/3364165186 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000f640 con 0x7f22940068d0 2023-07-19T20:44:44.772 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f7a910a9700 1 -- 172.21.15.117:0/992159577 shutdown_connections 2023-07-19T20:44:44.772 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f7a910a9700 1 --2- 172.21.15.117:0/992159577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a8c0b4560 0x7f7a8c0b5030 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.772 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f7a910a9700 1 -- 172.21.15.117:0/992159577 >> 172.21.15.117:0/992159577 conn(0x7f7a8c06b1f0 msgr2=0x7f7a8c0bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.772 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f7a910a9700 1 -- 172.21.15.117:0/992159577 shutdown_connections 2023-07-19T20:44:44.773 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.740+0000 7f3a427fc700 1 -- 172.21.15.117:0/2142397684 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c0092d0 con 0x7f3a2c004fd0 2023-07-19T20:44:44.773 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.740+0000 7f3a427fc700 1 -- 172.21.15.117:0/2142397684 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c00f040 con 0x7f3a2c004fd0 2023-07-19T20:44:44.773 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.740+0000 7f3a427fc700 1 -- 172.21.15.117:0/2142397684 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00ecc0 con 0x7f3a2c004fd0 2023-07-19T20:44:44.773 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.740+0000 7f22b320b700 1 -- 172.21.15.117:0/3364165186 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22940068d0 msgr2=0x7f2294008d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.774 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.740+0000 7f22b320b700 1 --2- 172.21.15.117:0/3364165186 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22940068d0 0x7f2294008d50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f22a0001e10 tx=0x7f2294003780 comp rx=0 tx=0).stop 2023-07-19T20:44:44.774 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.739+0000 7f7a910a9700 1 -- 172.21.15.117:0/992159577 wait complete. 2023-07-19T20:44:44.774 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1656236914 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf34074890 con 0x7fdf3406fa80 2023-07-19T20:44:44.774 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.740+0000 7faab91fb700 1 Processor -- start 2023-07-19T20:44:44.775 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7faab91fb700 1 -- start start 2023-07-19T20:44:44.775 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7f22b320b700 1 -- 172.21.15.117:0/3364165186 shutdown_connections 2023-07-19T20:44:44.775 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7f22b320b700 1 --2- 172.21.15.117:0/3364165186 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22940068d0 0x7f2294008d50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.775 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7f22b320b700 1 -- 172.21.15.117:0/3364165186 >> 172.21.15.117:0/3364165186 conn(0x7f22ac06b1f0 msgr2=0x7f22ac0bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7f7a910a9700 1 Processor -- start 2023-07-19T20:44:44.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7f7a910a9700 1 -- start start 2023-07-19T20:44:44.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7f3a49b26700 1 -- 172.21.15.117:0/2142397684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a2c004fd0 msgr2=0x7f3a2c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7f3a49b26700 1 --2- 172.21.15.117:0/2142397684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a2c004fd0 0x7f3a2c00ba10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00e1c0 tx=0x7f3a2c005880 comp rx=0 tx=0).stop 2023-07-19T20:44:44.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7f22b320b700 1 -- 172.21.15.117:0/3364165186 shutdown_connections 2023-07-19T20:44:44.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7fdf30ff9700 1 -- 172.21.15.117:0/1656236914 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fdf28013d30 con 0x7fdf3406fa80 2023-07-19T20:44:44.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7f3a49b26700 1 -- 172.21.15.117:0/2142397684 shutdown_connections 2023-07-19T20:44:44.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7f3a49b26700 1 --2- 172.21.15.117:0/2142397684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a2c004fd0 0x7f3a2c00ba10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7f3a49b26700 1 -- 172.21.15.117:0/2142397684 >> 172.21.15.117:0/2142397684 conn(0x7f3a440bdc00 msgr2=0x7f3a440b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7faab91fb700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7faab4149220 0x7faab40b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7faab91fb700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faab40b8da0 0x7faab4159590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.741+0000 7faab91fb700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab40b7630 con 0x7faab4072990 2023-07-19T20:44:44.779 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7faab91fb700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab40b8310 con 0x7faab4149220 2023-07-19T20:44:44.779 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7faab91fb700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab40bd590 con 0x7faab40b8da0 2023-07-19T20:44:44.779 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7f22b320b700 1 -- 172.21.15.117:0/3364165186 wait complete. 2023-07-19T20:44:44.779 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7faab259c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7faab4072990 0x7faab40bce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.117:34416/0 (socket says 172.21.15.117:34416) 2023-07-19T20:44:44.780 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7faab259c700 1 -- 172.21.15.117:0/2417956639 learned_addr learned my addr 172.21.15.117:0/2417956639 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:44.780 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7f7a910a9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a8c0b4560 0x7f7a8c1e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.780 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7f7a910a9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a8c0b68c0 0x7f7a8c14a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.781 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7f7a910a9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a8c0bd0f0 0x7f7a8c1473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.781 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7f7a910a9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c14abb0 con 0x7f7a8c0b4560 2023-07-19T20:44:44.781 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7f7a910a9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c06f7f0 con 0x7f7a8c0b68c0 2023-07-19T20:44:44.781 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7f7a910a9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c1e72a0 con 0x7f7a8c0bd0f0 2023-07-19T20:44:44.781 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7f4d870ff700 1 -- 172.21.15.117:0/2358473932 wait complete. 2023-07-19T20:44:44.782 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7f7a8ad9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a8c0b4560 0x7f7a8c1e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.782 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7fdf30ff9700 1 --2- 172.21.15.117:0/1656236914 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdf2006a660 0x7fdf2006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.782 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7fdf30ff9700 1 -- 172.21.15.117:0/1656236914 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf28088da0 con 0x7fdf3406fa80 2023-07-19T20:44:44.782 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7f7a8ad9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a8c0b4560 0x7f7a8c1e6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43706/0 (socket says 172.21.15.117:43706) 2023-07-19T20:44:44.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7f7a8ad9d700 1 -- 172.21.15.117:0/2822525697 learned_addr learned my addr 172.21.15.117:0/2822525697 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7f7a8a59c700 1 --2- 172.21.15.117:0/2822525697 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a8c0b68c0 0x7f7a8c14a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7f7a8b59e700 1 --2- 172.21.15.117:0/2822525697 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a8c0bd0f0 0x7f7a8c1473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7faab1d9b700 1 -- 172.21.15.117:0/2417956639 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246355842 0 0) 0x7faab40b7630 con 0x7faab4072990 2023-07-19T20:44:44.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.742+0000 7faab1d9b700 1 -- 172.21.15.117:0/2417956639 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa9c0035b0 con 0x7faab4072990 2023-07-19T20:44:44.784 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7f7a8a59c700 1 -- 172.21.15.117:0/2822525697 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a8c0bd0f0 msgr2=0x7f7a8c1473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.784 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7f7a8a59c700 1 --2- 172.21.15.117:0/2822525697 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a8c0bd0f0 0x7f7a8c1473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.784 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7f7a8a59c700 1 -- 172.21.15.117:0/2822525697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a8c0b4560 msgr2=0x7f7a8c1e6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.784 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7f7a8a59c700 1 --2- 172.21.15.117:0/2822525697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a8c0b4560 0x7f7a8c1e6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.784 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7f7a8a59c700 1 -- 172.21.15.117:0/2822525697 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a84009a70 con 0x7f7a8c0b68c0 2023-07-19T20:44:44.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab1d9b700 1 -- 172.21.15.117:0/2417956639 <== mon.1 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245127016 0 0) 0x7faa9c0035b0 con 0x7faab4072990 2023-07-19T20:44:44.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab1d9b700 1 -- 172.21.15.117:0/2417956639 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faab40b8da0 msgr2=0x7faab4159590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-19T20:44:44.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab1d9b700 1 --2- 172.21.15.117:0/2417956639 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faab40b8da0 0x7faab4159590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab1d9b700 1 -- 172.21.15.117:0/2417956639 >> v2:172.21.15.124:3300/0 conn(0x7faab4149220 msgr2=0x7faab40b70f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-19T20:44:44.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab1d9b700 1 --2- 172.21.15.117:0/2417956639 >> v2:172.21.15.124:3300/0 conn(0x7faab4149220 0x7faab40b70f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab1d9b700 1 -- 172.21.15.117:0/2417956639 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab41523a0 con 0x7faab4072990 2023-07-19T20:44:44.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab1d9b700 1 -- 172.21.15.117:0/2417956639 <== mon.1 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7faaa4001670 con 0x7faab4072990 2023-07-19T20:44:44.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab1d9b700 1 -- 172.21.15.117:0/2417956639 >> v1:172.21.15.124:6789/0 conn(0x7faab4072990 legacy=0x7faab40bce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab1d9b700 1 --2- 172.21.15.117:0/2417956639 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa9c003a00 0x7faa9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab1d9b700 1 --2- 172.21.15.117:0/2417956639 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faab40b8da0 0x7faa9c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab1d9b700 1 --2- 172.21.15.117:0/2417956639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa9c004e00 0x7faa9c005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab1d9b700 1 -- 172.21.15.117:0/2417956639 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab40bd590 con 0x7faa9c004e00 2023-07-19T20:44:44.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab1d9b700 1 -- 172.21.15.117:0/2417956639 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c00bc20 con 0x7faa9c003a00 2023-07-19T20:44:44.787 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab1d9b700 1 -- 172.21.15.117:0/2417956639 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c00bde0 con 0x7faab40b8da0 2023-07-19T20:44:44.787 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7fdf33fff700 1 --2- 172.21.15.117:0/1656236914 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdf2006a660 0x7fdf2006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.787 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7f22b320b700 1 Processor -- start 2023-07-19T20:44:44.788 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7f4d870ff700 1 Processor -- start 2023-07-19T20:44:44.788 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab259c700 1 --2- 172.21.15.117:0/2417956639 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faab40b8da0 0x7faa9c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.788 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7f3a49b26700 1 -- 172.21.15.117:0/2142397684 shutdown_connections 2023-07-19T20:44:44.788 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7f3a49b26700 1 -- 172.21.15.117:0/2142397684 wait complete. 2023-07-19T20:44:44.789 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7f50772cc700 1 Processor -- start 2023-07-19T20:44:44.789 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7faab2d9d700 1 --2- 172.21.15.117:0/2417956639 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa9c003a00 0x7faa9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.790 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7faab359e700 1 --2- 172.21.15.117:0/2417956639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa9c004e00 0x7faa9c005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.790 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7faab259c700 1 -- 172.21.15.117:0/2417956639 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa9c003a00 msgr2=0x7faa9c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.790 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7faab259c700 1 --2- 172.21.15.117:0/2417956639 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa9c003a00 0x7faa9c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.790 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7faab259c700 1 -- 172.21.15.117:0/2417956639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa9c004e00 msgr2=0x7faa9c005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.790 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7faab259c700 1 --2- 172.21.15.117:0/2417956639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa9c004e00 0x7faa9c005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.790 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7faab259c700 1 -- 172.21.15.117:0/2417956639 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab41523a0 con 0x7faab40b8da0 2023-07-19T20:44:44.790 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7faab2d9d700 1 --2- 172.21.15.117:0/2417956639 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa9c003a00 0x7faa9c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:44.791 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7faab259c700 1 --2- 172.21.15.117:0/2417956639 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faab40b8da0 0x7faa9c004850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faaa400c3f0 tx=0x7faa9c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c8d33d9e25be6bb server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.791 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7f7a8a59c700 1 --2- 172.21.15.117:0/2822525697 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a8c0b68c0 0x7f7a8c14a130 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c780 tx=0x7f7a7c00ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.792 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7f7a837fe700 1 -- 172.21.15.117:0/2822525697 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c004c80 con 0x7f7a8c0b68c0 2023-07-19T20:44:44.792 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7fdf33fff700 1 --2- 172.21.15.117:0/1656236914 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdf2006a660 0x7fdf2006cb10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdf24005040 tx=0x7fdf24009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.792 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7f7a837fe700 1 -- 172.21.15.117:0/2822525697 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c004de0 con 0x7f7a8c0b68c0 2023-07-19T20:44:44.793 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7f7a837fe700 1 -- 172.21.15.117:0/2822525697 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c007310 con 0x7f7a8c0b68c0 2023-07-19T20:44:44.793 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7f4d870ff700 1 -- start start 2023-07-19T20:44:44.793 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.743+0000 7f22b320b700 1 -- start start 2023-07-19T20:44:44.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f22b320b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22940068d0 0x7f22ac145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f22b320b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22ac1456c0 0x7f22ac1db900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f22b320b700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f22ac1dbe40 0x7f22ac13a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f22b320b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac1dc2c0 con 0x7f22940068d0 2023-07-19T20:44:44.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f22b320b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac146770 con 0x7f22ac1456c0 2023-07-19T20:44:44.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f22b320b700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac146a50 con 0x7f22ac1dbe40 2023-07-19T20:44:44.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f4d870ff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d80140da0 0x7f4d8006f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f4d870ff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d800710a0 0x7f4d80071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f4d870ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d800b21a0 0x7f4d800b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f4d870ff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801dba50 con 0x7f4d800710a0 2023-07-19T20:44:44.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f4d870ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801dc2f0 con 0x7f4d800b21a0 2023-07-19T20:44:44.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f4d870ff700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800a89a0 con 0x7f4d80140da0 2023-07-19T20:44:44.796 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f4d8569c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d800b21a0 0x7f4d800b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.796 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f4d8569c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d800b21a0 0x7f4d800b25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58204/0 (socket says 172.21.15.117:58204) 2023-07-19T20:44:44.796 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f4d8569c700 1 -- 172.21.15.117:0/4221498333 learned_addr learned my addr 172.21.15.117:0/4221498333 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.797 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f22b0fa7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22940068d0 0x7f22ac145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.797 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f22b0fa7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22940068d0 0x7f22ac145180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43718/0 (socket says 172.21.15.117:43718) 2023-07-19T20:44:44.797 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f22b0fa7700 1 -- 172.21.15.117:0/2138048962 learned_addr learned my addr 172.21.15.117:0/2138048962 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.797 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f22b17a8700 1 --2- 172.21.15.117:0/2138048962 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f22ac1dbe40 0x7f22ac13a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.797 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7f7a910a9700 1 -- 172.21.15.117:0/2822525697 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8c14ae00 con 0x7f7a8c0b68c0 2023-07-19T20:44:44.798 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.744+0000 7f7a910a9700 1 -- 172.21.15.117:0/2822525697 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8c1441e0 con 0x7f7a8c0b68c0 2023-07-19T20:44:44.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7fa5021e0700 1 Processor -- start 2023-07-19T20:44:44.802 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f4d8569c700 1 -- 172.21.15.117:0/4221498333 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d80140da0 msgr2=0x7f4d8006f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.802 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f4d84e9b700 1 --2- 172.21.15.117:0/4221498333 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d80140da0 0x7f4d8006f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.802 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7f22abfff700 1 --2- 172.21.15.117:0/2138048962 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22ac1456c0 0x7f22ac1db900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.802 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f3a49b26700 1 Processor -- start 2023-07-19T20:44:44.803 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f4d8569c700 1 --2- 172.21.15.117:0/4221498333 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d80140da0 0x7f4d8006f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.803 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f4d8569c700 1 -- 172.21.15.117:0/4221498333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d800710a0 msgr2=0x7f4d80071510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.803 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f4d8569c700 1 --2- 172.21.15.117:0/4221498333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d800710a0 0x7f4d80071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.803 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f4d8569c700 1 -- 172.21.15.117:0/4221498333 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7800d050 con 0x7f4d800b21a0 2023-07-19T20:44:44.803 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f4d84e9b700 1 --2- 172.21.15.117:0/4221498333 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d80140da0 0x7f4d8006f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:44.804 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f22abfff700 1 -- 172.21.15.117:0/2138048962 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f22ac1dbe40 msgr2=0x7f22ac13a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.804 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f22abfff700 1 --2- 172.21.15.117:0/2138048962 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f22ac1dbe40 0x7f22ac13a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.805 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f22abfff700 1 -- 172.21.15.117:0/2138048962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22940068d0 msgr2=0x7f22ac145180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.805 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f22abfff700 1 --2- 172.21.15.117:0/2138048962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22940068d0 0x7f22ac145180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.805 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f22abfff700 1 -- 172.21.15.117:0/2138048962 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac146d30 con 0x7f22ac1456c0 2023-07-19T20:44:44.805 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.745+0000 7fa5021e0700 1 -- start start 2023-07-19T20:44:44.805 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7fa5021e0700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4fc0bcd80 0x7fa4fc0b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.806 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7fa5021e0700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa4fc0b65c0 0x7fa4fc0b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.806 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7fa5021e0700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4fc0b6f60 con 0x7fa4fc0b8520 2023-07-19T20:44:44.806 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7fa5021e0700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4fc0b4480 con 0x7fa4fc0b65c0 2023-07-19T20:44:44.806 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7fa5021e0700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc0b4660 con 0x7fa4fc0bcd80 2023-07-19T20:44:44.806 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f7a910a9700 1 -- 172.21.15.117:0/2822525697 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a700052e0 con 0x7f7a8c0b68c0 2023-07-19T20:44:44.806 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f7a837fe700 1 -- 172.21.15.117:0/2822525697 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f7a7c007470 con 0x7f7a8c0b68c0 2023-07-19T20:44:44.807 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7fa4fbfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa4fc0b65c0 0x7fa4fc0b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.807 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7fa4fbfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa4fc0b65c0 0x7fa4fc0b6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43748/0 (socket says 172.21.15.117:43748) 2023-07-19T20:44:44.807 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7fa4fbfff700 1 -- 172.21.15.117:0/2922760774 learned_addr learned my addr 172.21.15.117:0/2922760774 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.807 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f3a49b26700 1 -- start start 2023-07-19T20:44:44.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a49b26700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3a2c004fd0 0x7f3a44147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f7a837fe700 1 --2- 172.21.15.117:0/2822525697 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7a6c06a730 0x7f7a6c06cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a49b26700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3a44157220 0x7f3a441eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a49b26700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a441ed3f0 0x7f3a441535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a49b26700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a44147670 con 0x7f3a441ed3f0 2023-07-19T20:44:44.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a49b26700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a441546a0 con 0x7f3a2c004fd0 2023-07-19T20:44:44.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a49b26700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a441ec7a0 con 0x7f3a44157220 2023-07-19T20:44:44.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.746+0000 7f50772cc700 1 -- start start 2023-07-19T20:44:44.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f50772cc700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50700c0d10 0x7f50700be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f50772cc700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50700bdcb0 0x7f50700bf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.812 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f50772cc700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507014ac80 con 0x7f50700be130 2023-07-19T20:44:44.812 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f50772cc700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507014aa90 con 0x7f50700c0d10 2023-07-19T20:44:44.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f50772cc700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507014af60 con 0x7f50700bdcb0 2023-07-19T20:44:44.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f4d8569c700 1 --2- 172.21.15.117:0/4221498333 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d800b21a0 0x7f4d800b25f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4d8014a2f0 tx=0x7f4d78004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a437fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3a2c004fd0 0x7f3a44147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a437fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3a2c004fd0 0x7f3a44147130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58224/0 (socket says 172.21.15.117:58224) 2023-07-19T20:44:44.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a437fe700 1 -- 172.21.15.117:0/1465592910 learned_addr learned my addr 172.21.15.117:0/1465592910 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f7a837fe700 1 -- 172.21.15.117:0/2822525697 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a7c0886c0 con 0x7f7a8c0b68c0 2023-07-19T20:44:44.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f7a8ad9d700 1 --2- 172.21.15.117:0/2822525697 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7a6c06a730 0x7f7a6c06cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7fa4fbfff700 1 -- 172.21.15.117:0/2922760774 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4fc0bcd80 msgr2=0x7fa4fc0b3770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-19T20:44:44.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7fa4fbfff700 1 --2- 172.21.15.117:0/2922760774 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4fc0bcd80 0x7fa4fc0b3770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7fa4fbfff700 1 -- 172.21.15.117:0/2922760774 >> v1:172.21.15.117:6789/0 conn(0x7fa4fc0b8520 legacy=0x7fa4fc1407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7fa4fbfff700 1 -- 172.21.15.117:0/2922760774 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc0b4940 con 0x7fa4fc0b65c0 2023-07-19T20:44:44.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f5074867700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50700bdcb0 0x7f50700bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f5074867700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50700bdcb0 0x7f50700bf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:39778/0 (socket says 172.21.15.117:39778) 2023-07-19T20:44:44.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f5074867700 1 -- 172.21.15.117:0/4132507338 learned_addr learned my addr 172.21.15.117:0/4132507338 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a42ffd700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3a44157220 0x7f3a441eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f22abfff700 1 --2- 172.21.15.117:0/2138048962 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22ac1456c0 0x7f22ac1db900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22a0015000 tx=0x7f22a0005020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f5075068700 1 --2- 172.21.15.117:0/4132507338 >> v2:172.21.15.117:3300/0 conn(0x7f50700c0d10 0x7f50700be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a43fff700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a441ed3f0 0x7f3a441535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a437fe700 1 -- 172.21.15.117:0/1465592910 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3a44157220 msgr2=0x7f3a441eceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a437fe700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3a44157220 0x7f3a441eceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a437fe700 1 -- 172.21.15.117:0/1465592910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a441ed3f0 msgr2=0x7f3a441535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a437fe700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a441ed3f0 0x7f3a441535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a437fe700 1 -- 172.21.15.117:0/1465592910 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a440bbaa0 con 0x7f3a2c004fd0 2023-07-19T20:44:44.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f3a43fff700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a441ed3f0 0x7f3a441535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:44.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7fa4fbfff700 1 --2- 172.21.15.117:0/2922760774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4fc0b65c0 0x7fa4fc0b6a20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400d1e0 tx=0x7fa4f400d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4b203db338733e server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f5074867700 1 -- 172.21.15.117:0/4132507338 >> v2:172.21.15.117:3300/0 conn(0x7f50700c0d10 msgr2=0x7f50700be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:44.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.747+0000 7f5074867700 1 --2- 172.21.15.117:0/4132507338 >> v2:172.21.15.117:3300/0 conn(0x7f50700c0d10 0x7f50700be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.748+0000 7f5074867700 1 -- 172.21.15.117:0/4132507338 >> v1:172.21.15.117:6789/0 conn(0x7f50700be130 legacy=0x7f507014dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.748+0000 7f5074867700 1 -- 172.21.15.117:0/4132507338 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507014b240 con 0x7f50700bdcb0 2023-07-19T20:44:44.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.748+0000 7f7a8ad9d700 1 --2- 172.21.15.117:0/2822525697 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7a6c06a730 0x7f7a6c06cbe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a74001220 tx=0x7f7a74009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.748+0000 7faab1d9b700 1 -- 172.21.15.117:0/2417956639 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4007ca0 con 0x7faab40b8da0 2023-07-19T20:44:44.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.748+0000 7faab1d9b700 1 -- 172.21.15.117:0/2417956639 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa4005960 con 0x7faab40b8da0 2023-07-19T20:44:44.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.748+0000 7faab1d9b700 1 -- 172.21.15.117:0/2417956639 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4005d10 con 0x7faab40b8da0 2023-07-19T20:44:44.822 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.748+0000 7f5074867700 1 --2- 172.21.15.117:0/4132507338 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50700bdcb0 0x7f50700bf800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f506c0098f0 tx=0x7f506c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6331b6fe1d048d6a server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.822 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.748+0000 7f5067fff700 1 -- 172.21.15.117:0/4132507338 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c011830 con 0x7f50700bdcb0 2023-07-19T20:44:44.822 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.748+0000 7f5067fff700 1 -- 172.21.15.117:0/4132507338 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c011990 con 0x7f50700bdcb0 2023-07-19T20:44:44.823 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.748+0000 7f5067fff700 1 -- 172.21.15.117:0/4132507338 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c011d20 con 0x7f50700bdcb0 2023-07-19T20:44:44.823 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.748+0000 7fdf30ff9700 1 -- 172.21.15.117:0/1656236914 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fdf28054230 con 0x7fdf3406fa80 2023-07-19T20:44:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.749+0000 7faab91fb700 1 -- 172.21.15.117:0/2417956639 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faab40b8da0 msgr2=0x7faa9c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.749+0000 7faab91fb700 1 --2- 172.21.15.117:0/2417956639 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faab40b8da0 0x7faa9c004850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faaa400c3f0 tx=0x7faa9c005880 comp rx=0 tx=0).stop 2023-07-19T20:44:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.749+0000 7faab359e700 1 -- 172.21.15.117:0/2417956639 reap_dead start 2023-07-19T20:44:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.748+0000 7f3a437fe700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3a2c004fd0 0x7f3a44147130 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800f580 tx=0x7f3a3800f890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.749+0000 7f50772cc700 1 -- 172.21.15.117:0/4132507338 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50700bdcb0 msgr2=0x7f50700bf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.749+0000 7f50772cc700 1 --2- 172.21.15.117:0/4132507338 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50700bdcb0 0x7f50700bf800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f506c0098f0 tx=0x7f506c009c00 comp rx=0 tx=0).stop 2023-07-19T20:44:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7f50772cc700 1 -- 172.21.15.117:0/4132507338 shutdown_connections 2023-07-19T20:44:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7f50772cc700 1 --2- 172.21.15.117:0/4132507338 >> v2:172.21.15.117:3300/0 conn(0x7f50700c0d10 0x7f50700be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.826 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7f50772cc700 1 --2- 172.21.15.117:0/4132507338 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50700bdcb0 0x7f50700bf800 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.826 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7f50772cc700 1 -- 172.21.15.117:0/4132507338 >> 172.21.15.117:0/4132507338 conn(0x7f5070071c90 msgr2=0x7f5070072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.829 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7fa4faffd700 1 -- 172.21.15.117:0/2922760774 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4010070 con 0x7fa4fc0b65c0 2023-07-19T20:44:44.829 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7fa4faffd700 1 -- 172.21.15.117:0/2922760774 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f400dc60 con 0x7fa4fc0b65c0 2023-07-19T20:44:44.830 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7fa4faffd700 1 -- 172.21.15.117:0/2922760774 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4007b60 con 0x7fa4fc0b65c0 2023-07-19T20:44:44.830 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7f50772cc700 1 -- 172.21.15.117:0/4132507338 shutdown_connections 2023-07-19T20:44:44.830 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7f50772cc700 1 -- 172.21.15.117:0/4132507338 wait complete. 2023-07-19T20:44:44.830 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7fa5021e0700 1 -- 172.21.15.117:0/2922760774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4fc0b65c0 msgr2=0x7fa4fc0b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.831 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7fa5021e0700 1 --2- 172.21.15.117:0/2922760774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4fc0b65c0 0x7fa4fc0b6a20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400d1e0 tx=0x7fa4f400d4f0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.831 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7fa5021e0700 1 -- 172.21.15.117:0/2922760774 shutdown_connections 2023-07-19T20:44:44.831 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7fa5021e0700 1 --2- 172.21.15.117:0/2922760774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4fc0b65c0 0x7fa4fc0b6a20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.831 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7fa5021e0700 1 --2- 172.21.15.117:0/2922760774 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4fc0bcd80 0x7fa4fc0b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.831 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.750+0000 7fa5021e0700 1 -- 172.21.15.117:0/2922760774 >> 172.21.15.117:0/2922760774 conn(0x7fa4fc06d5d0 msgr2=0x7fa4fc073530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.832 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.751+0000 7f50772cc700 1 Processor -- start 2023-07-19T20:44:44.832 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.751+0000 7f50772cc700 1 -- start start 2023-07-19T20:44:44.832 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.751+0000 7fa5021e0700 1 -- 172.21.15.117:0/2922760774 shutdown_connections 2023-07-19T20:44:44.832 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.751+0000 7fa5021e0700 1 -- 172.21.15.117:0/2922760774 wait complete. 2023-07-19T20:44:44.833 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.751+0000 7f3a2bfff700 1 -- 172.21.15.117:0/1465592910 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38014870 con 0x7f3a2c004fd0 2023-07-19T20:44:44.833 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.751+0000 7f50772cc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50700bdcb0 0x7f50700a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.833 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f50772cc700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50700be130 0x7f50701dde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.833 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f50772cc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50700c0d10 0x7f507014dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.834 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f50772cc700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507014d720 con 0x7f50700c0d10 2023-07-19T20:44:44.834 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f50772cc700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700b8b40 con 0x7f50700bdcb0 2023-07-19T20:44:44.834 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f50772cc700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507014d3d0 con 0x7f50700be130 2023-07-19T20:44:44.834 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f3a2bfff700 1 -- 172.21.15.117:0/1465592910 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3800c050 con 0x7f3a2c004fd0 2023-07-19T20:44:44.834 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f3a2bfff700 1 -- 172.21.15.117:0/1465592910 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38014bf0 con 0x7f3a2c004fd0 2023-07-19T20:44:44.835 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f3a49b26700 1 -- 172.21.15.117:0/1465592910 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a44157ce0 con 0x7f3a2c004fd0 2023-07-19T20:44:44.835 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f3a49b26700 1 -- 172.21.15.117:0/1465592910 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a441ec990 con 0x7f3a2c004fd0 2023-07-19T20:44:44.835 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.753+0000 7f3a49b26700 1 -- 172.21.15.117:0/1465592910 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a44157840 con 0x7f3a2c004fd0 2023-07-19T20:44:44.835 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.755+0000 7f3a2bfff700 1 -- 172.21.15.117:0/1465592910 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f3a38014d50 con 0x7f3a2c004fd0 2023-07-19T20:44:44.835 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.755+0000 7f3a2bfff700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3a3006a690 0x7f3a3006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.835 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.756+0000 7f3a2bfff700 1 -- 172.21.15.117:0/1465592910 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a38089810 con 0x7f3a2c004fd0 2023-07-19T20:44:44.835 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.756+0000 7f3a42ffd700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3a3006a690 0x7f3a3006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.836 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.756+0000 7f3a42ffd700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3a3006a690 0x7f3a3006cb40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3a441e70c0 tx=0x7f3a34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.836 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.755+0000 7f22a97fa700 1 -- 172.21.15.117:0/2138048962 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a00018d0 con 0x7f22ac1456c0 2023-07-19T20:44:44.836 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.755+0000 7f22a97fa700 1 -- 172.21.15.117:0/2138048962 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a0004d30 con 0x7f22ac1456c0 2023-07-19T20:44:44.836 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.755+0000 7f22a97fa700 1 -- 172.21.15.117:0/2138048962 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0024640 con 0x7f22ac1456c0 2023-07-19T20:44:44.836 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.756+0000 7f22b320b700 1 -- 172.21.15.117:0/2138048962 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac147010 con 0x7f22ac1456c0 2023-07-19T20:44:44.836 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.756+0000 7f22b320b700 1 -- 172.21.15.117:0/2138048962 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac146110 con 0x7f22ac1456c0 2023-07-19T20:44:44.837 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.757+0000 7f22b320b700 1 -- 172.21.15.117:0/2138048962 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac074890 con 0x7f22ac1456c0 2023-07-19T20:44:44.837 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f7a837fe700 1 -- 172.21.15.117:0/2822525697 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7a7c053ae0 con 0x7f7a8c0b68c0 2023-07-19T20:44:44.837 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.753+0000 7f4d757fa700 1 -- 172.21.15.117:0/4221498333 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78023070 con 0x7f4d800b21a0 2023-07-19T20:44:44.837 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.753+0000 7f4d757fa700 1 -- 172.21.15.117:0/4221498333 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d780043c0 con 0x7f4d800b21a0 2023-07-19T20:44:44.838 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.753+0000 7f4d870ff700 1 -- 172.21.15.117:0/4221498333 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d801440e0 con 0x7f4d800b21a0 2023-07-19T20:44:44.838 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.753+0000 7f4d757fa700 1 -- 172.21.15.117:0/4221498333 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78004770 con 0x7f4d800b21a0 2023-07-19T20:44:44.838 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.753+0000 7f4d870ff700 1 -- 172.21.15.117:0/4221498333 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d800a8c10 con 0x7f4d800b21a0 2023-07-19T20:44:44.838 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7f4d870ff700 1 -- 172.21.15.117:0/4221498333 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d80074890 con 0x7f4d800b21a0 2023-07-19T20:44:44.838 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f5075068700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50700bdcb0 0x7f50700a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f5075068700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50700bdcb0 0x7f50700a6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58234/0 (socket says 172.21.15.117:58234) 2023-07-19T20:44:44.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f5075068700 1 -- 172.21.15.117:0/2820916970 learned_addr learned my addr 172.21.15.117:0/2820916970 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f5074867700 1 --2- 172.21.15.117:0/2820916970 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50700be130 0x7f50701dde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f5075068700 1 -- 172.21.15.117:0/2820916970 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50700be130 msgr2=0x7f50701dde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.840 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f5075068700 1 --2- 172.21.15.117:0/2820916970 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50700be130 0x7f50701dde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.840 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f5075068700 1 -- 172.21.15.117:0/2820916970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50700c0d10 msgr2=0x7f507014dbb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-19T20:44:44.840 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f5075068700 1 --2- 172.21.15.117:0/2820916970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50700c0d10 0x7f507014dbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.840 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f5075068700 1 -- 172.21.15.117:0/2820916970 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c009550 con 0x7f50700bdcb0 2023-07-19T20:44:44.840 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f5074867700 1 --2- 172.21.15.117:0/2820916970 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50700be130 0x7f50701dde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:44.840 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7f5075068700 1 --2- 172.21.15.117:0/2820916970 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50700bdcb0 0x7f50700a6370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f506000e9e0 tx=0x7f506000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.841 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.757+0000 7faab91fb700 1 -- 172.21.15.117:0/2417956639 shutdown_connections 2023-07-19T20:44:44.841 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.757+0000 7faab91fb700 1 -- 172.21.15.117:0/2417956639 >> 172.21.15.117:0/2417956639 conn(0x7faab406b1f0 msgr2=0x7faab40bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:44.841 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.752+0000 7fa5021e0700 1 Processor -- start 2023-07-19T20:44:44.841 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.753+0000 7fa5021e0700 1 -- start start 2023-07-19T20:44:44.841 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.753+0000 7fa5021e0700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4fc0b65c0 0x7fa4fc071650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.842 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.753+0000 7fa5021e0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4fc0b8520 0x7fa4fc1417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.842 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.753+0000 7fa5021e0700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4fc0bcd80 0x7fa4fc144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.842 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.753+0000 7fa5021e0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc071b90 con 0x7fa4fc0b8520 2023-07-19T20:44:44.842 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.753+0000 7fa5021e0700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc144180 con 0x7fa4fc0bcd80 2023-07-19T20:44:44.842 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.753+0000 7fa5021e0700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc1446d0 con 0x7fa4fc0b65c0 2023-07-19T20:44:44.842 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa4f2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4fc0b8520 0x7fa4fc1417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.842 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa4f2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4fc0b8520 0x7fa4fc1417c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43760/0 (socket says 172.21.15.117:43760) 2023-07-19T20:44:44.843 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa4f2ffd700 1 -- 172.21.15.117:0/1773959045 learned_addr learned my addr 172.21.15.117:0/1773959045 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.843 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa4fbfff700 1 --2- 172.21.15.117:0/1773959045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4fc0bcd80 0x7fa4fc144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.843 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa4f2ffd700 1 -- 172.21.15.117:0/1773959045 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4fc0b65c0 msgr2=0x7fa4fc071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.843 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa4f2ffd700 1 --2- 172.21.15.117:0/1773959045 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4fc0b65c0 0x7fa4fc071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.843 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa4f2ffd700 1 -- 172.21.15.117:0/1773959045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4fc0bcd80 msgr2=0x7fa4fc144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.844 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa4f2ffd700 1 --2- 172.21.15.117:0/1773959045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4fc0bcd80 0x7fa4fc144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.844 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa4f2ffd700 1 -- 172.21.15.117:0/1773959045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f40079d0 con 0x7fa4fc0b8520 2023-07-19T20:44:44.844 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa4fbfff700 1 --2- 172.21.15.117:0/1773959045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4fc0bcd80 0x7fa4fc144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:44.844 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa4f2ffd700 1 --2- 172.21.15.117:0/1773959045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4fc0b8520 0x7fa4fc1417c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400c4d0 tx=0x7fa4e400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.844 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa4f8ff9700 1 -- 172.21.15.117:0/1773959045 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40054e0 con 0x7fa4fc0b8520 2023-07-19T20:44:44.844 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa4f8ff9700 1 -- 172.21.15.117:0/1773959045 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e4003680 con 0x7fa4fc0b8520 2023-07-19T20:44:44.844 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa4f8ff9700 1 -- 172.21.15.117:0/1773959045 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4003a30 con 0x7fa4fc0b8520 2023-07-19T20:44:44.845 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.754+0000 7fa5021e0700 1 -- 172.21.15.117:0/1773959045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4fc147180 con 0x7fa4fc0b8520 2023-07-19T20:44:44.845 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.755+0000 7fa5021e0700 1 -- 172.21.15.117:0/1773959045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4fc146480 con 0x7fa4fc0b8520 2023-07-19T20:44:44.845 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.758+0000 7faab91fb700 1 -- 172.21.15.117:0/2417956639 shutdown_connections 2023-07-19T20:44:44.845 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.758+0000 7faab91fb700 1 -- 172.21.15.117:0/2417956639 wait complete. 2023-07-19T20:44:44.846 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.758+0000 7fa4f8ff9700 1 -- 172.21.15.117:0/1773959045 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fa4e4003b90 con 0x7fa4fc0b8520 2023-07-19T20:44:44.846 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.758+0000 7fa4f8ff9700 1 --2- 172.21.15.117:0/1773959045 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa4dc06a660 0x7fa4dc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.846 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.757+0000 7f5065ffb700 1 -- 172.21.15.117:0/2820916970 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060009710 con 0x7f50700bdcb0 2023-07-19T20:44:44.846 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.757+0000 7f5065ffb700 1 -- 172.21.15.117:0/2820916970 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506000c850 con 0x7f50700bdcb0 2023-07-19T20:44:44.846 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.757+0000 7f50772cc700 1 -- 172.21.15.117:0/2820916970 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50700b8db0 con 0x7f50700bdcb0 2023-07-19T20:44:44.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.757+0000 7f5065ffb700 1 -- 172.21.15.117:0/2820916970 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506000cbc0 con 0x7f50700bdcb0 2023-07-19T20:44:44.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.757+0000 7f50772cc700 1 -- 172.21.15.117:0/2820916970 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50701e4d40 con 0x7f50700bdcb0 2023-07-19T20:44:44.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.759+0000 7f50772cc700 1 -- 172.21.15.117:0/2820916970 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50500052e0 con 0x7f50700bdcb0 2023-07-19T20:44:44.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.759+0000 7fa5021e0700 1 -- 172.21.15.117:0/1773959045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4fc067940 con 0x7fa4fc0b8520 2023-07-19T20:44:44.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.759+0000 7f3a2bfff700 1 -- 172.21.15.117:0/1465592910 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3a38054ae0 con 0x7f3a2c004fd0 2023-07-19T20:44:44.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.759+0000 7fa4fb7fe700 1 --2- 172.21.15.117:0/1773959045 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa4dc06a660 0x7fa4dc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.759+0000 7fa4fb7fe700 1 --2- 172.21.15.117:0/1773959045 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa4dc06a660 0x7fa4dc06cb10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0096d0 tx=0x7fa4ec006c30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.759+0000 7faab91fb700 1 Processor -- start 2023-07-19T20:44:44.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.760+0000 7f22a97fa700 1 -- 172.21.15.117:0/2138048962 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f22a000a030 con 0x7f22ac1456c0 2023-07-19T20:44:44.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.760+0000 7faab91fb700 1 -- start start 2023-07-19T20:44:44.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.761+0000 7faab91fb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faab40b8da0 0x7faab406f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.761+0000 7faab91fb700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faab41e42a0 0x7faab41e4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.761+0000 7faab91fb700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faab4070650 0x7faab4070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.761+0000 7faab91fb700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab41e8470 con 0x7faab40b8da0 2023-07-19T20:44:44.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.761+0000 7f22a97fa700 1 --2- 172.21.15.117:0/2138048962 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f229806a730 0x7f229806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.761+0000 7faab91fb700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab406f960 con 0x7faab41e42a0 2023-07-19T20:44:44.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.761+0000 7faab91fb700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab41e4c50 con 0x7faab4070650 2023-07-19T20:44:44.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.761+0000 7f22a97fa700 1 -- 172.21.15.117:0/2138048962 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f22a0006050 con 0x7f22ac1456c0 2023-07-19T20:44:44.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.762+0000 7f4d757fa700 1 -- 172.21.15.117:0/4221498333 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f4d780124d0 con 0x7f4d800b21a0 2023-07-19T20:44:44.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.763+0000 7f4d757fa700 1 --2- 172.21.15.117:0/4221498333 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4d6c06a730 0x7f4d6c06cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.763+0000 7f4d757fa700 1 -- 172.21.15.117:0/4221498333 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4d7808e470 con 0x7f4d800b21a0 2023-07-19T20:44:44.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.763+0000 7faab259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faab41e42a0 0x7faab41e4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.763+0000 7faab359e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faab4070650 0x7faab4070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.763+0000 7faab259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faab41e42a0 0x7faab41e4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58240/0 (socket says 172.21.15.117:58240) 2023-07-19T20:44:44.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.763+0000 7faab259c700 1 -- 172.21.15.117:0/3766694914 learned_addr learned my addr 172.21.15.117:0/3766694914 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:44.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.761+0000 7f5065ffb700 1 -- 172.21.15.117:0/2820916970 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f506000cd20 con 0x7f50700bdcb0 2023-07-19T20:44:44.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.761+0000 7f5065ffb700 1 --2- 172.21.15.117:0/2820916970 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f505406a760 0x7f505406cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.761+0000 7f5065ffb700 1 -- 172.21.15.117:0/2820916970 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5060089270 con 0x7f50700bdcb0 2023-07-19T20:44:44.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.764+0000 7faab259c700 1 -- 172.21.15.117:0/3766694914 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faab4070650 msgr2=0x7faab4070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.764+0000 7faab259c700 1 --2- 172.21.15.117:0/3766694914 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faab4070650 0x7faab4070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.764+0000 7faab259c700 1 -- 172.21.15.117:0/3766694914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faab40b8da0 msgr2=0x7faab406f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:44.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.764+0000 7faab259c700 1 --2- 172.21.15.117:0/3766694914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faab40b8da0 0x7faab406f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:44.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.764+0000 7faab259c700 1 -- 172.21.15.117:0/3766694914 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab41e7ad0 con 0x7faab41e42a0 2023-07-19T20:44:44.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.764+0000 7fa4f8ff9700 1 -- 172.21.15.117:0/1773959045 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa4e4003e40 con 0x7fa4fc0b8520 2023-07-19T20:44:44.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.764+0000 7f22b0fa7700 1 --2- 172.21.15.117:0/2138048962 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f229806a730 0x7f229806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.764+0000 7faab259c700 1 --2- 172.21.15.117:0/3766694914 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faab41e42a0 0x7faab41e4710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faaa400cf20 tx=0x7faaa4001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.765+0000 7f22b0fa7700 1 --2- 172.21.15.117:0/2138048962 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f229806a730 0x7f229806cbe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f229c006d20 tx=0x7f229c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.765+0000 7f4d757fa700 1 -- 172.21.15.117:0/4221498333 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f4d780598e0 con 0x7f4d800b21a0 2023-07-19T20:44:44.860 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.766+0000 7f5074867700 1 --2- 172.21.15.117:0/2820916970 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f505406a760 0x7f505406cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.860 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.766+0000 7f5074867700 1 --2- 172.21.15.117:0/2820916970 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f505406a760 0x7f505406cc10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f506c014040 tx=0x7f506c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.860 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.772+0000 7f4d84e9b700 1 --2- 172.21.15.117:0/4221498333 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4d6c06a730 0x7f4d6c06cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.861 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.772+0000 7f22a97fa700 1 -- 172.21.15.117:0/2138048962 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f22a0056080 con 0x7f22ac1456c0 2023-07-19T20:44:44.861 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.772+0000 7f4d84e9b700 1 --2- 172.21.15.117:0/4221498333 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4d6c06a730 0x7f4d6c06cbe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c006fd0 tx=0x7f4d7c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.861 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.773+0000 7faa9b7fe700 1 -- 172.21.15.117:0/3766694914 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa40072d0 con 0x7faab41e42a0 2023-07-19T20:44:44.862 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.773+0000 7faa9b7fe700 1 -- 172.21.15.117:0/3766694914 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa4007430 con 0x7faab41e42a0 2023-07-19T20:44:44.862 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.773+0000 7faa9b7fe700 1 -- 172.21.15.117:0/3766694914 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa40077a0 con 0x7faab41e42a0 2023-07-19T20:44:44.862 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.773+0000 7faab91fb700 1 -- 172.21.15.117:0/3766694914 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab41e7db0 con 0x7faab41e42a0 2023-07-19T20:44:44.862 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.773+0000 7faab91fb700 1 -- 172.21.15.117:0/3766694914 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab4071aa0 con 0x7faab41e42a0 2023-07-19T20:44:44.863 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.775+0000 7faa9b7fe700 1 -- 172.21.15.117:0/3766694914 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7faaa4028450 con 0x7faab41e42a0 2023-07-19T20:44:44.863 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.775+0000 7faab91fb700 1 -- 172.21.15.117:0/3766694914 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab41e86e0 con 0x7faab41e42a0 2023-07-19T20:44:44.863 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.775+0000 7fa4f8ff9700 1 -- 172.21.15.117:0/1773959045 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fa4e4052f20 con 0x7fa4fc0b8520 2023-07-19T20:44:44.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.776+0000 7faa9b7fe700 1 --2- 172.21.15.117:0/3766694914 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faaa006a660 0x7faaa006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:44.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.776+0000 7faa9b7fe700 1 -- 172.21.15.117:0/3766694914 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faaa408a5c0 con 0x7faab41e42a0 2023-07-19T20:44:44.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.776+0000 7faab2d9d700 1 --2- 172.21.15.117:0/3766694914 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faaa006a660 0x7faaa006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:44.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.777+0000 7faab2d9d700 1 --2- 172.21.15.117:0/3766694914 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faaa006a660 0x7faaa006cb10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faaa800a8d0 tx=0x7faaa8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:44.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.782+0000 7faa9b7fe700 1 -- 172.21.15.117:0/3766694914 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7faaa40559b0 con 0x7faab41e42a0 2023-07-19T20:44:44.865 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:44.784+0000 7f5065ffb700 1 -- 172.21.15.117:0/2820916970 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f50600546e0 con 0x7f50700bdcb0 2023-07-19T20:44:45.137 INFO:teuthology.orchestra.run.smithi117.stdout:60129542148 2023-07-19T20:44:45.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.143+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1656236914 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdf3412f260 con 0x7fdf3406fa80 2023-07-19T20:44:45.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.143+0000 7fdf30ff9700 1 -- 172.21.15.117:0/1656236914 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf28020020 con 0x7fdf3406fa80 2023-07-19T20:44:45.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.147+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1656236914 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdf2006a660 msgr2=0x7fdf2006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.141 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.147+0000 7fdf3a7d1700 1 --2- 172.21.15.117:0/1656236914 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdf2006a660 0x7fdf2006cb10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdf24005040 tx=0x7fdf24009030 comp rx=0 tx=0).stop 2023-07-19T20:44:45.141 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.147+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1656236914 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf3406fa80 msgr2=0x7fdf341332f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.141 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.147+0000 7fdf3a7d1700 1 --2- 172.21.15.117:0/1656236914 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf3406fa80 0x7fdf341332f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800f810 tx=0x7fdf2800fb20 comp rx=0 tx=0).stop 2023-07-19T20:44:45.142 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.147+0000 7f4d870ff700 1 -- 172.21.15.117:0/4221498333 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4d801dc430 con 0x7f4d800b21a0 2023-07-19T20:44:45.142 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.148+0000 7f4d757fa700 1 -- 172.21.15.117:0/4221498333 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d7802c020 con 0x7f4d800b21a0 2023-07-19T20:44:45.142 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.148+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1656236914 shutdown_connections 2023-07-19T20:44:45.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.148+0000 7fdf3a7d1700 1 --2- 172.21.15.117:0/1656236914 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdf2006a660 0x7fdf2006cb10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.148+0000 7fdf3a7d1700 1 --2- 172.21.15.117:0/1656236914 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf3414f200 0x7fdf34131fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.148+0000 7fdf3a7d1700 1 --2- 172.21.15.117:0/1656236914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf34134080 0x7fdf3412f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.148+0000 7fdf3a7d1700 1 --2- 172.21.15.117:0/1656236914 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf3406fa80 0x7fdf341332f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.148+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1656236914 >> 172.21.15.117:0/1656236914 conn(0x7fdf3406b1f0 msgr2=0x7fdf34150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:45.144 INFO:teuthology.orchestra.run.smithi117.stdout:60129542149 2023-07-19T20:44:45.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.151+0000 7f4d870ff700 1 -- 172.21.15.117:0/4221498333 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4d6c06a730 msgr2=0x7f4d6c06cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.151+0000 7f4d870ff700 1 --2- 172.21.15.117:0/4221498333 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4d6c06a730 0x7f4d6c06cbe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c006fd0 tx=0x7f4d7c008040 comp rx=0 tx=0).stop 2023-07-19T20:44:45.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.151+0000 7f4d870ff700 1 -- 172.21.15.117:0/4221498333 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d800b21a0 msgr2=0x7f4d800b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.151+0000 7f4d870ff700 1 --2- 172.21.15.117:0/4221498333 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d800b21a0 0x7f4d800b25f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4d8014a2f0 tx=0x7f4d78004ad0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.152+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1656236914 shutdown_connections 2023-07-19T20:44:45.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.152+0000 7fdf3a7d1700 1 -- 172.21.15.117:0/1656236914 wait complete. 2023-07-19T20:44:45.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.152+0000 7f4d870ff700 1 -- 172.21.15.117:0/4221498333 shutdown_connections 2023-07-19T20:44:45.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.152+0000 7f4d870ff700 1 --2- 172.21.15.117:0/4221498333 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4d6c06a730 0x7f4d6c06cbe0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.152+0000 7f4d870ff700 1 --2- 172.21.15.117:0/4221498333 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d800b21a0 0x7f4d800b25f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.152+0000 7f4d870ff700 1 --2- 172.21.15.117:0/4221498333 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d80140da0 0x7f4d8006f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.152+0000 7f4d870ff700 1 --2- 172.21.15.117:0/4221498333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d800710a0 0x7f4d80071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.152+0000 7f4d870ff700 1 -- 172.21.15.117:0/4221498333 >> 172.21.15.117:0/4221498333 conn(0x7f4d8006b1f0 msgr2=0x7f4d80147cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:45.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.153+0000 7f7a910a9700 1 -- 172.21.15.117:0/2822525697 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7a70005590 con 0x7f7a8c0b68c0 2023-07-19T20:44:45.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.154+0000 7f4d870ff700 1 -- 172.21.15.117:0/4221498333 shutdown_connections 2023-07-19T20:44:45.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.154+0000 7f3a49b26700 1 -- 172.21.15.117:0/1465592910 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3a44067940 con 0x7f3a2c004fd0 2023-07-19T20:44:45.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.154+0000 7f4d870ff700 1 -- 172.21.15.117:0/4221498333 wait complete. 2023-07-19T20:44:45.149 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.156+0000 7f7a837fe700 1 -- 172.21.15.117:0/2822525697 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7a7c057100 con 0x7f7a8c0b68c0 2023-07-19T20:44:45.152 INFO:teuthology.orchestra.run.smithi117.stdout:60129542149 2023-07-19T20:44:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.160+0000 7f7a910a9700 1 -- 172.21.15.117:0/2822525697 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7a6c06a730 msgr2=0x7f7a6c06cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.160+0000 7f7a910a9700 1 --2- 172.21.15.117:0/2822525697 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7a6c06a730 0x7f7a6c06cbe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a74001220 tx=0x7f7a74009040 comp rx=0 tx=0).stop 2023-07-19T20:44:45.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.160+0000 7f7a910a9700 1 -- 172.21.15.117:0/2822525697 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a8c0b68c0 msgr2=0x7f7a8c14a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.160+0000 7f7a910a9700 1 --2- 172.21.15.117:0/2822525697 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a8c0b68c0 0x7f7a8c14a130 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c780 tx=0x7f7a7c00ca90 comp rx=0 tx=0).stop 2023-07-19T20:44:45.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.160+0000 7f3a2bfff700 1 -- 172.21.15.117:0/1465592910 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a38058100 con 0x7f3a2c004fd0 2023-07-19T20:44:45.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.160+0000 7f7a910a9700 1 -- 172.21.15.117:0/2822525697 shutdown_connections 2023-07-19T20:44:45.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.160+0000 7f7a910a9700 1 --2- 172.21.15.117:0/2822525697 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7a6c06a730 0x7f7a6c06cbe0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.160+0000 7f7a910a9700 1 --2- 172.21.15.117:0/2822525697 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a8c0bd0f0 0x7f7a8c1473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.160+0000 7f7a910a9700 1 --2- 172.21.15.117:0/2822525697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a8c0b4560 0x7f7a8c1e6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.160+0000 7f7a910a9700 1 --2- 172.21.15.117:0/2822525697 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a8c0b68c0 0x7f7a8c14a130 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.160+0000 7f7a910a9700 1 -- 172.21.15.117:0/2822525697 >> 172.21.15.117:0/2822525697 conn(0x7f7a8c06b1f0 msgr2=0x7f7a8c0bbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:45.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.160+0000 7f7a910a9700 1 -- 172.21.15.117:0/2822525697 shutdown_connections 2023-07-19T20:44:45.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.160+0000 7f7a910a9700 1 -- 172.21.15.117:0/2822525697 wait complete. 2023-07-19T20:44:45.157 INFO:teuthology.orchestra.run.smithi117.stdout:60129542148 2023-07-19T20:44:45.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.165+0000 7f3a49b26700 1 -- 172.21.15.117:0/1465592910 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3a3006a690 msgr2=0x7f3a3006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.165+0000 7f3a49b26700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3a3006a690 0x7f3a3006cb40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3a441e70c0 tx=0x7f3a34009040 comp rx=0 tx=0).stop 2023-07-19T20:44:45.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.165+0000 7f3a49b26700 1 -- 172.21.15.117:0/1465592910 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3a2c004fd0 msgr2=0x7f3a44147130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.165+0000 7f3a49b26700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3a2c004fd0 0x7f3a44147130 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800f580 tx=0x7f3a3800f890 comp rx=0 tx=0).stop 2023-07-19T20:44:45.159 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.165+0000 7f22b320b700 1 -- 172.21.15.117:0/2138048962 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f22ac1468b0 con 0x7f22ac1456c0 2023-07-19T20:44:45.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.168+0000 7f3a49b26700 1 -- 172.21.15.117:0/1465592910 shutdown_connections 2023-07-19T20:44:45.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.168+0000 7f3a49b26700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3a3006a690 0x7f3a3006cb40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.168+0000 7f3a49b26700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a441ed3f0 0x7f3a441535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.162 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.168+0000 7f3a49b26700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3a2c004fd0 0x7f3a44147130 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.162 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.168+0000 7f3a49b26700 1 --2- 172.21.15.117:0/1465592910 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3a44157220 0x7f3a441eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.162 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.168+0000 7f3a49b26700 1 -- 172.21.15.117:0/1465592910 >> 172.21.15.117:0/1465592910 conn(0x7f3a440bdc00 msgr2=0x7f3a440b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:45.162 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.169+0000 7f3a49b26700 1 -- 172.21.15.117:0/1465592910 shutdown_connections 2023-07-19T20:44:45.163 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.169+0000 7fa5021e0700 1 -- 172.21.15.117:0/1773959045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa4fc1401d0 con 0x7fa4fc0b8520 2023-07-19T20:44:45.164 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.170+0000 7f50772cc700 1 -- 172.21.15.117:0/2820916970 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5050005860 con 0x7f50700bdcb0 2023-07-19T20:44:45.164 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.170+0000 7f22a97fa700 1 -- 172.21.15.117:0/2138048962 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22ac1468b0 con 0x7f22ac1456c0 2023-07-19T20:44:45.165 INFO:teuthology.orchestra.run.smithi117.stdout:60129542150 2023-07-19T20:44:45.165 INFO:teuthology.orchestra.run.smithi117.stdout:60129542149 2023-07-19T20:44:45.166 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.170+0000 7fa4f8ff9700 1 -- 172.21.15.117:0/1773959045 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4e4017070 con 0x7fa4fc0b8520 2023-07-19T20:44:45.168 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.173+0000 7f3a49b26700 1 -- 172.21.15.117:0/1465592910 wait complete. 2023-07-19T20:44:45.168 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7f22b320b700 1 -- 172.21.15.117:0/2138048962 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f229806a730 msgr2=0x7f229806cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.168 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7f22b320b700 1 --2- 172.21.15.117:0/2138048962 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f229806a730 0x7f229806cbe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f229c006d20 tx=0x7f229c008040 comp rx=0 tx=0).stop 2023-07-19T20:44:45.168 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7f22b320b700 1 -- 172.21.15.117:0/2138048962 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22ac1456c0 msgr2=0x7f22ac1db900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.169 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7f22b320b700 1 --2- 172.21.15.117:0/2138048962 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22ac1456c0 0x7f22ac1db900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22a0015000 tx=0x7f22a0005020 comp rx=0 tx=0).stop 2023-07-19T20:44:45.170 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7fa5021e0700 1 -- 172.21.15.117:0/1773959045 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa4dc06a660 msgr2=0x7fa4dc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.170 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7fa5021e0700 1 --2- 172.21.15.117:0/1773959045 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa4dc06a660 0x7fa4dc06cb10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0096d0 tx=0x7fa4ec006c30 comp rx=0 tx=0).stop 2023-07-19T20:44:45.170 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7fa5021e0700 1 -- 172.21.15.117:0/1773959045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4fc0b8520 msgr2=0x7fa4fc1417c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.170 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7fa5021e0700 1 --2- 172.21.15.117:0/1773959045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4fc0b8520 0x7fa4fc1417c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400c4d0 tx=0x7fa4e400c890 comp rx=0 tx=0).stop 2023-07-19T20:44:45.170 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7fa5021e0700 1 -- 172.21.15.117:0/1773959045 shutdown_connections 2023-07-19T20:44:45.170 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7fa5021e0700 1 --2- 172.21.15.117:0/1773959045 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa4dc06a660 0x7fa4dc06cb10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.170 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7fa5021e0700 1 --2- 172.21.15.117:0/1773959045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4fc0bcd80 0x7fa4fc144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.171 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7fa5021e0700 1 --2- 172.21.15.117:0/1773959045 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4fc0b65c0 0x7fa4fc071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.171 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7fa5021e0700 1 --2- 172.21.15.117:0/1773959045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4fc0b8520 0x7fa4fc1417c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.171 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7fa5021e0700 1 -- 172.21.15.117:0/1773959045 >> 172.21.15.117:0/1773959045 conn(0x7fa4fc06d5d0 msgr2=0x7fa4fc0b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:45.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2023-07-19T20:44:45.172 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7f5065ffb700 1 -- 172.21.15.117:0/2820916970 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5060057d00 con 0x7f50700bdcb0 2023-07-19T20:44:45.172 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7fa5021e0700 1 -- 172.21.15.117:0/1773959045 shutdown_connections 2023-07-19T20:44:45.172 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7fa5021e0700 1 -- 172.21.15.117:0/1773959045 wait complete. 2023-07-19T20:44:45.173 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7f22b320b700 1 -- 172.21.15.117:0/2138048962 shutdown_connections 2023-07-19T20:44:45.173 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7f22b320b700 1 --2- 172.21.15.117:0/2138048962 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f229806a730 0x7f229806cbe0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.173 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7f22b320b700 1 --2- 172.21.15.117:0/2138048962 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f22ac1dbe40 0x7f22ac13a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.173 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7f22b320b700 1 --2- 172.21.15.117:0/2138048962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22940068d0 0x7f22ac145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.173 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.174+0000 7f22b320b700 1 --2- 172.21.15.117:0/2138048962 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22ac1456c0 0x7f22ac1db900 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.174 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.175+0000 7f22b320b700 1 -- 172.21.15.117:0/2138048962 >> 172.21.15.117:0/2138048962 conn(0x7f22ac06b1f0 msgr2=0x7f22ac0b7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:45.174 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.175+0000 7f22b320b700 1 -- 172.21.15.117:0/2138048962 shutdown_connections 2023-07-19T20:44:45.174 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.175+0000 7f22b320b700 1 -- 172.21.15.117:0/2138048962 wait complete. 2023-07-19T20:44:45.174 INFO:teuthology.orchestra.run.smithi117.stdout:60129542149 2023-07-19T20:44:45.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.3 2023-07-19T20:44:45.175 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.177+0000 7faab91fb700 1 -- 172.21.15.117:0/3766694914 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faab40bc460 con 0x7faab41e42a0 2023-07-19T20:44:45.175 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.177+0000 7faa9b7fe700 1 -- 172.21.15.117:0/3766694914 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faaa4017090 con 0x7faab41e42a0 2023-07-19T20:44:45.176 INFO:teuthology.orchestra.run.smithi117.stdout:60129542149 2023-07-19T20:44:45.176 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.179+0000 7f50772cc700 1 -- 172.21.15.117:0/2820916970 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f505406a760 msgr2=0x7f505406cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.179+0000 7f50772cc700 1 --2- 172.21.15.117:0/2820916970 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f505406a760 0x7f505406cc10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f506c014040 tx=0x7f506c008030 comp rx=0 tx=0).stop 2023-07-19T20:44:45.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.179+0000 7f50772cc700 1 -- 172.21.15.117:0/2820916970 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50700bdcb0 msgr2=0x7f50700a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.179+0000 7f50772cc700 1 --2- 172.21.15.117:0/2820916970 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50700bdcb0 0x7f50700a6370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f506000e9e0 tx=0x7f506000ecf0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.179+0000 7f50772cc700 1 -- 172.21.15.117:0/2820916970 shutdown_connections 2023-07-19T20:44:45.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.179+0000 7f50772cc700 1 --2- 172.21.15.117:0/2820916970 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f505406a760 0x7f505406cc10 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f506c014040 tx=0x7f506c008030 comp rx=0 tx=0).stop 2023-07-19T20:44:45.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.179+0000 7f50772cc700 1 --2- 172.21.15.117:0/2820916970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50700c0d10 0x7f507014dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.179+0000 7f50772cc700 1 --2- 172.21.15.117:0/2820916970 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50700bdcb0 0x7f50700a6370 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.179+0000 7f50772cc700 1 --2- 172.21.15.117:0/2820916970 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50700be130 0x7f50701dde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.179+0000 7f50772cc700 1 -- 172.21.15.117:0/2820916970 >> 172.21.15.117:0/2820916970 conn(0x7f5070071c90 msgr2=0x7f5070145ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:45.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.180+0000 7faab91fb700 1 -- 172.21.15.117:0/3766694914 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faaa006a660 msgr2=0x7faaa006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.180+0000 7faab91fb700 1 --2- 172.21.15.117:0/3766694914 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faaa006a660 0x7faaa006cb10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faaa800a8d0 tx=0x7faaa8008040 comp rx=0 tx=0).stop 2023-07-19T20:44:45.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.180+0000 7faab91fb700 1 -- 172.21.15.117:0/3766694914 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faab41e42a0 msgr2=0x7faab41e4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:45.179 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.180+0000 7faab91fb700 1 --2- 172.21.15.117:0/3766694914 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faab41e42a0 0x7faab41e4710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faaa400cf20 tx=0x7faaa4001930 comp rx=0 tx=0).stop 2023-07-19T20:44:45.179 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.182+0000 7f50772cc700 1 -- 172.21.15.117:0/2820916970 shutdown_connections 2023-07-19T20:44:45.179 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.182+0000 7f50772cc700 1 -- 172.21.15.117:0/2820916970 wait complete. 2023-07-19T20:44:45.179 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.184+0000 7faab91fb700 1 -- 172.21.15.117:0/3766694914 shutdown_connections 2023-07-19T20:44:45.180 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.184+0000 7faab91fb700 1 --2- 172.21.15.117:0/3766694914 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faaa006a660 0x7faaa006cb10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.180 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.184+0000 7faab91fb700 1 --2- 172.21.15.117:0/3766694914 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faab4070650 0x7faab4070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.180 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.184+0000 7faab91fb700 1 --2- 172.21.15.117:0/3766694914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faab40b8da0 0x7faab406f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.180 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.184+0000 7faab91fb700 1 --2- 172.21.15.117:0/3766694914 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faab41e42a0 0x7faab41e4710 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:45.180 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.184+0000 7faab91fb700 1 -- 172.21.15.117:0/3766694914 >> 172.21.15.117:0/3766694914 conn(0x7faab406b1f0 msgr2=0x7faab4148780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:45.180 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.184+0000 7faab91fb700 1 -- 172.21.15.117:0/3766694914 shutdown_connections 2023-07-19T20:44:45.180 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:45.184+0000 7faab91fb700 1 -- 172.21.15.117:0/3766694914 wait complete. 2023-07-19T20:44:45.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.1 2023-07-19T20:44:45.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.6 2023-07-19T20:44:45.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2023-07-19T20:44:45.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2023-07-19T20:44:45.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.2 2023-07-19T20:44:45.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.0 2023-07-19T20:44:46.174 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-19T20:44:46.176 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-19T20:44:46.190 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-19T20:44:46.191 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-19T20:44:46.192 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-19T20:44:46.192 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-19T20:44:46.198 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-19T20:44:46.199 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-19T20:44:46.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.398+0000 7f58d1d3e700 1 Processor -- start 2023-07-19T20:44:46.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.398+0000 7f58d1d3e700 1 -- start start 2023-07-19T20:44:46.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.394+0000 7fb4cc39d700 1 Processor -- start 2023-07-19T20:44:46.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.395+0000 7fb4cc39d700 1 -- start start 2023-07-19T20:44:46.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.396+0000 7fb4cc39d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb4c40bd0f0 0x7fb4c4158090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.396+0000 7fb4cc39d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb4c4072990 0x7fb4c408a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.396+0000 7fb4cc39d700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c40b82a0 con 0x7fb4c408a600 2023-07-19T20:44:46.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.396+0000 7fb4cc39d700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c41576b0 con 0x7fb4c40bd0f0 2023-07-19T20:44:46.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.396+0000 7fb4cc39d700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c41585d0 con 0x7fb4c4072990 2023-07-19T20:44:46.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.396+0000 7fb4ca139700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb4c40bd0f0 0x7fb4c4158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.396 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.396+0000 7fb4ca139700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb4c40bd0f0 0x7fb4c4158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43774/0 (socket says 172.21.15.117:43774) 2023-07-19T20:44:46.396 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.396+0000 7fb4ca139700 1 -- 172.21.15.117:0/982748375 learned_addr learned my addr 172.21.15.117:0/982748375 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.396 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.397+0000 7fb4ca139700 1 -- 172.21.15.117:0/982748375 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb4c4072990 msgr2=0x7fb4c408a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:46.396 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.397+0000 7fb4c9938700 1 --2- 172.21.15.117:0/982748375 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb4c4072990 0x7fb4c408a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.396 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.397+0000 7fb4ca139700 1 --2- 172.21.15.117:0/982748375 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb4c4072990 0x7fb4c408a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.396 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.397+0000 7fb4ca139700 1 -- 172.21.15.117:0/982748375 >> v1:172.21.15.117:6789/0 conn(0x7fb4c408a600 legacy=0x7fb4c415abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.396 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.397+0000 7fb4ca139700 1 -- 172.21.15.117:0/982748375 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c40b6230 con 0x7fb4c40bd0f0 2023-07-19T20:44:46.397 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.397+0000 7fb4c9938700 1 --2- 172.21.15.117:0/982748375 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb4c4072990 0x7fb4c408a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:46.397 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.398+0000 7fb4ca139700 1 --2- 172.21.15.117:0/982748375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c40bd0f0 0x7fb4c4158090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc008ec0 tx=0x7fb4bc00e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e27739f8792bd3f server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.399+0000 7f58d1d3e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f58cc140950 0x7f58cc0b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.399+0000 7f58d1d3e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f58cc140da0 0x7f58cc151260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.399+0000 7f58d1d3e700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58cc14a800 con 0x7f58cc0b3de0 2023-07-19T20:44:46.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.399+0000 7f58d1d3e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58cc0b7800 con 0x7f58cc140da0 2023-07-19T20:44:46.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.399+0000 7f58d1d3e700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc149ed0 con 0x7f58cc140950 2023-07-19T20:44:46.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.399+0000 7f58caffd700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f58cc140950 0x7f58cc0b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.399 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.399+0000 7f58caffd700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f58cc140950 0x7f58cc0b4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:39834/0 (socket says 172.21.15.117:39834) 2023-07-19T20:44:46.399 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.399+0000 7f58caffd700 1 -- 172.21.15.117:0/834419779 learned_addr learned my addr 172.21.15.117:0/834419779 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.399 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.400+0000 7f58caffd700 1 -- 172.21.15.117:0/834419779 >> v2:172.21.15.117:3300/0 conn(0x7f58cc140da0 msgr2=0x7f58cc151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:46.399 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.400+0000 7f58cbfff700 1 --2- 172.21.15.117:0/834419779 >> v2:172.21.15.117:3300/0 conn(0x7f58cc140da0 0x7f58cc151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.399 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.400+0000 7f58caffd700 1 --2- 172.21.15.117:0/834419779 >> v2:172.21.15.117:3300/0 conn(0x7f58cc140da0 0x7f58cc151260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.399 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.400+0000 7f58caffd700 1 -- 172.21.15.117:0/834419779 >> v1:172.21.15.124:6789/0 conn(0x7f58cc0b3de0 legacy=0x7f58cc0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:46.399 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.400+0000 7f58caffd700 1 -- 172.21.15.117:0/834419779 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc14a1b0 con 0x7f58cc140950 2023-07-19T20:44:46.399 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.400+0000 7f58cbfff700 1 --2- 172.21.15.117:0/834419779 >> v2:172.21.15.117:3300/0 conn(0x7f58cc140da0 0x7f58cc151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:46.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.400+0000 7f58caffd700 1 --2- 172.21.15.117:0/834419779 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f58cc140950 0x7f58cc0b4e80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009e50 tx=0x7f58c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=882df6f5e2ab9c57 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.400+0000 7f58ca7fc700 1 -- 172.21.15.117:0/834419779 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4003c20 con 0x7f58cc140950 2023-07-19T20:44:46.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.400+0000 7f58ca7fc700 1 -- 172.21.15.117:0/834419779 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c4003d80 con 0x7f58cc140950 2023-07-19T20:44:46.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.401+0000 7f58ca7fc700 1 -- 172.21.15.117:0/834419779 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c400bbc0 con 0x7f58cc140950 2023-07-19T20:44:46.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.401+0000 7f58d1d3e700 1 -- 172.21.15.117:0/834419779 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f58cc140950 msgr2=0x7f58cc0b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.400 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.401+0000 7f58d1d3e700 1 --2- 172.21.15.117:0/834419779 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f58cc140950 0x7f58cc0b4e80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009e50 tx=0x7f58c400b330 comp rx=0 tx=0).stop 2023-07-19T20:44:46.401 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.401+0000 7fb4c9137700 1 -- 172.21.15.117:0/982748375 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc00f610 con 0x7fb4c40bd0f0 2023-07-19T20:44:46.401 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.401+0000 7fb4c9137700 1 -- 172.21.15.117:0/982748375 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc00f770 con 0x7fb4c40bd0f0 2023-07-19T20:44:46.401 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.401+0000 7fb4c9137700 1 -- 172.21.15.117:0/982748375 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc00fb00 con 0x7fb4c40bd0f0 2023-07-19T20:44:46.401 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.402+0000 7f58d1d3e700 1 -- 172.21.15.117:0/834419779 shutdown_connections 2023-07-19T20:44:46.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.402+0000 7f58d1d3e700 1 --2- 172.21.15.117:0/834419779 >> v2:172.21.15.117:3300/0 conn(0x7f58cc140da0 0x7f58cc151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.402+0000 7f58d1d3e700 1 --2- 172.21.15.117:0/834419779 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f58cc140950 0x7f58cc0b4e80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.402+0000 7f58d1d3e700 1 -- 172.21.15.117:0/834419779 >> 172.21.15.117:0/834419779 conn(0x7f58cc06b1f0 msgr2=0x7f58cc0bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.402+0000 7fb4cc39d700 1 -- 172.21.15.117:0/982748375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c40bd0f0 msgr2=0x7fb4c4158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.402+0000 7fb4cc39d700 1 --2- 172.21.15.117:0/982748375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c40bd0f0 0x7fb4c4158090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc008ec0 tx=0x7fb4bc00e680 comp rx=0 tx=0).stop 2023-07-19T20:44:46.402 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.402+0000 7fb4cc39d700 1 -- 172.21.15.117:0/982748375 shutdown_connections 2023-07-19T20:44:46.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.402+0000 7fb4cc39d700 1 --2- 172.21.15.117:0/982748375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c40bd0f0 0x7fb4c4158090 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.402+0000 7fb4cc39d700 1 --2- 172.21.15.117:0/982748375 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb4c4072990 0x7fb4c408a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.402+0000 7fb4cc39d700 1 -- 172.21.15.117:0/982748375 >> 172.21.15.117:0/982748375 conn(0x7fb4c406b1f0 msgr2=0x7fb4c40bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.403+0000 7f58d1d3e700 1 -- 172.21.15.117:0/834419779 shutdown_connections 2023-07-19T20:44:46.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.403+0000 7f58d1d3e700 1 -- 172.21.15.117:0/834419779 wait complete. 2023-07-19T20:44:46.404 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.402+0000 7fb4cc39d700 1 -- 172.21.15.117:0/982748375 shutdown_connections 2023-07-19T20:44:46.404 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.405+0000 7fb4cc39d700 1 -- 172.21.15.117:0/982748375 wait complete. 2023-07-19T20:44:46.404 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.406+0000 7fb4cc39d700 1 Processor -- start 2023-07-19T20:44:46.405 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.404+0000 7f58d1d3e700 1 Processor -- start 2023-07-19T20:44:46.405 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.407+0000 7f58d1d3e700 1 -- start start 2023-07-19T20:44:46.405 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.408+0000 7f58d1d3e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f58cc0b3de0 0x7f58cc06f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.405 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.408+0000 7f58d1d3e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f58cc140950 0x7f58cc146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.406 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.408+0000 7f58d1d3e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc140da0 0x7f58cc070e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.406 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.408+0000 7f58d1d3e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc147370 con 0x7f58cc140da0 2023-07-19T20:44:46.406 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.408+0000 7f58d1d3e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc06f960 con 0x7f58cc0b3de0 2023-07-19T20:44:46.406 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.408+0000 7f58d1d3e700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc1e74a0 con 0x7f58cc140950 2023-07-19T20:44:46.406 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.408+0000 7f58cbfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc140da0 0x7f58cc070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.406 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.408+0000 7f58cbfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc140da0 0x7f58cc070e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43786/0 (socket says 172.21.15.117:43786) 2023-07-19T20:44:46.406 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.408+0000 7f58cbfff700 1 -- 172.21.15.117:0/3105245851 learned_addr learned my addr 172.21.15.117:0/3105245851 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.406 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.409+0000 7f58cbfff700 1 -- 172.21.15.117:0/3105245851 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f58cc140950 msgr2=0x7f58cc146e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-19T20:44:46.407 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.409+0000 7f58cbfff700 1 --2- 172.21.15.117:0/3105245851 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f58cc140950 0x7f58cc146e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.407 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.409+0000 7f58cbfff700 1 -- 172.21.15.117:0/3105245851 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f58cc0b3de0 msgr2=0x7f58cc06f2e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-19T20:44:46.407 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.409+0000 7f58cbfff700 1 --2- 172.21.15.117:0/3105245851 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f58cc0b3de0 0x7f58cc06f2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.407 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.409+0000 7f58cbfff700 1 -- 172.21.15.117:0/3105245851 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c4009b30 con 0x7f58cc140da0 2023-07-19T20:44:46.407 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.409+0000 7f58cbfff700 1 --2- 172.21.15.117:0/3105245851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc140da0 0x7f58cc070e90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f58c000c7f0 tx=0x7f58c000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.407 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.409+0000 7fb4cc39d700 1 -- start start 2023-07-19T20:44:46.408 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.410+0000 7f58b3fff700 1 -- 172.21.15.117:0/3105245851 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0011800 con 0x7f58cc140da0 2023-07-19T20:44:46.408 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.410+0000 7f58b3fff700 1 -- 172.21.15.117:0/3105245851 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c0011980 con 0x7f58cc140da0 2023-07-19T20:44:46.408 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.410+0000 7f58b3fff700 1 -- 172.21.15.117:0/3105245851 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0011d30 con 0x7f58cc140da0 2023-07-19T20:44:46.408 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.410+0000 7fb4cc39d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb4c408a600 0x7fb4c415b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.410+0000 7fb4cc39d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c40bd0f0 0x7fb4c41f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.410+0000 7fb4cc39d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb4c40b28a0 0x7fb4c41eecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.410+0000 7fb4cc39d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c415b800 con 0x7fb4c40bd0f0 2023-07-19T20:44:46.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.410+0000 7fb4cc39d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c40b3040 con 0x7fb4c408a600 2023-07-19T20:44:46.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.410+0000 7fb4cc39d700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c41f94c0 con 0x7fb4c40b28a0 2023-07-19T20:44:46.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.410+0000 7f58d1d3e700 1 -- 172.21.15.117:0/3105245851 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58cc1e7780 con 0x7f58cc140da0 2023-07-19T20:44:46.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.410+0000 7f58d1d3e700 1 -- 172.21.15.117:0/3105245851 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58cc1e7d40 con 0x7f58cc140da0 2023-07-19T20:44:46.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.412+0000 7fb4ca93a700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb4c40b28a0 0x7fb4c41eecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.412+0000 7fb4ca93a700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb4c40b28a0 0x7fb4c41eecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:39844/0 (socket says 172.21.15.117:39844) 2023-07-19T20:44:46.411 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.412+0000 7fb4ca93a700 1 -- 172.21.15.117:0/400091393 learned_addr learned my addr 172.21.15.117:0/400091393 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.411 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.412+0000 7f58b3fff700 1 -- 172.21.15.117:0/3105245851 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f58c0018360 con 0x7f58cc140da0 2023-07-19T20:44:46.411 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.413+0000 7fb4ca139700 1 --2- 172.21.15.117:0/400091393 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb4c408a600 0x7fb4c415b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.412 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.413+0000 7f58b3fff700 1 --2- 172.21.15.117:0/3105245851 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f58b806a730 0x7f58b806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.412 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.413+0000 7f58b3fff700 1 -- 172.21.15.117:0/3105245851 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58c0088b10 con 0x7f58cc140da0 2023-07-19T20:44:46.412 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.413+0000 7fb4ca93a700 1 -- 172.21.15.117:0/400091393 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb4c408a600 msgr2=0x7fb4c415b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.412 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.413+0000 7fb4ca93a700 1 --2- 172.21.15.117:0/400091393 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb4c408a600 0x7fb4c415b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.413+0000 7fb4ca93a700 1 -- 172.21.15.117:0/400091393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c40bd0f0 msgr2=0x7fb4c41f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.413+0000 7fb4ca93a700 1 --2- 172.21.15.117:0/400091393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c40bd0f0 0x7fb4c41f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.413+0000 7fb4ca93a700 1 -- 172.21.15.117:0/400091393 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc008b20 con 0x7fb4c40b28a0 2023-07-19T20:44:46.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.413+0000 7fb4ca93a700 1 --2- 172.21.15.117:0/400091393 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb4c40b28a0 0x7fb4c41eecc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400c420 tx=0x7fb4b400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.413+0000 7fb4baffd700 1 -- 172.21.15.117:0/400091393 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b40052d0 con 0x7fb4c40b28a0 2023-07-19T20:44:46.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.413+0000 7fb4baffd700 1 -- 172.21.15.117:0/400091393 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b4005430 con 0x7fb4c40b28a0 2023-07-19T20:44:46.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.413+0000 7fb4cc39d700 1 -- 172.21.15.117:0/400091393 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c40b2d60 con 0x7fb4c40b28a0 2023-07-19T20:44:46.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.413+0000 7fb4baffd700 1 -- 172.21.15.117:0/400091393 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4006a80 con 0x7fb4c40b28a0 2023-07-19T20:44:46.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.414+0000 7fb4cc39d700 1 -- 172.21.15.117:0/400091393 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c41f8a60 con 0x7fb4c40b28a0 2023-07-19T20:44:46.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.414+0000 7f58d1d3e700 1 -- 172.21.15.117:0/3105245851 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ac0052e0 con 0x7f58cc140da0 2023-07-19T20:44:46.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.416+0000 7fb4baffd700 1 -- 172.21.15.117:0/400091393 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fb4b4003680 con 0x7fb4c40b28a0 2023-07-19T20:44:46.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.416+0000 7fb4baffd700 1 --2- 172.21.15.117:0/400091393 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb4a806a6b0 0x7fb4a806cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.416+0000 7fb4baffd700 1 -- 172.21.15.117:0/400091393 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4b4087e50 con 0x7fb4c40b28a0 2023-07-19T20:44:46.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.421+0000 7f58b3fff700 1 -- 172.21.15.117:0/3105245851 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f58c00578f0 con 0x7f58cc140da0 2023-07-19T20:44:46.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.422+0000 7fb4ca139700 1 --2- 172.21.15.117:0/400091393 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb4c408a600 0x7fb4c415b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:46.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.423+0000 7fb4cc39d700 1 -- 172.21.15.117:0/400091393 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ac0052e0 con 0x7fb4c40b28a0 2023-07-19T20:44:46.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.423+0000 7fb4ca139700 1 --2- 172.21.15.117:0/400091393 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb4a806a6b0 0x7fb4a806cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.426+0000 7fb4ca139700 1 --2- 172.21.15.117:0/400091393 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb4a806a6b0 0x7fb4a806cb60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00e6c0 tx=0x7fb4bc013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.427+0000 7f58cb7fe700 1 --2- 172.21.15.117:0/3105245851 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f58b806a730 0x7f58b806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.428+0000 7f58cb7fe700 1 --2- 172.21.15.117:0/3105245851 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f58b806a730 0x7f58b806cbe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f58bc003d80 tx=0x7f58bc007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.431+0000 7fb4baffd700 1 -- 172.21.15.117:0/400091393 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fb4b404b2c0 con 0x7fb4c40b28a0 2023-07-19T20:44:46.434 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.439+0000 7fb14818e700 1 Processor -- start 2023-07-19T20:44:46.434 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.439+0000 7fb14818e700 1 -- start start 2023-07-19T20:44:46.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.440+0000 7fb14818e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb1401447e0 0x7fb1400b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.440+0000 7fb14818e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb14006baf0 0x7fb140070110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.440+0000 7fb14818e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1400b9770 con 0x7fb14006f560 2023-07-19T20:44:46.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.440+0000 7fb14818e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb140070db0 con 0x7fb1401447e0 2023-07-19T20:44:46.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.440+0000 7fb14818e700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14006b6a0 con 0x7fb14006baf0 2023-07-19T20:44:46.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.440+0000 7fb14672b700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb14006f560 0x7fb1400b7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41318/0 (socket says 172.21.15.117:41318) 2023-07-19T20:44:46.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.440+0000 7fb14672b700 1 -- 172.21.15.117:0/157191167 learned_addr learned my addr 172.21.15.117:0/157191167 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:46.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.440+0000 7fb144f28700 1 -- 172.21.15.117:0/157191167 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426825847 0 0) 0x7fb1400b9770 con 0x7fb14006f560 2023-07-19T20:44:46.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.440+0000 7fb144f28700 1 -- 172.21.15.117:0/157191167 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb12c0035b0 con 0x7fb14006f560 2023-07-19T20:44:46.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.440+0000 7fb144f28700 1 -- 172.21.15.117:0/157191167 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1429857779 0 0) 0x7fb12c0035b0 con 0x7fb14006f560 2023-07-19T20:44:46.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb144f28700 1 -- 172.21.15.117:0/157191167 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb14006baf0 msgr2=0x7fb140070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:46.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb145729700 1 --2- 172.21.15.117:0/157191167 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb14006baf0 0x7fb140070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb144f28700 1 --2- 172.21.15.117:0/157191167 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb14006baf0 0x7fb140070110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb144f28700 1 -- 172.21.15.117:0/157191167 >> v2:172.21.15.124:3300/0 conn(0x7fb1401447e0 msgr2=0x7fb1400b9230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-19T20:44:46.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb144f28700 1 --2- 172.21.15.117:0/157191167 >> v2:172.21.15.124:3300/0 conn(0x7fb1401447e0 0x7fb1400b9230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb144f28700 1 -- 172.21.15.117:0/157191167 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1400b8a70 con 0x7fb14006f560 2023-07-19T20:44:46.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb144f28700 1 -- 172.21.15.117:0/157191167 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7fb1380019f0 con 0x7fb14006f560 2023-07-19T20:44:46.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb144f28700 1 -- 172.21.15.117:0/157191167 >> v1:172.21.15.117:6789/0 conn(0x7fb14006f560 legacy=0x7fb1400b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb144f28700 1 --2- 172.21.15.117:0/157191167 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb12c003a00 0x7fb12c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.439 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb144f28700 1 --2- 172.21.15.117:0/157191167 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb12c004850 0x7fb12c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.439 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb144f28700 1 --2- 172.21.15.117:0/157191167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb12c005320 0x7fb12c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.439 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb144f28700 1 -- 172.21.15.117:0/157191167 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14006b6a0 con 0x7fb12c005320 2023-07-19T20:44:46.439 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb144f28700 1 -- 172.21.15.117:0/157191167 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c00c170 con 0x7fb12c003a00 2023-07-19T20:44:46.439 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb144f28700 1 -- 172.21.15.117:0/157191167 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c00c330 con 0x7fb12c004850 2023-07-19T20:44:46.439 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb14672b700 1 --2- 172.21.15.117:0/157191167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb12c005320 0x7fb12c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.440 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb14672b700 1 -- 172.21.15.117:0/157191167 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb12c004850 msgr2=0x7fb12c004cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-19T20:44:46.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb14672b700 1 --2- 172.21.15.117:0/157191167 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb12c004850 0x7fb12c004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb14672b700 1 -- 172.21.15.117:0/157191167 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb12c003a00 msgr2=0x7fb12c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:46.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb14672b700 1 --2- 172.21.15.117:0/157191167 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb12c003a00 0x7fb12c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.441+0000 7fb14672b700 1 -- 172.21.15.117:0/157191167 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c0035b0 con 0x7fb12c005320 2023-07-19T20:44:46.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.442+0000 7fb14672b700 1 --2- 172.21.15.117:0/157191167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb12c005320 0x7fb12c00ba10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb13800a7d0 tx=0x7fb12c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145b4cac1aa08440 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.442+0000 7fb144f28700 1 -- 172.21.15.117:0/157191167 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138010730 con 0x7fb12c005320 2023-07-19T20:44:46.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.442+0000 7fb144f28700 1 -- 172.21.15.117:0/157191167 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb138010890 con 0x7fb12c005320 2023-07-19T20:44:46.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.442+0000 7fb144f28700 1 -- 172.21.15.117:0/157191167 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138010c20 con 0x7fb12c005320 2023-07-19T20:44:46.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.443+0000 7fb14818e700 1 -- 172.21.15.117:0/157191167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb12c005320 msgr2=0x7fb12c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.443+0000 7fb14818e700 1 --2- 172.21.15.117:0/157191167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb12c005320 0x7fb12c00ba10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb13800a7d0 tx=0x7fb12c005880 comp rx=0 tx=0).stop 2023-07-19T20:44:46.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.443+0000 7fb14672b700 1 -- 172.21.15.117:0/157191167 reap_dead start 2023-07-19T20:44:46.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.444+0000 7fb14818e700 1 -- 172.21.15.117:0/157191167 shutdown_connections 2023-07-19T20:44:46.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.444+0000 7fb14818e700 1 -- 172.21.15.117:0/157191167 >> 172.21.15.117:0/157191167 conn(0x7fb1400bdc00 msgr2=0x7fb1400b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.446+0000 7fe83a4e8700 1 Processor -- start 2023-07-19T20:44:46.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.446+0000 7fe83a4e8700 1 -- start start 2023-07-19T20:44:46.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.447+0000 7fe83a4e8700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe8340b3de0 0x7fe8340b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.447+0000 7fe83a4e8700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe834140da0 0x7fe834151260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.447+0000 7fe83a4e8700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83414a800 con 0x7fe834140950 2023-07-19T20:44:46.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.447+0000 7fe83a4e8700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe834149ed0 con 0x7fe8340b3de0 2023-07-19T20:44:46.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.447+0000 7fe83a4e8700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83414a1b0 con 0x7fe834140da0 2023-07-19T20:44:46.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.448+0000 7fe838a85700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe834140da0 0x7fe834151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.448+0000 7fe838a85700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe834140da0 0x7fe834151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:39876/0 (socket says 172.21.15.117:39876) 2023-07-19T20:44:46.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.448+0000 7fe838a85700 1 -- 172.21.15.117:0/4279090748 learned_addr learned my addr 172.21.15.117:0/4279090748 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.448+0000 7fe838a85700 1 -- 172.21.15.117:0/4279090748 >> v2:172.21.15.117:3300/0 conn(0x7fe8340b3de0 msgr2=0x7fe8340b70f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-19T20:44:46.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.448+0000 7fe838a85700 1 --2- 172.21.15.117:0/4279090748 >> v2:172.21.15.117:3300/0 conn(0x7fe8340b3de0 0x7fe8340b70f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.448+0000 7fe838a85700 1 -- 172.21.15.117:0/4279090748 >> v1:172.21.15.124:6789/0 conn(0x7fe834140950 legacy=0x7fe8340b4e80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-19T20:44:46.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.448+0000 7fe838a85700 1 -- 172.21.15.117:0/4279090748 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83414a490 con 0x7fe834140da0 2023-07-19T20:44:46.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.448+0000 7fe838a85700 1 --2- 172.21.15.117:0/4279090748 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe834140da0 0x7fe834151260 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009e50 tx=0x7fe82c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a79e7c510d701b8a server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.446 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.448+0000 7fe832ffd700 1 -- 172.21.15.117:0/4279090748 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c003c20 con 0x7fe834140da0 2023-07-19T20:44:46.446 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.449+0000 7fb14818e700 1 -- 172.21.15.117:0/157191167 shutdown_connections 2023-07-19T20:44:46.446 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.448+0000 7fe832ffd700 1 -- 172.21.15.117:0/4279090748 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c003d80 con 0x7fe834140da0 2023-07-19T20:44:46.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.449+0000 7fe832ffd700 1 -- 172.21.15.117:0/4279090748 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00bbc0 con 0x7fe834140da0 2023-07-19T20:44:46.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.449+0000 7fe83a4e8700 1 -- 172.21.15.117:0/4279090748 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe834140da0 msgr2=0x7fe834151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.449+0000 7fe83a4e8700 1 --2- 172.21.15.117:0/4279090748 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe834140da0 0x7fe834151260 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009e50 tx=0x7fe82c00b330 comp rx=0 tx=0).stop 2023-07-19T20:44:46.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.450+0000 7fe83a4e8700 1 -- 172.21.15.117:0/4279090748 shutdown_connections 2023-07-19T20:44:46.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.450+0000 7fe83a4e8700 1 --2- 172.21.15.117:0/4279090748 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe834140da0 0x7fe834151260 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.450+0000 7fe83a4e8700 1 --2- 172.21.15.117:0/4279090748 >> v2:172.21.15.117:3300/0 conn(0x7fe8340b3de0 0x7fe8340b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.450+0000 7fe83a4e8700 1 -- 172.21.15.117:0/4279090748 >> 172.21.15.117:0/4279090748 conn(0x7fe83406b1f0 msgr2=0x7fe8340bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.448 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.449+0000 7fb14818e700 1 -- 172.21.15.117:0/157191167 wait complete. 2023-07-19T20:44:46.448 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.451+0000 7fb14818e700 1 Processor -- start 2023-07-19T20:44:46.448 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.450+0000 7fe83a4e8700 1 -- 172.21.15.117:0/4279090748 shutdown_connections 2023-07-19T20:44:46.449 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.450+0000 7fe83a4e8700 1 -- 172.21.15.117:0/4279090748 wait complete. 2023-07-19T20:44:46.449 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.451+0000 7fe83a4e8700 1 Processor -- start 2023-07-19T20:44:46.450 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.452+0000 7fe83a4e8700 1 -- start start 2023-07-19T20:44:46.450 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fe83a4e8700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe8340b3de0 0x7fe834142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.450 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fe83a4e8700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe834140950 0x7fe834146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.450 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fe83a4e8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe834140da0 0x7fe834147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.450 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fe83a4e8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe834145580 con 0x7fe834140da0 2023-07-19T20:44:46.450 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fe83a4e8700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe834145050 con 0x7fe834140950 2023-07-19T20:44:46.450 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fe83a4e8700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8341452a0 con 0x7fe8340b3de0 2023-07-19T20:44:46.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fe838a85700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe834140da0 0x7fe834147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fe838a85700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe834140da0 0x7fe834147020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43810/0 (socket says 172.21.15.117:43810) 2023-07-19T20:44:46.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fe838a85700 1 -- 172.21.15.117:0/117523032 learned_addr learned my addr 172.21.15.117:0/117523032 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.452+0000 7fb14818e700 1 -- start start 2023-07-19T20:44:46.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fb14818e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb12c005320 0x7fb1401e0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fb14818e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb140145020 0x7fb1400badc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fb14818e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb140145490 0x7fb1400b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fb14818e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1401edc10 con 0x7fb140145020 2023-07-19T20:44:46.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fb14818e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1401459e0 con 0x7fb140145490 2023-07-19T20:44:46.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fb14818e700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1401ece50 con 0x7fb12c005320 2023-07-19T20:44:46.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fb14672b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb140145490 0x7fb1400b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fe838a85700 1 -- 172.21.15.117:0/117523032 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe8340b3de0 msgr2=0x7fe834142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fe838a85700 1 --2- 172.21.15.117:0/117523032 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe8340b3de0 0x7fe834142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fe838a85700 1 -- 172.21.15.117:0/117523032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe834140950 msgr2=0x7fe834146ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fe838a85700 1 --2- 172.21.15.117:0/117523032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe834140950 0x7fe834146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fe838a85700 1 -- 172.21.15.117:0/117523032 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c009b30 con 0x7fe834140da0 2023-07-19T20:44:46.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.453+0000 7fb145729700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb140145020 0x7fb1400badc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.454+0000 7fb145729700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb140145020 0x7fb1400badc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43822/0 (socket says 172.21.15.117:43822) 2023-07-19T20:44:46.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.454+0000 7fb145729700 1 -- 172.21.15.117:0/1881276492 learned_addr learned my addr 172.21.15.117:0/1881276492 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.454+0000 7fb145f2a700 1 --2- 172.21.15.117:0/1881276492 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb12c005320 0x7fb1401e0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.454+0000 7fe838a85700 1 --2- 172.21.15.117:0/117523032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe834140da0 0x7fe834147020 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe83414a2f0 tx=0x7fe82c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.454+0000 7fb145729700 1 -- 172.21.15.117:0/1881276492 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb12c005320 msgr2=0x7fb1401e0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.454+0000 7fb145729700 1 --2- 172.21.15.117:0/1881276492 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb12c005320 0x7fb1401e0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.454+0000 7fb145729700 1 -- 172.21.15.117:0/1881276492 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb140145490 msgr2=0x7fb1400b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.454+0000 7fb145729700 1 --2- 172.21.15.117:0/1881276492 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb140145490 0x7fb1400b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.454+0000 7fb145729700 1 -- 172.21.15.117:0/1881276492 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1401ed130 con 0x7fb140145020 2023-07-19T20:44:46.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.454+0000 7fe830ff9700 1 -- 172.21.15.117:0/117523032 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c01e070 con 0x7fe834140da0 2023-07-19T20:44:46.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.454+0000 7fe830ff9700 1 -- 172.21.15.117:0/117523032 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c0092e0 con 0x7fe834140da0 2023-07-19T20:44:46.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.454+0000 7fe830ff9700 1 -- 172.21.15.117:0/117523032 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c004870 con 0x7fe834140da0 2023-07-19T20:44:46.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.454+0000 7fe83a4e8700 1 -- 172.21.15.117:0/117523032 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe834145880 con 0x7fe834140da0 2023-07-19T20:44:46.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.454+0000 7fe83a4e8700 1 -- 172.21.15.117:0/117523032 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe834142d80 con 0x7fe834140da0 2023-07-19T20:44:46.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.455+0000 7fb145729700 1 --2- 172.21.15.117:0/1881276492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb140145020 0x7fb1400badc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb14006bee0 tx=0x7fb13c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.455+0000 7fd7ef3c3700 1 Processor -- start 2023-07-19T20:44:46.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.456+0000 7fd7ef3c3700 1 -- start start 2023-07-19T20:44:46.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.456+0000 7fd7ef3c3700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd7e8072990 0x7fd7e80b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.456+0000 7fd7ef3c3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd7e80b8da0 0x7fd7e8159590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.457+0000 7fd7ef3c3700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e80b7630 con 0x7fd7e8149220 2023-07-19T20:44:46.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.457+0000 7fd7ef3c3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e80b8310 con 0x7fd7e80b8da0 2023-07-19T20:44:46.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.457+0000 7fd7ef3c3700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80bd590 con 0x7fd7e8072990 2023-07-19T20:44:46.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.456+0000 7fe83a4e8700 1 -- 172.21.15.117:0/117523032 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe834145da0 con 0x7fe834140da0 2023-07-19T20:44:46.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.457+0000 7fe830ff9700 1 -- 172.21.15.117:0/117523032 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fe82c0193f0 con 0x7fe834140da0 2023-07-19T20:44:46.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.457+0000 7fe830ff9700 1 --2- 172.21.15.117:0/117523032 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe82006a730 0x7fe82006cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.457+0000 7fe830ff9700 1 -- 172.21.15.117:0/117523032 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe82c00e030 con 0x7fe834140da0 2023-07-19T20:44:46.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.456+0000 7f0321846700 1 Processor -- start 2023-07-19T20:44:46.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.456+0000 7f0321846700 1 -- start start 2023-07-19T20:44:46.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.460+0000 7f0321846700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f031c149220 0x7f031c0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.460+0000 7f0321846700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f031c072990 0x7f031c0bce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.460+0000 7f0321846700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f031c0b8da0 0x7f031c14ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.460+0000 7f0321846700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f031c0b8310 con 0x7f031c0b8da0 2023-07-19T20:44:46.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.460+0000 7f0321846700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f031c0b7630 con 0x7f031c149220 2023-07-19T20:44:46.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.460+0000 7f0321846700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031c1523a0 con 0x7f031c072990 2023-07-19T20:44:46.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.460+0000 7f031a7fc700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f031c072990 0x7f031c0bce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.460+0000 7f031b7fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f031c0b8da0 0x7f031c14ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.460+0000 7f031b7fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f031c0b8da0 0x7f031c14ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43848/0 (socket says 172.21.15.117:43848) 2023-07-19T20:44:46.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.460+0000 7f031b7fe700 1 -- 172.21.15.117:0/4256041814 learned_addr learned my addr 172.21.15.117:0/4256041814 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.461+0000 7f031b7fe700 1 -- 172.21.15.117:0/4256041814 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f031c072990 msgr2=0x7f031c0bce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:46.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.461+0000 7f031b7fe700 1 --2- 172.21.15.117:0/4256041814 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f031c072990 0x7f031c0bce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.461+0000 7f031b7fe700 1 -- 172.21.15.117:0/4256041814 >> v2:172.21.15.124:3300/0 conn(0x7f031c149220 msgr2=0x7f031c0b70f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-19T20:44:46.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.461+0000 7f031b7fe700 1 --2- 172.21.15.117:0/4256041814 >> v2:172.21.15.124:3300/0 conn(0x7f031c149220 0x7f031c0b70f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.461+0000 7f031b7fe700 1 -- 172.21.15.117:0/4256041814 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c152680 con 0x7f031c0b8da0 2023-07-19T20:44:46.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.461+0000 7f031b7fe700 1 --2- 172.21.15.117:0/4256041814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f031c0b8da0 0x7f031c14ecd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f031c0bd830 tx=0x7f031400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c67d2e556efcc39 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.458+0000 7fb1367fc700 1 -- 172.21.15.117:0/1881276492 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c004220 con 0x7fb140145020 2023-07-19T20:44:46.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.458+0000 7fb1367fc700 1 -- 172.21.15.117:0/1881276492 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c004380 con 0x7fb140145020 2023-07-19T20:44:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.458+0000 7fb1367fc700 1 -- 172.21.15.117:0/1881276492 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0036a0 con 0x7fb140145020 2023-07-19T20:44:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.462+0000 7fb14818e700 1 -- 172.21.15.117:0/1881276492 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1401ed410 con 0x7fb140145020 2023-07-19T20:44:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.462+0000 7fb14818e700 1 -- 172.21.15.117:0/1881276492 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1400bc9a0 con 0x7fb140145020 2023-07-19T20:44:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.462+0000 7fe833fff700 1 --2- 172.21.15.117:0/117523032 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe82006a730 0x7fe82006cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.463+0000 7fb14818e700 1 -- 172.21.15.117:0/1881276492 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1401ed930 con 0x7fb140145020 2023-07-19T20:44:46.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.463+0000 7fe833fff700 1 --2- 172.21.15.117:0/117523032 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe82006a730 0x7fe82006cbe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe8240015f0 tx=0x7fe824007ae0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.457+0000 7fd7ec95e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd7e8072990 0x7fd7e80b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.457+0000 7fd7ec95e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd7e8072990 0x7fd7e80b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:39908/0 (socket says 172.21.15.117:39908) 2023-07-19T20:44:46.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.457+0000 7fd7ec95e700 1 -- 172.21.15.117:0/134208214 learned_addr learned my addr 172.21.15.117:0/134208214 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.457+0000 7fd7ec95e700 1 -- 172.21.15.117:0/134208214 >> v2:172.21.15.117:3300/0 conn(0x7fd7e80b8da0 msgr2=0x7fd7e8159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:46.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.457+0000 7fd7ec95e700 1 --2- 172.21.15.117:0/134208214 >> v2:172.21.15.117:3300/0 conn(0x7fd7e80b8da0 0x7fd7e8159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.457+0000 7fd7ec95e700 1 -- 172.21.15.117:0/134208214 >> v1:172.21.15.117:6789/0 conn(0x7fd7e8149220 legacy=0x7fd7e80bce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:46.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.457+0000 7fd7ec95e700 1 -- 172.21.15.117:0/134208214 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e81523a0 con 0x7fd7e8072990 2023-07-19T20:44:46.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.458+0000 7fd7ec95e700 1 --2- 172.21.15.117:0/134208214 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd7e8072990 0x7fd7e80b70f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40098f0 tx=0x7fd7e4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=990565c3fea51f29 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.462+0000 7fd7dffff700 1 -- 172.21.15.117:0/134208214 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4004230 con 0x7fd7e8072990 2023-07-19T20:44:46.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.462+0000 7fd7dffff700 1 -- 172.21.15.117:0/134208214 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e4004390 con 0x7fd7e8072990 2023-07-19T20:44:46.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.462+0000 7fd7dffff700 1 -- 172.21.15.117:0/134208214 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40036a0 con 0x7fd7e8072990 2023-07-19T20:44:46.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.463+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/134208214 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd7e8072990 msgr2=0x7fd7e80b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.463+0000 7fd7ef3c3700 1 --2- 172.21.15.117:0/134208214 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd7e8072990 0x7fd7e80b70f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40098f0 tx=0x7fd7e4009c00 comp rx=0 tx=0).stop 2023-07-19T20:44:46.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.466+0000 7fe830ff9700 1 -- 172.21.15.117:0/117523032 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fe834145da0 con 0x7fe834140da0 2023-07-19T20:44:46.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.468+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/134208214 shutdown_connections 2023-07-19T20:44:46.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.468+0000 7fd7ef3c3700 1 --2- 172.21.15.117:0/134208214 >> v2:172.21.15.117:3300/0 conn(0x7fd7e80b8da0 0x7fd7e8159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.472 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.468+0000 7fd7ef3c3700 1 --2- 172.21.15.117:0/134208214 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd7e8072990 0x7fd7e80b70f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.472 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.468+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/134208214 >> 172.21.15.117:0/134208214 conn(0x7fd7e806b1f0 msgr2=0x7fd7e80bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.472 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.464+0000 7fd51fd5d700 1 Processor -- start 2023-07-19T20:44:46.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.464+0000 7fd51fd5d700 1 -- start start 2023-07-19T20:44:46.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.464+0000 7fd51fd5d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd518072990 0x7fd518158090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.465+0000 7fd51fd5d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd5180b70f0 0x7fd518161ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.465+0000 7fd51fd5d700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5180b82a0 con 0x7fd5180bd0f0 2023-07-19T20:44:46.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.465+0000 7fd51fd5d700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5181576b0 con 0x7fd518072990 2023-07-19T20:44:46.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.465+0000 7fd51fd5d700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5181585d0 con 0x7fd5180b70f0 2023-07-19T20:44:46.474 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.465+0000 7fd51e2fa700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd5180b70f0 0x7fd518161ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.474 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.465+0000 7fd51e2fa700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd5180b70f0 0x7fd518161ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58292/0 (socket says 172.21.15.117:58292) 2023-07-19T20:44:46.474 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.465+0000 7fd51e2fa700 1 -- 172.21.15.117:0/1632350229 learned_addr learned my addr 172.21.15.117:0/1632350229 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.474 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.465+0000 7fd51caf7700 1 -- 172.21.15.117:0/1632350229 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262774918 0 0) 0x7fd5180b82a0 con 0x7fd5180bd0f0 2023-07-19T20:44:46.474 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.468+0000 7fd51caf7700 1 -- 172.21.15.117:0/1632350229 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd504003a00 con 0x7fd5180bd0f0 2023-07-19T20:44:46.475 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.468+0000 7fb1367fc700 1 -- 172.21.15.117:0/1881276492 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fb13c003800 con 0x7fb140145020 2023-07-19T20:44:46.475 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.469+0000 7fb1367fc700 1 --2- 172.21.15.117:0/1881276492 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb12406a630 0x7fb12406cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.475 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.469+0000 7fb1367fc700 1 -- 172.21.15.117:0/1881276492 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb13c088720 con 0x7fb140145020 2023-07-19T20:44:46.475 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.469+0000 7f0319ffb700 1 -- 172.21.15.117:0/4256041814 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031400e070 con 0x7f031c0b8da0 2023-07-19T20:44:46.476 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.469+0000 7f0319ffb700 1 -- 172.21.15.117:0/4256041814 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031400b910 con 0x7f031c0b8da0 2023-07-19T20:44:46.476 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.469+0000 7f0319ffb700 1 -- 172.21.15.117:0/4256041814 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031400bcc0 con 0x7f031c0b8da0 2023-07-19T20:44:46.476 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.469+0000 7fd51caf7700 1 -- 172.21.15.117:0/1632350229 <== mon.1 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4289888224 0 0) 0x7fd504003a00 con 0x7fd5180bd0f0 2023-07-19T20:44:46.476 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.469+0000 7fd51caf7700 1 -- 172.21.15.117:0/1632350229 >> v2:172.21.15.124:3300/0 conn(0x7fd5180b70f0 msgr2=0x7fd518161ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:46.476 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.469+0000 7fd51caf7700 1 --2- 172.21.15.117:0/1632350229 >> v2:172.21.15.124:3300/0 conn(0x7fd5180b70f0 0x7fd518161ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.477 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.469+0000 7fd51caf7700 1 -- 172.21.15.117:0/1632350229 >> v2:172.21.15.117:3300/0 conn(0x7fd518072990 msgr2=0x7fd518158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:46.477 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.469+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/134208214 shutdown_connections 2023-07-19T20:44:46.477 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.469+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/134208214 wait complete. 2023-07-19T20:44:46.478 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.470+0000 7f0321846700 1 -- 172.21.15.117:0/4256041814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f031c0b8da0 msgr2=0x7f031c14ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.478 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.470+0000 7f0321846700 1 --2- 172.21.15.117:0/4256041814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f031c0b8da0 0x7f031c14ecd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f031c0bd830 tx=0x7f031400b330 comp rx=0 tx=0).stop 2023-07-19T20:44:46.478 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.466+0000 7fd51d2f8700 1 --2- 172.21.15.117:0/1632350229 >> v2:172.21.15.117:3300/0 conn(0x7fd518072990 0x7fd518158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.478 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51caf7700 1 --2- 172.21.15.117:0/1632350229 >> v2:172.21.15.117:3300/0 conn(0x7fd518072990 0x7fd518158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.478 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51caf7700 1 -- 172.21.15.117:0/1632350229 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5180b6230 con 0x7fd5180bd0f0 2023-07-19T20:44:46.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51caf7700 1 -- 172.21.15.117:0/1632350229 <== mon.1 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7fd514001670 con 0x7fd5180bd0f0 2023-07-19T20:44:46.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51caf7700 1 -- 172.21.15.117:0/1632350229 >> v1:172.21.15.124:6789/0 conn(0x7fd5180bd0f0 legacy=0x7fd51808a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51caf7700 1 --2- 172.21.15.117:0/1632350229 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd504003ea0 0x7fd5040042b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51caf7700 1 --2- 172.21.15.117:0/1632350229 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5040047f0 0x7fd504004ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51caf7700 1 --2- 172.21.15.117:0/1632350229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd504005250 0x7fd5040056f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51caf7700 1 -- 172.21.15.117:0/1632350229 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181576b0 con 0x7fd504005250 2023-07-19T20:44:46.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51caf7700 1 -- 172.21.15.117:0/1632350229 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181585d0 con 0x7fd5040047f0 2023-07-19T20:44:46.480 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51caf7700 1 -- 172.21.15.117:0/1632350229 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50400d310 con 0x7fd504003ea0 2023-07-19T20:44:46.480 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51d2f8700 1 --2- 172.21.15.117:0/1632350229 >> v2:172.21.15.117:3300/0 conn(0x7fd518072990 0x7fd518158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:46.480 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd7ef3c3700 1 Processor -- start 2023-07-19T20:44:46.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51daf9700 1 --2- 172.21.15.117:0/1632350229 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd504003ea0 0x7fd5040042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51d2f8700 1 --2- 172.21.15.117:0/1632350229 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5040047f0 0x7fd504004ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51daf9700 1 -- 172.21.15.117:0/1632350229 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5040047f0 msgr2=0x7fd504004ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:46.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51daf9700 1 --2- 172.21.15.117:0/1632350229 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5040047f0 0x7fd504004ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51daf9700 1 -- 172.21.15.117:0/1632350229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd504005250 msgr2=0x7fd5040056f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:46.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51daf9700 1 --2- 172.21.15.117:0/1632350229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd504005250 0x7fd5040056f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd51daf9700 1 -- 172.21.15.117:0/1632350229 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd504003a00 con 0x7fd504003ea0 2023-07-19T20:44:46.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.472+0000 7fd51daf9700 1 --2- 172.21.15.117:0/1632350229 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd504003ea0 0x7fd5040042b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd514001eb0 tx=0x7fd504005cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d47895bf1f7f70a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.472+0000 7fd51e2fa700 1 -- 172.21.15.117:0/1632350229 reap_dead start 2023-07-19T20:44:46.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.472+0000 7fd51caf7700 1 -- 172.21.15.117:0/1632350229 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51400dd30 con 0x7fd504003ea0 2023-07-19T20:44:46.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.472+0000 7fd51caf7700 1 -- 172.21.15.117:0/1632350229 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51400de90 con 0x7fd504003ea0 2023-07-19T20:44:46.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.472+0000 7fd51caf7700 1 -- 172.21.15.117:0/1632350229 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140106a0 con 0x7fd504003ea0 2023-07-19T20:44:46.483 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.471+0000 7fd7ef3c3700 1 -- start start 2023-07-19T20:44:46.483 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.472+0000 7fd7ef3c3700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd7e80b8da0 0x7fd7e81e7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.483 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.472+0000 7fd7ef3c3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e8149220 0x7fd7e814e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.483 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.472+0000 7fd7ef3c3700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd7e81499e0 0x7fd7e814e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.484 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.472+0000 7fd7ef3c3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e814c190 con 0x7fd7e8149220 2023-07-19T20:44:46.484 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.472+0000 7fd7ef3c3700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e814ddd0 con 0x7fd7e81499e0 2023-07-19T20:44:46.484 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.472+0000 7fd7ef3c3700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e81e86c0 con 0x7fd7e80b8da0 2023-07-19T20:44:46.484 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7fd7ed15f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd7e80b8da0 0x7fd7e81e7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.484 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7fd7ed15f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd7e80b8da0 0x7fd7e81e7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:39932/0 (socket says 172.21.15.117:39932) 2023-07-19T20:44:46.484 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7fd7ed15f700 1 -- 172.21.15.117:0/1041158337 learned_addr learned my addr 172.21.15.117:0/1041158337 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.484 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7fd7ed960700 1 --2- 172.21.15.117:0/1041158337 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd7e81499e0 0x7fd7e814e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.485 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7fb145f2a700 1 --2- 172.21.15.117:0/1881276492 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb12406a630 0x7fb12406cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.485 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7f0321846700 1 -- 172.21.15.117:0/4256041814 shutdown_connections 2023-07-19T20:44:46.485 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7f0321846700 1 --2- 172.21.15.117:0/4256041814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f031c0b8da0 0x7f031c14ecd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.486 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7f0321846700 1 --2- 172.21.15.117:0/4256041814 >> v2:172.21.15.124:3300/0 conn(0x7f031c149220 0x7f031c0b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.486 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7f0321846700 1 --2- 172.21.15.117:0/4256041814 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f031c072990 0x7f031c0bce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.486 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7f0321846700 1 -- 172.21.15.117:0/4256041814 >> 172.21.15.117:0/4256041814 conn(0x7f031c06b1f0 msgr2=0x7f031c0bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.486 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7fd51fd5d700 1 -- 172.21.15.117:0/1632350229 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd504003ea0 msgr2=0x7fd5040042b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.486 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7fd51fd5d700 1 --2- 172.21.15.117:0/1632350229 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd504003ea0 0x7fd5040042b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd514001eb0 tx=0x7fd504005cd0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.487 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7f08bf801700 1 Processor -- start 2023-07-19T20:44:46.487 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7f0321846700 1 -- 172.21.15.117:0/4256041814 shutdown_connections 2023-07-19T20:44:46.487 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7f0321846700 1 -- 172.21.15.117:0/4256041814 wait complete. 2023-07-19T20:44:46.488 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7fd7ed15f700 1 -- 172.21.15.117:0/1041158337 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd7e81499e0 msgr2=0x7fd7e814e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.488 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7fd7ed15f700 1 --2- 172.21.15.117:0/1041158337 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd7e81499e0 0x7fd7e814e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.488 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7fd7ed15f700 1 -- 172.21.15.117:0/1041158337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e8149220 msgr2=0x7fd7e814e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.488 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7fd7ed15f700 1 --2- 172.21.15.117:0/1041158337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e8149220 0x7fd7e814e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.488 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7fd7ed15f700 1 -- 172.21.15.117:0/1041158337 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e4009550 con 0x7fd7e80b8da0 2023-07-19T20:44:46.489 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.473+0000 7f08bf801700 1 -- start start 2023-07-19T20:44:46.489 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.474+0000 7fb145f2a700 1 --2- 172.21.15.117:0/1881276492 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb12406a630 0x7fb12406cae0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb130009890 tx=0x7fb130008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.489 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.474+0000 7fd7ed15f700 1 --2- 172.21.15.117:0/1041158337 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd7e80b8da0 0x7fd7e81e7d60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800b470 tx=0x7fd7d800b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.490 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.474+0000 7fd51fd5d700 1 -- 172.21.15.117:0/1632350229 shutdown_connections 2023-07-19T20:44:46.490 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.474+0000 7fd51fd5d700 1 --2- 172.21.15.117:0/1632350229 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd504003ea0 0x7fd5040042b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.491 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.474+0000 7fd51fd5d700 1 -- 172.21.15.117:0/1632350229 >> 172.21.15.117:0/1632350229 conn(0x7fd51806b1f0 msgr2=0x7fd5180bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.491 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.474+0000 7fd51fd5d700 1 -- 172.21.15.117:0/1632350229 shutdown_connections 2023-07-19T20:44:46.491 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.474+0000 7fd51fd5d700 1 -- 172.21.15.117:0/1632350229 wait complete. 2023-07-19T20:44:46.491 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.474+0000 7f08bf801700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f08b8140950 0x7f08b80b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.491 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.474+0000 7f08bf801700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f08b8140da0 0x7f08b8151260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.492 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.474+0000 7f08bf801700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b814a800 con 0x7f08b80b3de0 2023-07-19T20:44:46.492 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.474+0000 7f08bf801700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b80b7800 con 0x7f08b8140da0 2023-07-19T20:44:46.492 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.474+0000 7f08bf801700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b8149ed0 con 0x7f08b8140950 2023-07-19T20:44:46.492 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.475+0000 7f0321846700 1 Processor -- start 2023-07-19T20:44:46.493 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.475+0000 7f0321846700 1 -- start start 2023-07-19T20:44:46.493 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.475+0000 7f08bcd9c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f08b8140950 0x7f08b80b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.493 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.475+0000 7f08bcd9c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f08b8140950 0x7f08b80b4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58326/0 (socket says 172.21.15.117:58326) 2023-07-19T20:44:46.493 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.475+0000 7f08bcd9c700 1 -- 172.21.15.117:0/541596988 learned_addr learned my addr 172.21.15.117:0/541596988 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.475+0000 7f08bcd9c700 1 -- 172.21.15.117:0/541596988 >> v2:172.21.15.117:3300/0 conn(0x7f08b8140da0 msgr2=0x7f08b8151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:46.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.475+0000 7f08bcd9c700 1 --2- 172.21.15.117:0/541596988 >> v2:172.21.15.117:3300/0 conn(0x7f08b8140da0 0x7f08b8151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.475+0000 7f08bcd9c700 1 -- 172.21.15.117:0/541596988 >> v1:172.21.15.117:6789/0 conn(0x7f08b80b3de0 legacy=0x7f08b80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:46.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.475+0000 7f08bcd9c700 1 -- 172.21.15.117:0/541596988 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b814a1b0 con 0x7f08b8140950 2023-07-19T20:44:46.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.476+0000 7f08bcd9c700 1 --2- 172.21.15.117:0/541596988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08b8140950 0x7f08b80b4e80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f08b806ecf0 tx=0x7f08a800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea0d66da03850b3b server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.495 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.476+0000 7f0321846700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f031c0b8da0 0x7f031c14ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.495 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.476+0000 7f0321846700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f031c149220 0x7f031c14f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.495 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.476+0000 7f0321846700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f031c14d7a0 0x7f031c14dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.495 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.476+0000 7f0321846700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c06f370 con 0x7f031c149220 2023-07-19T20:44:46.495 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.476+0000 7f0321846700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c14e150 con 0x7f031c14d7a0 2023-07-19T20:44:46.495 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.476+0000 7f0321846700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031c14d2a0 con 0x7f031c0b8da0 2023-07-19T20:44:46.496 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.476+0000 7fb1367fc700 1 -- 172.21.15.117:0/1881276492 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fb13c0522c0 con 0x7fb140145020 2023-07-19T20:44:46.496 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.476+0000 7f031b7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f031c14d7a0 0x7f031c14dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.497 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f031b7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f031c14d7a0 0x7f031c14dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58328/0 (socket says 172.21.15.117:58328) 2023-07-19T20:44:46.497 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f031b7fe700 1 -- 172.21.15.117:0/258948722 learned_addr learned my addr 172.21.15.117:0/258948722 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.497 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f031affd700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f031c0b8da0 0x7f031c14ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.497 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f031a7fc700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f031c149220 0x7f031c14f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.497 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7fd7ddffb700 1 -- 172.21.15.117:0/1041158337 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8011830 con 0x7fd7e80b8da0 2023-07-19T20:44:46.498 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7fd7ddffb700 1 -- 172.21.15.117:0/1041158337 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d80119b0 con 0x7fd7e80b8da0 2023-07-19T20:44:46.498 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f031b7fe700 1 -- 172.21.15.117:0/258948722 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f031c0b8da0 msgr2=0x7f031c14ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.498 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f031b7fe700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f031c0b8da0 0x7f031c14ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.498 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f031b7fe700 1 -- 172.21.15.117:0/258948722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f031c149220 msgr2=0x7f031c14f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.498 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f031b7fe700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f031c149220 0x7f031c14f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.499 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f031b7fe700 1 -- 172.21.15.117:0/258948722 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0314009b30 con 0x7f031c14d7a0 2023-07-19T20:44:46.499 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f031affd700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f031c0b8da0 0x7f031c14ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:46.499 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f031a7fc700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f031c149220 0x7f031c14f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:46.499 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f031b7fe700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f031c14d7a0 0x7f031c14dc10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f031400b370 tx=0x7f0314004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.499 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f0303fff700 1 -- 172.21.15.117:0/258948722 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314004250 con 0x7f031c14d7a0 2023-07-19T20:44:46.499 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f0303fff700 1 -- 172.21.15.117:0/258948722 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03140043d0 con 0x7f031c14d7a0 2023-07-19T20:44:46.500 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f0303fff700 1 -- 172.21.15.117:0/258948722 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140047c0 con 0x7f031c14d7a0 2023-07-19T20:44:46.500 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f0321846700 1 -- 172.21.15.117:0/258948722 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031c1e4f80 con 0x7f031c14d7a0 2023-07-19T20:44:46.500 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7f0321846700 1 -- 172.21.15.117:0/258948722 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031c1e5540 con 0x7f031c14d7a0 2023-07-19T20:44:46.500 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7fd7ddffb700 1 -- 172.21.15.117:0/1041158337 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8011d60 con 0x7fd7e80b8da0 2023-07-19T20:44:46.500 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/1041158337 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e81e89a0 con 0x7fd7e80b8da0 2023-07-19T20:44:46.501 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/1041158337 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e81e82a0 con 0x7fd7e80b8da0 2023-07-19T20:44:46.501 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.478+0000 7f08affff700 1 -- 172.21.15.117:0/541596988 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8010070 con 0x7f08b8140950 2023-07-19T20:44:46.501 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.478+0000 7f08affff700 1 -- 172.21.15.117:0/541596988 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a800da40 con 0x7f08b8140950 2023-07-19T20:44:46.501 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.478+0000 7f08affff700 1 -- 172.21.15.117:0/541596988 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a800ddd0 con 0x7f08b8140950 2023-07-19T20:44:46.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.478+0000 7f08bf801700 1 -- 172.21.15.117:0/541596988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08b8140950 msgr2=0x7f08b80b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.478+0000 7f08bf801700 1 --2- 172.21.15.117:0/541596988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08b8140950 0x7f08b80b4e80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f08b806ecf0 tx=0x7f08a800d330 comp rx=0 tx=0).stop 2023-07-19T20:44:46.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.479+0000 7f0321846700 1 -- 172.21.15.117:0/258948722 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031c14d4c0 con 0x7f031c14d7a0 2023-07-19T20:44:46.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.479+0000 7f0303fff700 1 -- 172.21.15.117:0/258948722 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f031401c440 con 0x7f031c14d7a0 2023-07-19T20:44:46.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.480+0000 7f0303fff700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f030806a730 0x7f030806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.480+0000 7f0303fff700 1 -- 172.21.15.117:0/258948722 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0314089f20 con 0x7f031c14d7a0 2023-07-19T20:44:46.503 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.481+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/1041158337 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e8074890 con 0x7fd7e80b8da0 2023-07-19T20:44:46.503 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.481+0000 7fd7ddffb700 1 -- 172.21.15.117:0/1041158337 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fd7d801a400 con 0x7fd7e80b8da0 2023-07-19T20:44:46.503 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.481+0000 7fd7ddffb700 1 --2- 172.21.15.117:0/1041158337 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd7cc06a680 0x7fd7cc06cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.503 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.481+0000 7fd7ddffb700 1 -- 172.21.15.117:0/1041158337 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7d8088a50 con 0x7fd7e80b8da0 2023-07-19T20:44:46.504 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.481+0000 7fd7ec95e700 1 --2- 172.21.15.117:0/1041158337 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd7cc06a680 0x7fd7cc06cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.504 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.482+0000 7fd7ec95e700 1 --2- 172.21.15.117:0/1041158337 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd7cc06a680 0x7fd7cc06cb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd7e81e56b0 tx=0x7fd7e4010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.504 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.482+0000 7f031affd700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f030806a730 0x7f030806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.477+0000 7fd51fd5d700 1 Processor -- start 2023-07-19T20:44:46.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.479+0000 7fd51fd5d700 1 -- start start 2023-07-19T20:44:46.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.480+0000 7fd51fd5d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd504003ea0 0x7fd5181e6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.480+0000 7fd51fd5d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5181e95d0 0x7fd518159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.480+0000 7fd51fd5d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd51815a5f0 0x7fd51815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.480+0000 7fd51fd5d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51815a090 con 0x7fd5181e95d0 2023-07-19T20:44:46.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.480+0000 7fd51fd5d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181e7030 con 0x7fd504003ea0 2023-07-19T20:44:46.506 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.480+0000 7fd51fd5d700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51815b090 con 0x7fd51815a5f0 2023-07-19T20:44:46.506 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.480+0000 7fd51d2f8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5181e95d0 0x7fd518159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.506 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.480+0000 7fd51d2f8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5181e95d0 0x7fd518159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43890/0 (socket says 172.21.15.117:43890) 2023-07-19T20:44:46.506 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.480+0000 7fd51d2f8700 1 -- 172.21.15.117:0/285641493 learned_addr learned my addr 172.21.15.117:0/285641493 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.506 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.481+0000 7fd51e2fa700 1 --2- 172.21.15.117:0/285641493 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd51815a5f0 0x7fd51815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.506 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.481+0000 7fd51daf9700 1 --2- 172.21.15.117:0/285641493 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd504003ea0 0x7fd5181e6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.506 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.481+0000 7fd51d2f8700 1 -- 172.21.15.117:0/285641493 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd51815a5f0 msgr2=0x7fd51815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.481+0000 7fd51d2f8700 1 --2- 172.21.15.117:0/285641493 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd51815a5f0 0x7fd51815aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.481+0000 7fd51d2f8700 1 -- 172.21.15.117:0/285641493 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd504003ea0 msgr2=0x7fd5181e6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.481+0000 7fd51d2f8700 1 --2- 172.21.15.117:0/285641493 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd504003ea0 0x7fd5181e6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.481+0000 7fd51d2f8700 1 -- 172.21.15.117:0/285641493 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd518158d30 con 0x7fd5181e95d0 2023-07-19T20:44:46.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.482+0000 7fd51d2f8700 1 --2- 172.21.15.117:0/285641493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5181e95d0 0x7fd518159450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd50800cc20 tx=0x7fd50800a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.482+0000 7fd50e7fc700 1 -- 172.21.15.117:0/285641493 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800a8e0 con 0x7fd5181e95d0 2023-07-19T20:44:46.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.482+0000 7fd50e7fc700 1 -- 172.21.15.117:0/285641493 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50800aa40 con 0x7fd5181e95d0 2023-07-19T20:44:46.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.482+0000 7fd50e7fc700 1 -- 172.21.15.117:0/285641493 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800add0 con 0x7fd5181e95d0 2023-07-19T20:44:46.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.482+0000 7fd51fd5d700 1 -- 172.21.15.117:0/285641493 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5181e85c0 con 0x7fd5181e95d0 2023-07-19T20:44:46.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.482+0000 7fd51fd5d700 1 -- 172.21.15.117:0/285641493 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd518159990 con 0x7fd5181e95d0 2023-07-19T20:44:46.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.483+0000 7f031affd700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f030806a730 0x7f030806cbe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f030c006fd0 tx=0x7f030c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.484+0000 7f0303fff700 1 -- 172.21.15.117:0/258948722 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f031c14d4c0 con 0x7f031c14d7a0 2023-07-19T20:44:46.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.484+0000 7fd50e7fc700 1 -- 172.21.15.117:0/285641493 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fd508015070 con 0x7fd5181e95d0 2023-07-19T20:44:46.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.485+0000 7fd50e7fc700 1 --2- 172.21.15.117:0/285641493 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd4fc06a660 0x7fd4fc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.485+0000 7fd50e7fc700 1 -- 172.21.15.117:0/285641493 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd508088580 con 0x7fd5181e95d0 2023-07-19T20:44:46.510 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.486+0000 7fd7ddffb700 1 -- 172.21.15.117:0/1041158337 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fd7d8053f30 con 0x7fd7e80b8da0 2023-07-19T20:44:46.510 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.488+0000 7f08bf801700 1 -- 172.21.15.117:0/541596988 shutdown_connections 2023-07-19T20:44:46.510 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.488+0000 7f08bf801700 1 --2- 172.21.15.117:0/541596988 >> v2:172.21.15.117:3300/0 conn(0x7f08b8140da0 0x7f08b8151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.510 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.488+0000 7f08bf801700 1 --2- 172.21.15.117:0/541596988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08b8140950 0x7f08b80b4e80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.511 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.488+0000 7f08bf801700 1 -- 172.21.15.117:0/541596988 >> 172.21.15.117:0/541596988 conn(0x7f08b806b1f0 msgr2=0x7f08b80bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.511 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.488+0000 7f08bf801700 1 -- 172.21.15.117:0/541596988 shutdown_connections 2023-07-19T20:44:46.511 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.490+0000 7fd51daf9700 1 --2- 172.21.15.117:0/285641493 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd4fc06a660 0x7fd4fc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.512 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.488+0000 7f08bf801700 1 -- 172.21.15.117:0/541596988 wait complete. 2023-07-19T20:44:46.512 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.490+0000 7f08bf801700 1 Processor -- start 2023-07-19T20:44:46.512 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.490+0000 7f08bf801700 1 -- start start 2023-07-19T20:44:46.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.491+0000 7f08bf801700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08b80b3de0 0x7f08b80b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.491+0000 7f08bf801700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08b8140950 0x7f08b80b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.491+0000 7f08bf801700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08b8140da0 0x7f08b80b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.491+0000 7f08bf801700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b81e7d50 con 0x7f08b8140950 2023-07-19T20:44:46.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.491+0000 7f08bf801700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b81e8030 con 0x7f08b80b3de0 2023-07-19T20:44:46.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.491+0000 7f08bf801700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b81e8310 con 0x7f08b8140da0 2023-07-19T20:44:46.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.492+0000 7f08bd59d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08b80b3de0 0x7f08b80b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.492+0000 7f08bd59d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08b80b3de0 0x7f08b80b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58344/0 (socket says 172.21.15.117:58344) 2023-07-19T20:44:46.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.492+0000 7f08bd59d700 1 -- 172.21.15.117:0/132169726 learned_addr learned my addr 172.21.15.117:0/132169726 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:46.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.492+0000 7f08bdd9e700 1 --2- 172.21.15.117:0/132169726 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08b8140da0 0x7f08b80b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.493+0000 7f08bcd9c700 1 --2- 172.21.15.117:0/132169726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08b8140950 0x7f08b80b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.493+0000 7f08bcd9c700 1 -- 172.21.15.117:0/132169726 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08b8140da0 msgr2=0x7f08b80b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.493+0000 7f08bcd9c700 1 --2- 172.21.15.117:0/132169726 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08b8140da0 0x7f08b80b1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.493+0000 7f08bcd9c700 1 -- 172.21.15.117:0/132169726 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08b80b3de0 msgr2=0x7f08b80b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.493+0000 7f08bcd9c700 1 --2- 172.21.15.117:0/132169726 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08b80b3de0 0x7f08b80b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.493+0000 7f08bcd9c700 1 -- 172.21.15.117:0/132169726 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a80085d0 con 0x7f08b8140950 2023-07-19T20:44:46.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.494+0000 7f08bcd9c700 1 --2- 172.21.15.117:0/132169726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08b8140950 0x7f08b80b31b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08a8018000 tx=0x7f08a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.494+0000 7f08adffb700 1 -- 172.21.15.117:0/132169726 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8008de0 con 0x7f08b8140950 2023-07-19T20:44:46.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.494+0000 7f08adffb700 1 -- 172.21.15.117:0/132169726 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a80036a0 con 0x7f08b8140950 2023-07-19T20:44:46.516 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.494+0000 7f08adffb700 1 -- 172.21.15.117:0/132169726 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8003a50 con 0x7f08b8140950 2023-07-19T20:44:46.516 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.494+0000 7f08bf801700 1 -- 172.21.15.117:0/132169726 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b80b1240 con 0x7f08b8140950 2023-07-19T20:44:46.516 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.494+0000 7f08bf801700 1 -- 172.21.15.117:0/132169726 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b81e7950 con 0x7f08b8140950 2023-07-19T20:44:46.516 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.496+0000 7f08bf801700 1 -- 172.21.15.117:0/132169726 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b81e7e90 con 0x7f08b8140950 2023-07-19T20:44:46.517 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.501+0000 7fd51daf9700 1 --2- 172.21.15.117:0/285641493 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd4fc06a660 0x7fd4fc06cb10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd514001eb0 tx=0x7fd514009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.517 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.502+0000 7fd51fd5d700 1 -- 172.21.15.117:0/285641493 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd518159c10 con 0x7fd5181e95d0 2023-07-19T20:44:46.517 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.509+0000 7f08adffb700 1 -- 172.21.15.117:0/132169726 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f08a8003bb0 con 0x7f08b8140950 2023-07-19T20:44:46.518 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.509+0000 7f08adffb700 1 --2- 172.21.15.117:0/132169726 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f089c06a630 0x7f089c06cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:46.518 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.510+0000 7f08adffb700 1 -- 172.21.15.117:0/132169726 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08a8089990 con 0x7f08b8140950 2023-07-19T20:44:46.518 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.510+0000 7f08adffb700 1 -- 172.21.15.117:0/132169726 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f08a80b5360 con 0x7f08b8140950 2023-07-19T20:44:46.518 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.516+0000 7f08bd59d700 1 --2- 172.21.15.117:0/132169726 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f089c06a630 0x7f089c06cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:46.518 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.517+0000 7f08bd59d700 1 --2- 172.21.15.117:0/132169726 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f089c06a630 0x7f089c06cae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08b0002040 tx=0x7f08b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:46.519 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.518+0000 7fd50e7fc700 1 -- 172.21.15.117:0/285641493 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fd518159c10 con 0x7fd5181e95d0 2023-07-19T20:44:46.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.814+0000 7fb4cc39d700 1 -- 172.21.15.117:0/400091393 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb4ac005590 con 0x7fb4c40b28a0 2023-07-19T20:44:46.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.815+0000 7fb4baffd700 1 -- 172.21.15.117:0/400091393 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb4b40531b0 con 0x7fb4c40b28a0 2023-07-19T20:44:46.812 INFO:teuthology.orchestra.run.smithi117.stdout:60129542150 2023-07-19T20:44:46.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.818+0000 7fb4cc39d700 1 -- 172.21.15.117:0/400091393 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb4a806a6b0 msgr2=0x7fb4a806cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.818+0000 7fb4cc39d700 1 --2- 172.21.15.117:0/400091393 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb4a806a6b0 0x7fb4a806cb60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00e6c0 tx=0x7fb4bc013000 comp rx=0 tx=0).stop 2023-07-19T20:44:46.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.818+0000 7fb4cc39d700 1 -- 172.21.15.117:0/400091393 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb4c40b28a0 msgr2=0x7fb4c41eecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.818+0000 7fb4cc39d700 1 --2- 172.21.15.117:0/400091393 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb4c40b28a0 0x7fb4c41eecc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400c420 tx=0x7fb4b400c7e0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.818+0000 7fb4cc39d700 1 -- 172.21.15.117:0/400091393 shutdown_connections 2023-07-19T20:44:46.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.818+0000 7fb4cc39d700 1 --2- 172.21.15.117:0/400091393 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb4a806a6b0 0x7fb4a806cb60 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00e6c0 tx=0x7fb4bc013000 comp rx=0 tx=0).stop 2023-07-19T20:44:46.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.818+0000 7fb4cc39d700 1 --2- 172.21.15.117:0/400091393 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb4c40b28a0 0x7fb4c41eecc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.818+0000 7fb4cc39d700 1 --2- 172.21.15.117:0/400091393 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb4c408a600 0x7fb4c415b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.818+0000 7fb4cc39d700 1 --2- 172.21.15.117:0/400091393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c40bd0f0 0x7fb4c41f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.818+0000 7fb4cc39d700 1 -- 172.21.15.117:0/400091393 >> 172.21.15.117:0/400091393 conn(0x7fb4c406b1f0 msgr2=0x7fb4c40b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.818+0000 7f58d1d3e700 1 -- 172.21.15.117:0/3105245851 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f58ac005590 con 0x7f58cc140da0 2023-07-19T20:44:46.815 INFO:teuthology.orchestra.run.smithi117.stdout:60129542149 2023-07-19T20:44:46.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.822+0000 7fb4cc39d700 1 -- 172.21.15.117:0/400091393 shutdown_connections 2023-07-19T20:44:46.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.819+0000 7f58b3fff700 1 -- 172.21.15.117:0/3105245851 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58c001f030 con 0x7f58cc140da0 2023-07-19T20:44:46.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.822+0000 7f58d1d3e700 1 -- 172.21.15.117:0/3105245851 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f58b806a730 msgr2=0x7f58b806cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.822+0000 7f58d1d3e700 1 --2- 172.21.15.117:0/3105245851 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f58b806a730 0x7f58b806cbe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f58bc003d80 tx=0x7f58bc007a40 comp rx=0 tx=0).stop 2023-07-19T20:44:46.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.822+0000 7f58d1d3e700 1 -- 172.21.15.117:0/3105245851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc140da0 msgr2=0x7f58cc070e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.822+0000 7f58d1d3e700 1 --2- 172.21.15.117:0/3105245851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc140da0 0x7f58cc070e90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f58c000c7f0 tx=0x7f58c000cbb0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.822 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.822+0000 7fb4cc39d700 1 -- 172.21.15.117:0/400091393 wait complete. 2023-07-19T20:44:46.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.822+0000 7f58d1d3e700 1 -- 172.21.15.117:0/3105245851 shutdown_connections 2023-07-19T20:44:46.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.822+0000 7f58d1d3e700 1 --2- 172.21.15.117:0/3105245851 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f58b806a730 0x7f58b806cbe0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.822+0000 7f58d1d3e700 1 --2- 172.21.15.117:0/3105245851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc140da0 0x7f58cc070e90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.825 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.822+0000 7f58d1d3e700 1 --2- 172.21.15.117:0/3105245851 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f58cc0b3de0 0x7f58cc06f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.825 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.822+0000 7f58d1d3e700 1 --2- 172.21.15.117:0/3105245851 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f58cc140950 0x7f58cc146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.825 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.822+0000 7f58d1d3e700 1 -- 172.21.15.117:0/3105245851 >> 172.21.15.117:0/3105245851 conn(0x7f58cc06b1f0 msgr2=0x7f58cc0b82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.825 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.822+0000 7f58d1d3e700 1 -- 172.21.15.117:0/3105245851 shutdown_connections 2023-07-19T20:44:46.826 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.826+0000 7f58d1d3e700 1 -- 172.21.15.117:0/3105245851 wait complete. 2023-07-19T20:44:46.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2023-07-19T20:44:46.837 DEBUG:teuthology.parallel:result is None 2023-07-19T20:44:46.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2023-07-19T20:44:46.840 DEBUG:teuthology.parallel:result is None 2023-07-19T20:44:46.877 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.861+0000 7fe83a4e8700 1 -- 172.21.15.117:0/117523032 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe834145da0 con 0x7fe834140da0 2023-07-19T20:44:46.877 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.862+0000 7fe830ff9700 1 -- 172.21.15.117:0/117523032 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe834145da0 con 0x7fe834140da0 2023-07-19T20:44:46.878 INFO:teuthology.orchestra.run.smithi117.stdout:60129542150 2023-07-19T20:44:46.879 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.865+0000 7fe83a4e8700 1 -- 172.21.15.117:0/117523032 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe82006a730 msgr2=0x7fe82006cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.879 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.865+0000 7fe83a4e8700 1 --2- 172.21.15.117:0/117523032 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe82006a730 0x7fe82006cbe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe8240015f0 tx=0x7fe824007ae0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.879 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.865+0000 7fe83a4e8700 1 -- 172.21.15.117:0/117523032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe834140da0 msgr2=0x7fe834147020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.879 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.865+0000 7fe83a4e8700 1 --2- 172.21.15.117:0/117523032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe834140da0 0x7fe834147020 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe83414a2f0 tx=0x7fe82c004ad0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.879 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.865+0000 7fe83a4e8700 1 -- 172.21.15.117:0/117523032 shutdown_connections 2023-07-19T20:44:46.879 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.865+0000 7fe83a4e8700 1 --2- 172.21.15.117:0/117523032 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe82006a730 0x7fe82006cbe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.879 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.865+0000 7fe83a4e8700 1 --2- 172.21.15.117:0/117523032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe834140da0 0x7fe834147020 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.880 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.865+0000 7fe83a4e8700 1 --2- 172.21.15.117:0/117523032 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe8340b3de0 0x7fe834142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.880 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.865+0000 7fe83a4e8700 1 --2- 172.21.15.117:0/117523032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe834140950 0x7fe834146ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.880 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.865+0000 7fe83a4e8700 1 -- 172.21.15.117:0/117523032 >> 172.21.15.117:0/117523032 conn(0x7fe83406b1f0 msgr2=0x7fe834148540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.880 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.865+0000 7fe83a4e8700 1 -- 172.21.15.117:0/117523032 shutdown_connections 2023-07-19T20:44:46.880 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.865+0000 7fe83a4e8700 1 -- 172.21.15.117:0/117523032 wait complete. 2023-07-19T20:44:46.881 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.866+0000 7f0321846700 1 -- 172.21.15.117:0/258948722 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f031c14d4c0 con 0x7f031c14d7a0 2023-07-19T20:44:46.881 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.870+0000 7f0303fff700 1 -- 172.21.15.117:0/258948722 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f031402a020 con 0x7f031c14d7a0 2023-07-19T20:44:46.881 INFO:teuthology.orchestra.run.smithi117.stdout:60129542150 2023-07-19T20:44:46.883 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.875+0000 7f0321846700 1 -- 172.21.15.117:0/258948722 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f030806a730 msgr2=0x7f030806cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.883 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.875+0000 7f0321846700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f030806a730 0x7f030806cbe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f030c006fd0 tx=0x7f030c008040 comp rx=0 tx=0).stop 2023-07-19T20:44:46.883 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.875+0000 7f0321846700 1 -- 172.21.15.117:0/258948722 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f031c14d7a0 msgr2=0x7f031c14dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.883 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.875+0000 7f0321846700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f031c14d7a0 0x7f031c14dc10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f031400b370 tx=0x7f0314004ad0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.883 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.875+0000 7f0321846700 1 -- 172.21.15.117:0/258948722 shutdown_connections 2023-07-19T20:44:46.884 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.875+0000 7f0321846700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f030806a730 0x7f030806cbe0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.884 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.875+0000 7f0321846700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f031c14d7a0 0x7f031c14dc10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.884 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.875+0000 7f0321846700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f031c0b8da0 0x7f031c14ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.884 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.875+0000 7f0321846700 1 --2- 172.21.15.117:0/258948722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f031c149220 0x7f031c14f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.884 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.875+0000 7f0321846700 1 -- 172.21.15.117:0/258948722 >> 172.21.15.117:0/258948722 conn(0x7f031c06b1f0 msgr2=0x7f031c148440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.884 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.876+0000 7f0321846700 1 -- 172.21.15.117:0/258948722 shutdown_connections 2023-07-19T20:44:46.884 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.876+0000 7f0321846700 1 -- 172.21.15.117:0/258948722 wait complete. 2023-07-19T20:44:46.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.880+0000 7fd51fd5d700 1 -- 172.21.15.117:0/285641493 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd518159c10 con 0x7fd5181e95d0 2023-07-19T20:44:46.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.880+0000 7fb14818e700 1 -- 172.21.15.117:0/1881276492 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb1401ed930 con 0x7fb140145020 2023-07-19T20:44:46.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.880+0000 7fb1367fc700 1 -- 172.21.15.117:0/1881276492 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb1401ed930 con 0x7fb140145020 2023-07-19T20:44:46.886 INFO:teuthology.orchestra.run.smithi117.stdout:60129542150 2023-07-19T20:44:46.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.881+0000 7fd50e7fc700 1 -- 172.21.15.117:0/285641493 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd518159c10 con 0x7fd5181e95d0 2023-07-19T20:44:46.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2023-07-19T20:44:46.887 INFO:teuthology.orchestra.run.smithi117.stdout:60129542151 2023-07-19T20:44:46.888 DEBUG:teuthology.parallel:result is None 2023-07-19T20:44:46.888 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.881+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/1041158337 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd7e80b64a0 con 0x7fd7e80b8da0 2023-07-19T20:44:46.888 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.882+0000 7fd7ddffb700 1 -- 172.21.15.117:0/1041158337 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd7d8015090 con 0x7fd7e80b8da0 2023-07-19T20:44:46.889 INFO:teuthology.orchestra.run.smithi117.stdout:60129542149 2023-07-19T20:44:46.889 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.883+0000 7fd51fd5d700 1 -- 172.21.15.117:0/285641493 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd4fc06a660 msgr2=0x7fd4fc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.883+0000 7fd51fd5d700 1 --2- 172.21.15.117:0/285641493 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd4fc06a660 0x7fd4fc06cb10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd514001eb0 tx=0x7fd514009030 comp rx=0 tx=0).stop 2023-07-19T20:44:46.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.883+0000 7fd51fd5d700 1 -- 172.21.15.117:0/285641493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5181e95d0 msgr2=0x7fd518159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.883+0000 7fd51fd5d700 1 --2- 172.21.15.117:0/285641493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5181e95d0 0x7fd518159450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd50800cc20 tx=0x7fd50800a0d0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.883+0000 7fd51fd5d700 1 -- 172.21.15.117:0/285641493 shutdown_connections 2023-07-19T20:44:46.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.883+0000 7fd51fd5d700 1 --2- 172.21.15.117:0/285641493 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd4fc06a660 0x7fd4fc06cb10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.891 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.883+0000 7fd51fd5d700 1 --2- 172.21.15.117:0/285641493 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd51815a5f0 0x7fd51815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.891 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.883+0000 7fd51fd5d700 1 --2- 172.21.15.117:0/285641493 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd504003ea0 0x7fd5181e6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.891 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.883+0000 7fd51fd5d700 1 --2- 172.21.15.117:0/285641493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5181e95d0 0x7fd518159450 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.891 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.883+0000 7fd51fd5d700 1 -- 172.21.15.117:0/285641493 >> 172.21.15.117:0/285641493 conn(0x7fd51806b1f0 msgr2=0x7fd5180baee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.891 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.883+0000 7fd51fd5d700 1 -- 172.21.15.117:0/285641493 shutdown_connections 2023-07-19T20:44:46.891 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.884+0000 7fd51fd5d700 1 -- 172.21.15.117:0/285641493 wait complete. 2023-07-19T20:44:46.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.884+0000 7fb14818e700 1 -- 172.21.15.117:0/1881276492 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb12406a630 msgr2=0x7fb12406cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.884+0000 7fb14818e700 1 --2- 172.21.15.117:0/1881276492 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb12406a630 0x7fb12406cae0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb130009890 tx=0x7fb130008040 comp rx=0 tx=0).stop 2023-07-19T20:44:46.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.884+0000 7fb14818e700 1 -- 172.21.15.117:0/1881276492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb140145020 msgr2=0x7fb1400badc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.884+0000 7fb14818e700 1 --2- 172.21.15.117:0/1881276492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb140145020 0x7fb1400badc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb14006bee0 tx=0x7fb13c00c820 comp rx=0 tx=0).stop 2023-07-19T20:44:46.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fb14818e700 1 -- 172.21.15.117:0/1881276492 shutdown_connections 2023-07-19T20:44:46.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fb14818e700 1 --2- 172.21.15.117:0/1881276492 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb12406a630 0x7fb12406cae0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb130009890 tx=0x7fb130008040 comp rx=0 tx=0).stop 2023-07-19T20:44:46.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fb14818e700 1 --2- 172.21.15.117:0/1881276492 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb140145490 0x7fb1400b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fb14818e700 1 --2- 172.21.15.117:0/1881276492 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb12c005320 0x7fb1401e0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fb14818e700 1 --2- 172.21.15.117:0/1881276492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb140145020 0x7fb1400badc0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.901 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fb14818e700 1 -- 172.21.15.117:0/1881276492 >> 172.21.15.117:0/1881276492 conn(0x7fb1400bdc00 msgr2=0x7fb140142ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.904 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/1041158337 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd7cc06a680 msgr2=0x7fd7cc06cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.905 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fd7ef3c3700 1 --2- 172.21.15.117:0/1041158337 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd7cc06a680 0x7fd7cc06cb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd7e81e56b0 tx=0x7fd7e4010000 comp rx=0 tx=0).stop 2023-07-19T20:44:46.905 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/1041158337 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd7e80b8da0 msgr2=0x7fd7e81e7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.905 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fd7ef3c3700 1 --2- 172.21.15.117:0/1041158337 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd7e80b8da0 0x7fd7e81e7d60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800b470 tx=0x7fd7d800b780 comp rx=0 tx=0).stop 2023-07-19T20:44:46.906 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/1041158337 shutdown_connections 2023-07-19T20:44:46.906 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fd7ef3c3700 1 --2- 172.21.15.117:0/1041158337 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd7cc06a680 0x7fd7cc06cb30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.906 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fd7ef3c3700 1 --2- 172.21.15.117:0/1041158337 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd7e81499e0 0x7fd7e814e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.906 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fd7ef3c3700 1 --2- 172.21.15.117:0/1041158337 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd7e80b8da0 0x7fd7e81e7d60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.906 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fd7ef3c3700 1 --2- 172.21.15.117:0/1041158337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e8149220 0x7fd7e814e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.906 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/1041158337 >> 172.21.15.117:0/1041158337 conn(0x7fd7e806b1f0 msgr2=0x7fd7e81486f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.906 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/1041158337 shutdown_connections 2023-07-19T20:44:46.907 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.885+0000 7fd7ef3c3700 1 -- 172.21.15.117:0/1041158337 wait complete. 2023-07-19T20:44:46.907 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.891+0000 7fb14818e700 1 -- 172.21.15.117:0/1881276492 shutdown_connections 2023-07-19T20:44:46.907 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.891+0000 7fb14818e700 1 -- 172.21.15.117:0/1881276492 wait complete. 2023-07-19T20:44:46.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2023-07-19T20:44:46.913 DEBUG:teuthology.parallel:result is None 2023-07-19T20:44:46.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2023-07-19T20:44:46.917 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.898+0000 7f08bf801700 1 -- 172.21.15.117:0/132169726 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f08b81e7e90 con 0x7f08b8140950 2023-07-19T20:44:46.918 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.899+0000 7f08adffb700 1 -- 172.21.15.117:0/132169726 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08b81e7e90 con 0x7f08b8140950 2023-07-19T20:44:46.919 DEBUG:teuthology.parallel:result is None 2023-07-19T20:44:46.919 INFO:teuthology.orchestra.run.smithi117.stdout:60129542150 2023-07-19T20:44:46.920 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.901+0000 7f08bf801700 1 -- 172.21.15.117:0/132169726 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f089c06a630 msgr2=0x7f089c06cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.920 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.901+0000 7f08bf801700 1 --2- 172.21.15.117:0/132169726 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f089c06a630 0x7f089c06cae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08b0002040 tx=0x7f08b0009040 comp rx=0 tx=0).stop 2023-07-19T20:44:46.920 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.901+0000 7f08bf801700 1 -- 172.21.15.117:0/132169726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08b8140950 msgr2=0x7f08b80b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:46.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.901+0000 7f08bf801700 1 --2- 172.21.15.117:0/132169726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08b8140950 0x7f08b80b31b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08a8018000 tx=0x7f08a8004750 comp rx=0 tx=0).stop 2023-07-19T20:44:46.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.901+0000 7f08bf801700 1 -- 172.21.15.117:0/132169726 shutdown_connections 2023-07-19T20:44:46.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.901+0000 7f08bf801700 1 --2- 172.21.15.117:0/132169726 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f089c06a630 0x7f089c06cae0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.901+0000 7f08bf801700 1 --2- 172.21.15.117:0/132169726 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08b8140da0 0x7f08b80b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.901+0000 7f08bf801700 1 --2- 172.21.15.117:0/132169726 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08b80b3de0 0x7f08b80b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.901+0000 7f08bf801700 1 --2- 172.21.15.117:0/132169726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08b8140950 0x7f08b80b31b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:46.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.901+0000 7f08bf801700 1 -- 172.21.15.117:0/132169726 >> 172.21.15.117:0/132169726 conn(0x7f08b806b1f0 msgr2=0x7f08b813fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:46.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.901+0000 7f08bf801700 1 -- 172.21.15.117:0/132169726 shutdown_connections 2023-07-19T20:44:46.922 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:46.901+0000 7f08bf801700 1 -- 172.21.15.117:0/132169726 wait complete. 2023-07-19T20:44:46.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2023-07-19T20:44:46.923 DEBUG:teuthology.parallel:result is None 2023-07-19T20:44:46.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2023-07-19T20:44:46.924 DEBUG:teuthology.parallel:result is None 2023-07-19T20:44:46.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2023-07-19T20:44:46.925 DEBUG:teuthology.parallel:result is None 2023-07-19T20:44:46.925 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-19T20:44:46.925 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-19T20:44:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.077+0000 7ff402761700 1 Processor -- start 2023-07-19T20:44:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.077+0000 7ff402761700 1 -- start start 2023-07-19T20:44:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.078+0000 7ff402761700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3fc0baa40 0x7ff3fc0b8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.076 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.078+0000 7ff402761700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff3fc1475e0 0x7ff3fc0b8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.076 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.078+0000 7ff402761700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3fc0b7900 con 0x7ff3fc0bae10 2023-07-19T20:44:47.076 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.078+0000 7ff402761700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3fc147a70 con 0x7ff3fc1475e0 2023-07-19T20:44:47.077 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.078+0000 7ff402761700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc147d50 con 0x7ff3fc0baa40 2023-07-19T20:44:47.077 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.078+0000 7ff3fb7fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff3fc1475e0 0x7ff3fc0b8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.077 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.078+0000 7ff400cfe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ff3fc0bae10 0x7ff3fc14ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41338/0 (socket says 172.21.15.117:41338) 2023-07-19T20:44:47.077 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.078+0000 7ff400cfe700 1 -- 172.21.15.117:0/24137910 learned_addr learned my addr 172.21.15.117:0/24137910 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:47.077 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.078+0000 7ff3fb7fe700 1 -- 172.21.15.117:0/24137910 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3fc0baa40 msgr2=0x7ff3fc0b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:47.077 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.078+0000 7ff3fbfff700 1 --2- 172.21.15.117:0/24137910 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3fc0baa40 0x7ff3fc0b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.077 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.078+0000 7ff3faffd700 1 -- 172.21.15.117:0/24137910 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427703956 0 0) 0x7ff3fc0b7900 con 0x7ff3fc0bae10 2023-07-19T20:44:47.078 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.078+0000 7ff3fb7fe700 1 --2- 172.21.15.117:0/24137910 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3fc0baa40 0x7ff3fc0b8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.078 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.079+0000 7ff3fb7fe700 1 -- 172.21.15.117:0/24137910 >> v1:172.21.15.117:6789/0 conn(0x7ff3fc0bae10 legacy=0x7ff3fc14ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.078 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.079+0000 7ff3fb7fe700 1 -- 172.21.15.117:0/24137910 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc148030 con 0x7ff3fc1475e0 2023-07-19T20:44:47.078 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.079+0000 7ff3fb7fe700 1 --2- 172.21.15.117:0/24137910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc1475e0 0x7ff3fc0b8850 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009840 tx=0x7ff3f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bb280eaf9a5b26 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:47.078 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.079+0000 7ff3faffd700 1 -- 172.21.15.117:0/24137910 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0011830 con 0x7ff3fc1475e0 2023-07-19T20:44:47.079 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.079+0000 7ff3faffd700 1 -- 172.21.15.117:0/24137910 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f0011990 con 0x7ff3fc1475e0 2023-07-19T20:44:47.079 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.079+0000 7ff3faffd700 1 -- 172.21.15.117:0/24137910 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0011d20 con 0x7ff3fc1475e0 2023-07-19T20:44:47.080 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.079+0000 7ff402761700 1 -- 172.21.15.117:0/24137910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc1475e0 msgr2=0x7ff3fc0b8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.080 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.079+0000 7ff402761700 1 --2- 172.21.15.117:0/24137910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc1475e0 0x7ff3fc0b8850 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009840 tx=0x7ff3f0009b50 comp rx=0 tx=0).stop 2023-07-19T20:44:47.080 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.079+0000 7ff402761700 1 -- 172.21.15.117:0/24137910 shutdown_connections 2023-07-19T20:44:47.080 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.079+0000 7ff402761700 1 --2- 172.21.15.117:0/24137910 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3fc0baa40 0x7ff3fc0b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.080 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.079+0000 7ff402761700 1 --2- 172.21.15.117:0/24137910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc1475e0 0x7ff3fc0b8850 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.080 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.079+0000 7ff402761700 1 -- 172.21.15.117:0/24137910 >> 172.21.15.117:0/24137910 conn(0x7ff3fc0be4b0 msgr2=0x7ff3fc0ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:47.080 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.079+0000 7ff402761700 1 -- 172.21.15.117:0/24137910 shutdown_connections 2023-07-19T20:44:47.081 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.079+0000 7ff402761700 1 -- 172.21.15.117:0/24137910 wait complete. 2023-07-19T20:44:47.081 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.080+0000 7ff402761700 1 Processor -- start 2023-07-19T20:44:47.081 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.081+0000 7ff402761700 1 -- start start 2023-07-19T20:44:47.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.081+0000 7ff402761700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3fc0baa40 0x7ff3fc1459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.081+0000 7ff402761700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc0bae10 0x7ff3fc1d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.081+0000 7ff402761700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3fc1475e0 0x7ff3fc1d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.081+0000 7ff402761700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc145f20 con 0x7ff3fc0bae10 2023-07-19T20:44:47.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.081+0000 7ff402761700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc1d19e0 con 0x7ff3fc1475e0 2023-07-19T20:44:47.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.081+0000 7ff402761700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc1d2020 con 0x7ff3fc0baa40 2023-07-19T20:44:47.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.081+0000 7ff3fb7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc0bae10 0x7ff3fc1d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.081+0000 7ff3fb7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc0bae10 0x7ff3fc1d0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43902/0 (socket says 172.21.15.117:43902) 2023-07-19T20:44:47.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.081+0000 7ff3fb7fe700 1 -- 172.21.15.117:0/1469287284 learned_addr learned my addr 172.21.15.117:0/1469287284 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:47.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.082+0000 7ff400cfe700 1 --2- 172.21.15.117:0/1469287284 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3fc1475e0 0x7ff3fc1d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.082+0000 7ff3fbfff700 1 --2- 172.21.15.117:0/1469287284 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3fc0baa40 0x7ff3fc1459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.082+0000 7ff3fb7fe700 1 -- 172.21.15.117:0/1469287284 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3fc0baa40 msgr2=0x7ff3fc1459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.082+0000 7ff3fb7fe700 1 --2- 172.21.15.117:0/1469287284 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3fc0baa40 0x7ff3fc1459e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.082+0000 7ff3fb7fe700 1 -- 172.21.15.117:0/1469287284 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3fc1475e0 msgr2=0x7ff3fc1d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.082+0000 7ff3fb7fe700 1 --2- 172.21.15.117:0/1469287284 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3fc1475e0 0x7ff3fc1d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.082+0000 7ff3fb7fe700 1 -- 172.21.15.117:0/1469287284 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f00094a0 con 0x7ff3fc0bae10 2023-07-19T20:44:47.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.082+0000 7ff3fb7fe700 1 --2- 172.21.15.117:0/1469287284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc0bae10 0x7ff3fc1d0a30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0014040 tx=0x7ff3f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:47.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.082+0000 7ff3f8ff9700 1 -- 172.21.15.117:0/1469287284 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f00045f0 con 0x7ff3fc0bae10 2023-07-19T20:44:47.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.082+0000 7ff3f8ff9700 1 -- 172.21.15.117:0/1469287284 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f001e070 con 0x7ff3fc0bae10 2023-07-19T20:44:47.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.082+0000 7ff3f8ff9700 1 -- 172.21.15.117:0/1469287284 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0003ae0 con 0x7ff3fc0bae10 2023-07-19T20:44:47.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.082+0000 7ff402761700 1 -- 172.21.15.117:0/1469287284 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3fc1d1c30 con 0x7ff3fc0bae10 2023-07-19T20:44:47.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.082+0000 7ff402761700 1 -- 172.21.15.117:0/1469287284 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3fc1d2550 con 0x7ff3fc0bae10 2023-07-19T20:44:47.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.083+0000 7ff402761700 1 -- 172.21.15.117:0/1469287284 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3fc067940 con 0x7ff3fc0bae10 2023-07-19T20:44:47.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.084+0000 7ff3f8ff9700 1 -- 172.21.15.117:0/1469287284 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7ff3f0003c40 con 0x7ff3fc0bae10 2023-07-19T20:44:47.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.084+0000 7ff3f8ff9700 1 --2- 172.21.15.117:0/1469287284 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff3e806a660 0x7ff3e806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.084+0000 7ff3f8ff9700 1 -- 172.21.15.117:0/1469287284 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff3f0089d60 con 0x7ff3fc0bae10 2023-07-19T20:44:47.087 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.084+0000 7ff3fbfff700 1 --2- 172.21.15.117:0/1469287284 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff3e806a660 0x7ff3e806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.087 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.084+0000 7ff3fbfff700 1 --2- 172.21.15.117:0/1469287284 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff3e806a660 0x7ff3e806cb10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec008850 tx=0x7ff3ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:47.087 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.088+0000 7ff3f8ff9700 1 -- 172.21.15.117:0/1469287284 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff3f00551f0 con 0x7ff3fc0bae10 2023-07-19T20:44:47.266 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.272+0000 7ff402761700 1 -- 172.21.15.117:0/1469287284 --> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3fc148310 con 0x7ff3e806a660 2023-07-19T20:44:47.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.279+0000 7ff3f8ff9700 1 -- 172.21.15.117:0/1469287284 <== mgr.4107 v2:172.21.15.117:6832/146126 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286811 (secure 0 0 0) 0x7ff3ec00c040 con 0x7ff3e806a660 2023-07-19T20:44:47.280 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:47.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.282+0000 7ff402761700 1 -- 172.21.15.117:0/1469287284 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff3e806a660 msgr2=0x7ff3e806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.282+0000 7ff402761700 1 --2- 172.21.15.117:0/1469287284 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff3e806a660 0x7ff3e806cb10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec008850 tx=0x7ff3ec008040 comp rx=0 tx=0).stop 2023-07-19T20:44:47.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.282+0000 7ff402761700 1 -- 172.21.15.117:0/1469287284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc0bae10 msgr2=0x7ff3fc1d0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.282+0000 7ff402761700 1 --2- 172.21.15.117:0/1469287284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc0bae10 0x7ff3fc1d0a30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0014040 tx=0x7ff3f0004750 comp rx=0 tx=0).stop 2023-07-19T20:44:47.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.282+0000 7ff402761700 1 -- 172.21.15.117:0/1469287284 shutdown_connections 2023-07-19T20:44:47.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.282+0000 7ff402761700 1 --2- 172.21.15.117:0/1469287284 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff3e806a660 0x7ff3e806cb10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.282+0000 7ff402761700 1 --2- 172.21.15.117:0/1469287284 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3fc1475e0 0x7ff3fc1d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.282+0000 7ff402761700 1 --2- 172.21.15.117:0/1469287284 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3fc0baa40 0x7ff3fc1459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.282+0000 7ff402761700 1 --2- 172.21.15.117:0/1469287284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc0bae10 0x7ff3fc1d0a30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.282+0000 7ff402761700 1 -- 172.21.15.117:0/1469287284 >> 172.21.15.117:0/1469287284 conn(0x7ff3fc0be4b0 msgr2=0x7ff3fc141120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:47.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.283+0000 7ff402761700 1 -- 172.21.15.117:0/1469287284 shutdown_connections 2023-07-19T20:44:47.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.283+0000 7ff402761700 1 -- 172.21.15.117:0/1469287284 wait complete. 2023-07-19T20:44:47.285 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2023-07-19T20:44:47.290 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-07-19T20:44:45.686970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218592,"kb_used_data":2976,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756128,"statfs":{"total":773094113280,"available":772870275072,"internally_reserved":0,"allocated":3047424,"data_stored":1840914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.547390"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557519+0000","last_change":"2023-07-19T20:44:38.557553+0000","last_active":"2023-07-19T20:44:39.557519+0000","last_peered":"2023-07-19T20:44:39.557519+0000","last_clean":"2023-07-19T20:44:39.557519+0000","last_became_active":"2023-07-19T20:44:38.557300+0000","last_became_peered":"2023-07-19T20:44:38.557300+0000","last_unstale":"2023-07-19T20:44:39.557519+0000","last_undegraded":"2023-07-19T20:44:39.557519+0000","last_fullsized":"2023-07-19T20:44:39.557519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:51:24.459453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967118+0000","last_change":"2023-07-19T20:44:38.568068+0000","last_active":"2023-07-19T20:44:39.967118+0000","last_peered":"2023-07-19T20:44:39.967118+0000","last_clean":"2023-07-19T20:44:39.967118+0000","last_became_active":"2023-07-19T20:44:38.567801+0000","last_became_peered":"2023-07-19T20:44:38.567801+0000","last_unstale":"2023-07-19T20:44:39.967118+0000","last_undegraded":"2023-07-19T20:44:39.967118+0000","last_fullsized":"2023-07-19T20:44:39.967118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:54:57.194368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966678+0000","last_change":"2023-07-19T20:44:38.570481+0000","last_active":"2023-07-19T20:44:39.966678+0000","last_peered":"2023-07-19T20:44:39.966678+0000","last_clean":"2023-07-19T20:44:39.966678+0000","last_became_active":"2023-07-19T20:44:38.570229+0000","last_became_peered":"2023-07-19T20:44:38.570229+0000","last_unstale":"2023-07-19T20:44:39.966678+0000","last_undegraded":"2023-07-19T20:44:39.966678+0000","last_fullsized":"2023-07-19T20:44:39.966678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:14:05.967200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557053+0000","last_change":"2023-07-19T20:44:38.570166+0000","last_active":"2023-07-19T20:44:39.557053+0000","last_peered":"2023-07-19T20:44:39.557053+0000","last_clean":"2023-07-19T20:44:39.557053+0000","last_became_active":"2023-07-19T20:44:38.569877+0000","last_became_peered":"2023-07-19T20:44:38.569877+0000","last_unstale":"2023-07-19T20:44:39.557053+0000","last_undegraded":"2023-07-19T20:44:39.557053+0000","last_fullsized":"2023-07-19T20:44:39.557053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:50:18.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965691+0000","last_change":"2023-07-19T20:44:38.571798+0000","last_active":"2023-07-19T20:44:39.965691+0000","last_peered":"2023-07-19T20:44:39.965691+0000","last_clean":"2023-07-19T20:44:39.965691+0000","last_became_active":"2023-07-19T20:44:38.571402+0000","last_became_peered":"2023-07-19T20:44:38.571402+0000","last_unstale":"2023-07-19T20:44:39.965691+0000","last_undegraded":"2023-07-19T20:44:39.965691+0000","last_fullsized":"2023-07-19T20:44:39.965691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:15:18.131376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965752+0000","last_change":"2023-07-19T20:44:38.572155+0000","last_active":"2023-07-19T20:44:39.965752+0000","last_peered":"2023-07-19T20:44:39.965752+0000","last_clean":"2023-07-19T20:44:39.965752+0000","last_became_active":"2023-07-19T20:44:38.571889+0000","last_became_peered":"2023-07-19T20:44:38.571889+0000","last_unstale":"2023-07-19T20:44:39.965752+0000","last_undegraded":"2023-07-19T20:44:39.965752+0000","last_fullsized":"2023-07-19T20:44:39.965752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:05:47.118546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965842+0000","last_change":"2023-07-19T20:44:38.583148+0000","last_active":"2023-07-19T20:44:39.965842+0000","last_peered":"2023-07-19T20:44:39.965842+0000","last_clean":"2023-07-19T20:44:39.965842+0000","last_became_active":"2023-07-19T20:44:38.582674+0000","last_became_peered":"2023-07-19T20:44:38.582674+0000","last_unstale":"2023-07-19T20:44:39.965842+0000","last_undegraded":"2023-07-19T20:44:39.965842+0000","last_fullsized":"2023-07-19T20:44:39.965842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966760+0000","last_change":"2023-07-19T20:44:38.563551+0000","last_active":"2023-07-19T20:44:39.966760+0000","last_peered":"2023-07-19T20:44:39.966760+0000","last_clean":"2023-07-19T20:44:39.966760+0000","last_became_active":"2023-07-19T20:44:38.563241+0000","last_became_peered":"2023-07-19T20:44:38.563241+0000","last_unstale":"2023-07-19T20:44:39.966760+0000","last_undegraded":"2023-07-19T20:44:39.966760+0000","last_fullsized":"2023-07-19T20:44:39.966760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:41:57.896806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965333+0000","last_change":"2023-07-19T20:44:38.568101+0000","last_active":"2023-07-19T20:44:39.965333+0000","last_peered":"2023-07-19T20:44:39.965333+0000","last_clean":"2023-07-19T20:44:39.965333+0000","last_became_active":"2023-07-19T20:44:38.567841+0000","last_became_peered":"2023-07-19T20:44:38.567841+0000","last_unstale":"2023-07-19T20:44:39.965333+0000","last_undegraded":"2023-07-19T20:44:39.965333+0000","last_fullsized":"2023-07-19T20:44:39.965333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:47:51.985998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967220+0000","last_change":"2023-07-19T20:44:38.573636+0000","last_active":"2023-07-19T20:44:39.967220+0000","last_peered":"2023-07-19T20:44:39.967220+0000","last_clean":"2023-07-19T20:44:39.967220+0000","last_became_active":"2023-07-19T20:44:38.572946+0000","last_became_peered":"2023-07-19T20:44:38.572946+0000","last_unstale":"2023-07-19T20:44:39.967220+0000","last_undegraded":"2023-07-19T20:44:39.967220+0000","last_fullsized":"2023-07-19T20:44:39.967220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:44:21.312824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966695+0000","last_change":"2023-07-19T20:44:38.569267+0000","last_active":"2023-07-19T20:44:39.966695+0000","last_peered":"2023-07-19T20:44:39.966695+0000","last_clean":"2023-07-19T20:44:39.966695+0000","last_became_active":"2023-07-19T20:44:38.568642+0000","last_became_peered":"2023-07-19T20:44:38.568642+0000","last_unstale":"2023-07-19T20:44:39.966695+0000","last_undegraded":"2023-07-19T20:44:39.966695+0000","last_fullsized":"2023-07-19T20:44:39.966695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:05:25.043607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557296+0000","last_change":"2023-07-19T20:44:38.563272+0000","last_active":"2023-07-19T20:44:39.557296+0000","last_peered":"2023-07-19T20:44:39.557296+0000","last_clean":"2023-07-19T20:44:39.557296+0000","last_became_active":"2023-07-19T20:44:38.562986+0000","last_became_peered":"2023-07-19T20:44:38.562986+0000","last_unstale":"2023-07-19T20:44:39.557296+0000","last_undegraded":"2023-07-19T20:44:39.557296+0000","last_fullsized":"2023-07-19T20:44:39.557296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:10:44.096418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557003+0000","last_change":"2023-07-19T20:44:38.558158+0000","last_active":"2023-07-19T20:44:39.557003+0000","last_peered":"2023-07-19T20:44:39.557003+0000","last_clean":"2023-07-19T20:44:39.557003+0000","last_became_active":"2023-07-19T20:44:38.557930+0000","last_became_peered":"2023-07-19T20:44:38.557930+0000","last_unstale":"2023-07-19T20:44:39.557003+0000","last_undegraded":"2023-07-19T20:44:39.557003+0000","last_fullsized":"2023-07-19T20:44:39.557003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:29:27.698047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967203+0000","last_change":"2023-07-19T20:44:38.561137+0000","last_active":"2023-07-19T20:44:39.967203+0000","last_peered":"2023-07-19T20:44:39.967203+0000","last_clean":"2023-07-19T20:44:39.967203+0000","last_became_active":"2023-07-19T20:44:38.560853+0000","last_became_peered":"2023-07-19T20:44:38.560853+0000","last_unstale":"2023-07-19T20:44:39.967203+0000","last_undegraded":"2023-07-19T20:44:39.967203+0000","last_fullsized":"2023-07-19T20:44:39.967203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:01:57.502720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965944+0000","last_change":"2023-07-19T20:44:38.583262+0000","last_active":"2023-07-19T20:44:39.965944+0000","last_peered":"2023-07-19T20:44:39.965944+0000","last_clean":"2023-07-19T20:44:39.965944+0000","last_became_active":"2023-07-19T20:44:38.582950+0000","last_became_peered":"2023-07-19T20:44:38.582950+0000","last_unstale":"2023-07-19T20:44:39.965944+0000","last_undegraded":"2023-07-19T20:44:39.965944+0000","last_fullsized":"2023-07-19T20:44:39.965944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:47:20.937341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965794+0000","last_change":"2023-07-19T20:44:38.572479+0000","last_active":"2023-07-19T20:44:39.965794+0000","last_peered":"2023-07-19T20:44:39.965794+0000","last_clean":"2023-07-19T20:44:39.965794+0000","last_became_active":"2023-07-19T20:44:38.572213+0000","last_became_peered":"2023-07-19T20:44:38.572213+0000","last_unstale":"2023-07-19T20:44:39.965794+0000","last_undegraded":"2023-07-19T20:44:39.965794+0000","last_fullsized":"2023-07-19T20:44:39.965794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:21:54.976852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965428+0000","last_change":"2023-07-19T20:44:38.568103+0000","last_active":"2023-07-19T20:44:39.965428+0000","last_peered":"2023-07-19T20:44:39.965428+0000","last_clean":"2023-07-19T20:44:39.965428+0000","last_became_active":"2023-07-19T20:44:38.567824+0000","last_became_peered":"2023-07-19T20:44:38.567824+0000","last_unstale":"2023-07-19T20:44:39.965428+0000","last_undegraded":"2023-07-19T20:44:39.965428+0000","last_fullsized":"2023-07-19T20:44:39.965428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:45:53.848298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966933+0000","last_change":"2023-07-19T20:44:38.567578+0000","last_active":"2023-07-19T20:44:39.966933+0000","last_peered":"2023-07-19T20:44:39.966933+0000","last_clean":"2023-07-19T20:44:39.966933+0000","last_became_active":"2023-07-19T20:44:38.567290+0000","last_became_peered":"2023-07-19T20:44:38.567290+0000","last_unstale":"2023-07-19T20:44:39.966933+0000","last_undegraded":"2023-07-19T20:44:39.966933+0000","last_fullsized":"2023-07-19T20:44:39.966933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:58:55.531091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557561+0000","last_change":"2023-07-19T20:44:38.572691+0000","last_active":"2023-07-19T20:44:39.557561+0000","last_peered":"2023-07-19T20:44:39.557561+0000","last_clean":"2023-07-19T20:44:39.557561+0000","last_became_active":"2023-07-19T20:44:38.572438+0000","last_became_peered":"2023-07-19T20:44:38.572438+0000","last_unstale":"2023-07-19T20:44:39.557561+0000","last_undegraded":"2023-07-19T20:44:39.557561+0000","last_fullsized":"2023-07-19T20:44:39.557561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:40:43.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966413+0000","last_change":"2023-07-19T20:44:38.567705+0000","last_active":"2023-07-19T20:44:39.966413+0000","last_peered":"2023-07-19T20:44:39.966413+0000","last_clean":"2023-07-19T20:44:39.966413+0000","last_became_active":"2023-07-19T20:44:38.567230+0000","last_became_peered":"2023-07-19T20:44:38.567230+0000","last_unstale":"2023-07-19T20:44:39.966413+0000","last_undegraded":"2023-07-19T20:44:39.966413+0000","last_fullsized":"2023-07-19T20:44:39.966413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:16:57.118793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966275+0000","last_change":"2023-07-19T20:44:38.583001+0000","last_active":"2023-07-19T20:44:39.966275+0000","last_peered":"2023-07-19T20:44:39.966275+0000","last_clean":"2023-07-19T20:44:39.966275+0000","last_became_active":"2023-07-19T20:44:38.582767+0000","last_became_peered":"2023-07-19T20:44:38.582767+0000","last_unstale":"2023-07-19T20:44:39.966275+0000","last_undegraded":"2023-07-19T20:44:39.966275+0000","last_fullsized":"2023-07-19T20:44:39.966275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:30:42.451874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965394+0000","last_change":"2023-07-19T20:44:38.571958+0000","last_active":"2023-07-19T20:44:39.965394+0000","last_peered":"2023-07-19T20:44:39.965394+0000","last_clean":"2023-07-19T20:44:39.965394+0000","last_became_active":"2023-07-19T20:44:38.571485+0000","last_became_peered":"2023-07-19T20:44:38.571485+0000","last_unstale":"2023-07-19T20:44:39.965394+0000","last_undegraded":"2023-07-19T20:44:39.965394+0000","last_fullsized":"2023-07-19T20:44:39.965394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965238+0000","last_change":"2023-07-19T20:44:38.566759+0000","last_active":"2023-07-19T20:44:39.965238+0000","last_peered":"2023-07-19T20:44:39.965238+0000","last_clean":"2023-07-19T20:44:39.965238+0000","last_became_active":"2023-07-19T20:44:38.566496+0000","last_became_peered":"2023-07-19T20:44:38.566496+0000","last_unstale":"2023-07-19T20:44:39.965238+0000","last_undegraded":"2023-07-19T20:44:39.965238+0000","last_fullsized":"2023-07-19T20:44:39.965238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:40:30.028440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966363+0000","last_change":"2023-07-19T20:44:38.582748+0000","last_active":"2023-07-19T20:44:39.966363+0000","last_peered":"2023-07-19T20:44:39.966363+0000","last_clean":"2023-07-19T20:44:39.966363+0000","last_became_active":"2023-07-19T20:44:38.582492+0000","last_became_peered":"2023-07-19T20:44:38.582492+0000","last_unstale":"2023-07-19T20:44:39.966363+0000","last_undegraded":"2023-07-19T20:44:39.966363+0000","last_fullsized":"2023-07-19T20:44:39.966363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556709+0000","last_change":"2023-07-19T20:44:38.573862+0000","last_active":"2023-07-19T20:44:39.556709+0000","last_peered":"2023-07-19T20:44:39.556709+0000","last_clean":"2023-07-19T20:44:39.556709+0000","last_became_active":"2023-07-19T20:44:38.573438+0000","last_became_peered":"2023-07-19T20:44:38.573438+0000","last_unstale":"2023-07-19T20:44:39.556709+0000","last_undegraded":"2023-07-19T20:44:39.556709+0000","last_fullsized":"2023-07-19T20:44:39.556709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:48:50.207451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556599+0000","last_change":"2023-07-19T20:44:38.573890+0000","last_active":"2023-07-19T20:44:39.556599+0000","last_peered":"2023-07-19T20:44:39.556599+0000","last_clean":"2023-07-19T20:44:39.556599+0000","last_became_active":"2023-07-19T20:44:38.573657+0000","last_became_peered":"2023-07-19T20:44:38.573657+0000","last_unstale":"2023-07-19T20:44:39.556599+0000","last_undegraded":"2023-07-19T20:44:39.556599+0000","last_fullsized":"2023-07-19T20:44:39.556599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:50:18.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967285+0000","last_change":"2023-07-19T20:44:38.578334+0000","last_active":"2023-07-19T20:44:39.967285+0000","last_peered":"2023-07-19T20:44:39.967285+0000","last_clean":"2023-07-19T20:44:39.967285+0000","last_became_active":"2023-07-19T20:44:38.578066+0000","last_became_peered":"2023-07-19T20:44:38.578066+0000","last_unstale":"2023-07-19T20:44:39.967285+0000","last_undegraded":"2023-07-19T20:44:39.967285+0000","last_fullsized":"2023-07-19T20:44:39.967285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965878+0000","last_change":"2023-07-19T20:44:38.150761+0000","last_active":"2023-07-19T20:44:39.965878+0000","last_peered":"2023-07-19T20:44:39.965878+0000","last_clean":"2023-07-19T20:44:39.965878+0000","last_became_active":"2023-07-19T20:44:38.150480+0000","last_became_peered":"2023-07-19T20:44:38.150480+0000","last_unstale":"2023-07-19T20:44:39.965878+0000","last_undegraded":"2023-07-19T20:44:39.965878+0000","last_fullsized":"2023-07-19T20:44:39.965878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:29:26.692730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965845+0000","last_change":"2023-07-19T20:44:38.573757+0000","last_active":"2023-07-19T20:44:39.965845+0000","last_peered":"2023-07-19T20:44:39.965845+0000","last_clean":"2023-07-19T20:44:39.965845+0000","last_became_active":"2023-07-19T20:44:38.573579+0000","last_became_peered":"2023-07-19T20:44:38.573579+0000","last_unstale":"2023-07-19T20:44:39.965845+0000","last_undegraded":"2023-07-19T20:44:39.965845+0000","last_fullsized":"2023-07-19T20:44:39.965845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:45:53.848298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556369+0000","last_change":"2023-07-19T20:44:38.163117+0000","last_active":"2023-07-19T20:44:39.556369+0000","last_peered":"2023-07-19T20:44:39.556369+0000","last_clean":"2023-07-19T20:44:39.556369+0000","last_became_active":"2023-07-19T20:44:38.162834+0000","last_became_peered":"2023-07-19T20:44:38.162834+0000","last_unstale":"2023-07-19T20:44:39.556369+0000","last_undegraded":"2023-07-19T20:44:39.556369+0000","last_fullsized":"2023-07-19T20:44:39.556369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:40:42.266562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965931+0000","last_change":"2023-07-19T20:44:38.582906+0000","last_active":"2023-07-19T20:44:39.965931+0000","last_peered":"2023-07-19T20:44:39.965931+0000","last_clean":"2023-07-19T20:44:39.965931+0000","last_became_active":"2023-07-19T20:44:38.582633+0000","last_became_peered":"2023-07-19T20:44:38.582633+0000","last_unstale":"2023-07-19T20:44:39.965931+0000","last_undegraded":"2023-07-19T20:44:39.965931+0000","last_fullsized":"2023-07-19T20:44:39.965931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:07:43.608434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965284+0000","last_change":"2023-07-19T20:44:38.162257+0000","last_active":"2023-07-19T20:44:39.965284+0000","last_peered":"2023-07-19T20:44:39.965284+0000","last_clean":"2023-07-19T20:44:39.965284+0000","last_became_active":"2023-07-19T20:44:38.161974+0000","last_became_peered":"2023-07-19T20:44:38.161974+0000","last_unstale":"2023-07-19T20:44:39.965284+0000","last_undegraded":"2023-07-19T20:44:39.965284+0000","last_fullsized":"2023-07-19T20:44:39.965284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:27:00.609956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557276+0000","last_change":"2023-07-19T20:44:38.570736+0000","last_active":"2023-07-19T20:44:39.557276+0000","last_peered":"2023-07-19T20:44:39.557276+0000","last_clean":"2023-07-19T20:44:39.557276+0000","last_became_active":"2023-07-19T20:44:38.570456+0000","last_became_peered":"2023-07-19T20:44:38.570456+0000","last_unstale":"2023-07-19T20:44:39.557276+0000","last_undegraded":"2023-07-19T20:44:39.557276+0000","last_fullsized":"2023-07-19T20:44:39.557276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:47:25.794801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965516+0000","last_change":"2023-07-19T20:44:38.156406+0000","last_active":"2023-07-19T20:44:39.965516+0000","last_peered":"2023-07-19T20:44:39.965516+0000","last_clean":"2023-07-19T20:44:39.965516+0000","last_became_active":"2023-07-19T20:44:38.156105+0000","last_became_peered":"2023-07-19T20:44:38.156105+0000","last_unstale":"2023-07-19T20:44:39.965516+0000","last_undegraded":"2023-07-19T20:44:39.965516+0000","last_fullsized":"2023-07-19T20:44:39.965516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:27:00.609956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965254+0000","last_change":"2023-07-19T20:44:38.566993+0000","last_active":"2023-07-19T20:44:39.965254+0000","last_peered":"2023-07-19T20:44:39.965254+0000","last_clean":"2023-07-19T20:44:39.965254+0000","last_became_active":"2023-07-19T20:44:38.566840+0000","last_became_peered":"2023-07-19T20:44:38.566840+0000","last_unstale":"2023-07-19T20:44:39.965254+0000","last_undegraded":"2023-07-19T20:44:39.965254+0000","last_fullsized":"2023-07-19T20:44:39.965254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:47:51.985998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967138+0000","last_change":"2023-07-19T20:44:38.158430+0000","last_active":"2023-07-19T20:44:39.967138+0000","last_peered":"2023-07-19T20:44:39.967138+0000","last_clean":"2023-07-19T20:44:39.967138+0000","last_became_active":"2023-07-19T20:44:38.158144+0000","last_became_peered":"2023-07-19T20:44:38.158144+0000","last_unstale":"2023-07-19T20:44:39.967138+0000","last_undegraded":"2023-07-19T20:44:39.967138+0000","last_fullsized":"2023-07-19T20:44:39.967138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:27:00.609956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965414+0000","last_change":"2023-07-19T20:44:38.578647+0000","last_active":"2023-07-19T20:44:39.965414+0000","last_peered":"2023-07-19T20:44:39.965414+0000","last_clean":"2023-07-19T20:44:39.965414+0000","last_became_active":"2023-07-19T20:44:38.578203+0000","last_became_peered":"2023-07-19T20:44:38.578203+0000","last_unstale":"2023-07-19T20:44:39.965414+0000","last_undegraded":"2023-07-19T20:44:39.965414+0000","last_fullsized":"2023-07-19T20:44:39.965414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:15:18.131376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966763+0000","last_change":"2023-07-19T20:44:38.162400+0000","last_active":"2023-07-19T20:44:39.966763+0000","last_peered":"2023-07-19T20:44:39.966763+0000","last_clean":"2023-07-19T20:44:39.966763+0000","last_became_active":"2023-07-19T20:44:38.161909+0000","last_became_peered":"2023-07-19T20:44:38.161909+0000","last_unstale":"2023-07-19T20:44:39.966763+0000","last_undegraded":"2023-07-19T20:44:39.966763+0000","last_fullsized":"2023-07-19T20:44:39.966763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:06:03.165653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556326+0000","last_change":"2023-07-19T20:44:38.576965+0000","last_active":"2023-07-19T20:44:39.556326+0000","last_peered":"2023-07-19T20:44:39.556326+0000","last_clean":"2023-07-19T20:44:39.556326+0000","last_became_active":"2023-07-19T20:44:38.574467+0000","last_became_peered":"2023-07-19T20:44:38.574467+0000","last_unstale":"2023-07-19T20:44:39.556326+0000","last_undegraded":"2023-07-19T20:44:39.556326+0000","last_fullsized":"2023-07-19T20:44:39.556326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:29:14.941818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966551+0000","last_change":"2023-07-19T20:44:38.159725+0000","last_active":"2023-07-19T20:44:39.966551+0000","last_peered":"2023-07-19T20:44:39.966551+0000","last_clean":"2023-07-19T20:44:39.966551+0000","last_became_active":"2023-07-19T20:44:38.159461+0000","last_became_peered":"2023-07-19T20:44:38.159461+0000","last_unstale":"2023-07-19T20:44:39.966551+0000","last_undegraded":"2023-07-19T20:44:39.966551+0000","last_fullsized":"2023-07-19T20:44:39.966551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:10:43.091101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966298+0000","last_change":"2023-07-19T20:44:38.570213+0000","last_active":"2023-07-19T20:44:39.966298+0000","last_peered":"2023-07-19T20:44:39.966298+0000","last_clean":"2023-07-19T20:44:39.966298+0000","last_became_active":"2023-07-19T20:44:38.567536+0000","last_became_peered":"2023-07-19T20:44:38.567536+0000","last_unstale":"2023-07-19T20:44:39.966298+0000","last_undegraded":"2023-07-19T20:44:39.966298+0000","last_fullsized":"2023-07-19T20:44:39.966298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:43:36.018520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966166+0000","last_change":"2023-07-19T20:44:38.161200+0000","last_active":"2023-07-19T20:44:39.966166+0000","last_peered":"2023-07-19T20:44:39.966166+0000","last_clean":"2023-07-19T20:44:39.966166+0000","last_became_active":"2023-07-19T20:44:38.160914+0000","last_became_peered":"2023-07-19T20:44:38.160914+0000","last_unstale":"2023-07-19T20:44:39.966166+0000","last_undegraded":"2023-07-19T20:44:39.966166+0000","last_fullsized":"2023-07-19T20:44:39.966166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:22:47.753831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965319+0000","last_change":"2023-07-19T20:44:38.573870+0000","last_active":"2023-07-19T20:44:39.965319+0000","last_peered":"2023-07-19T20:44:39.965319+0000","last_clean":"2023-07-19T20:44:39.965319+0000","last_became_active":"2023-07-19T20:44:38.573603+0000","last_became_peered":"2023-07-19T20:44:38.573603+0000","last_unstale":"2023-07-19T20:44:39.965319+0000","last_undegraded":"2023-07-19T20:44:39.965319+0000","last_fullsized":"2023-07-19T20:44:39.965319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:07:43.608434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965884+0000","last_change":"2023-07-19T20:44:38.158352+0000","last_active":"2023-07-19T20:44:39.965884+0000","last_peered":"2023-07-19T20:44:39.965884+0000","last_clean":"2023-07-19T20:44:39.965884+0000","last_became_active":"2023-07-19T20:44:38.158108+0000","last_became_peered":"2023-07-19T20:44:38.158108+0000","last_unstale":"2023-07-19T20:44:39.965884+0000","last_undegraded":"2023-07-19T20:44:39.965884+0000","last_fullsized":"2023-07-19T20:44:39.965884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:56:20.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967338+0000","last_change":"2023-07-19T20:44:38.578475+0000","last_active":"2023-07-19T20:44:39.967338+0000","last_peered":"2023-07-19T20:44:39.967338+0000","last_clean":"2023-07-19T20:44:39.967338+0000","last_became_active":"2023-07-19T20:44:38.578148+0000","last_became_peered":"2023-07-19T20:44:38.578148+0000","last_unstale":"2023-07-19T20:44:39.967338+0000","last_undegraded":"2023-07-19T20:44:39.967338+0000","last_fullsized":"2023-07-19T20:44:39.967338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:47:20.937341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966031+0000","last_change":"2023-07-19T20:44:38.161146+0000","last_active":"2023-07-19T20:44:39.966031+0000","last_peered":"2023-07-19T20:44:39.966031+0000","last_clean":"2023-07-19T20:44:39.966031+0000","last_became_active":"2023-07-19T20:44:38.160826+0000","last_became_peered":"2023-07-19T20:44:38.160826+0000","last_unstale":"2023-07-19T20:44:39.966031+0000","last_undegraded":"2023-07-19T20:44:39.966031+0000","last_fullsized":"2023-07-19T20:44:39.966031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:00:17.913421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965696+0000","last_change":"2023-07-19T20:44:38.575529+0000","last_active":"2023-07-19T20:44:39.965696+0000","last_peered":"2023-07-19T20:44:39.965696+0000","last_clean":"2023-07-19T20:44:39.965696+0000","last_became_active":"2023-07-19T20:44:38.571437+0000","last_became_peered":"2023-07-19T20:44:38.571437+0000","last_unstale":"2023-07-19T20:44:39.965696+0000","last_undegraded":"2023-07-19T20:44:39.965696+0000","last_fullsized":"2023-07-19T20:44:39.965696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:31:08.854923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556868+0000","last_change":"2023-07-19T20:44:38.151428+0000","last_active":"2023-07-19T20:44:39.556868+0000","last_peered":"2023-07-19T20:44:39.556868+0000","last_clean":"2023-07-19T20:44:39.556868+0000","last_became_active":"2023-07-19T20:44:38.150814+0000","last_became_peered":"2023-07-19T20:44:38.150814+0000","last_unstale":"2023-07-19T20:44:39.556868+0000","last_undegraded":"2023-07-19T20:44:39.556868+0000","last_fullsized":"2023-07-19T20:44:39.556868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:43:49.400337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966925+0000","last_change":"2023-07-19T20:44:38.578498+0000","last_active":"2023-07-19T20:44:39.966925+0000","last_peered":"2023-07-19T20:44:39.966925+0000","last_clean":"2023-07-19T20:44:39.966925+0000","last_became_active":"2023-07-19T20:44:38.578229+0000","last_became_peered":"2023-07-19T20:44:38.578229+0000","last_unstale":"2023-07-19T20:44:39.966925+0000","last_undegraded":"2023-07-19T20:44:39.966925+0000","last_fullsized":"2023-07-19T20:44:39.966925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965996+0000","last_change":"2023-07-19T20:44:38.162523+0000","last_active":"2023-07-19T20:44:39.965996+0000","last_peered":"2023-07-19T20:44:39.965996+0000","last_clean":"2023-07-19T20:44:39.965996+0000","last_became_active":"2023-07-19T20:44:38.162180+0000","last_became_peered":"2023-07-19T20:44:38.162180+0000","last_unstale":"2023-07-19T20:44:39.965996+0000","last_undegraded":"2023-07-19T20:44:39.965996+0000","last_fullsized":"2023-07-19T20:44:39.965996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:51:41.425413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966943+0000","last_change":"2023-07-19T20:44:38.578374+0000","last_active":"2023-07-19T20:44:39.966943+0000","last_peered":"2023-07-19T20:44:39.966943+0000","last_clean":"2023-07-19T20:44:39.966943+0000","last_became_active":"2023-07-19T20:44:38.578063+0000","last_became_peered":"2023-07-19T20:44:38.578063+0000","last_unstale":"2023-07-19T20:44:39.966943+0000","last_undegraded":"2023-07-19T20:44:39.966943+0000","last_fullsized":"2023-07-19T20:44:39.966943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966034+0000","last_change":"2023-07-19T20:44:38.161133+0000","last_active":"2023-07-19T20:44:39.966034+0000","last_peered":"2023-07-19T20:44:39.966034+0000","last_clean":"2023-07-19T20:44:39.966034+0000","last_became_active":"2023-07-19T20:44:38.160858+0000","last_became_peered":"2023-07-19T20:44:38.160858+0000","last_unstale":"2023-07-19T20:44:39.966034+0000","last_undegraded":"2023-07-19T20:44:39.966034+0000","last_fullsized":"2023-07-19T20:44:39.966034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966513+0000","last_change":"2023-07-19T20:44:38.569109+0000","last_active":"2023-07-19T20:44:39.966513+0000","last_peered":"2023-07-19T20:44:39.966513+0000","last_clean":"2023-07-19T20:44:39.966513+0000","last_became_active":"2023-07-19T20:44:38.568655+0000","last_became_peered":"2023-07-19T20:44:38.568655+0000","last_unstale":"2023-07-19T20:44:39.966513+0000","last_undegraded":"2023-07-19T20:44:39.966513+0000","last_fullsized":"2023-07-19T20:44:39.966513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:22:21.797390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966727+0000","last_change":"2023-07-19T20:44:38.159979+0000","last_active":"2023-07-19T20:44:39.966727+0000","last_peered":"2023-07-19T20:44:39.966727+0000","last_clean":"2023-07-19T20:44:39.966727+0000","last_became_active":"2023-07-19T20:44:38.159724+0000","last_became_peered":"2023-07-19T20:44:38.159724+0000","last_unstale":"2023-07-19T20:44:39.966727+0000","last_undegraded":"2023-07-19T20:44:39.966727+0000","last_fullsized":"2023-07-19T20:44:39.966727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:13:29.703932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557319+0000","last_change":"2023-07-19T20:44:38.573821+0000","last_active":"2023-07-19T20:44:39.557319+0000","last_peered":"2023-07-19T20:44:39.557319+0000","last_clean":"2023-07-19T20:44:39.557319+0000","last_became_active":"2023-07-19T20:44:38.573531+0000","last_became_peered":"2023-07-19T20:44:38.573531+0000","last_unstale":"2023-07-19T20:44:39.557319+0000","last_undegraded":"2023-07-19T20:44:39.557319+0000","last_fullsized":"2023-07-19T20:44:39.557319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:12:57.038089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967186+0000","last_change":"2023-07-19T20:44:38.161247+0000","last_active":"2023-07-19T20:44:39.967186+0000","last_peered":"2023-07-19T20:44:39.967186+0000","last_clean":"2023-07-19T20:44:39.967186+0000","last_became_active":"2023-07-19T20:44:38.160983+0000","last_became_peered":"2023-07-19T20:44:38.160983+0000","last_unstale":"2023-07-19T20:44:39.967186+0000","last_undegraded":"2023-07-19T20:44:39.967186+0000","last_fullsized":"2023-07-19T20:44:39.967186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:48:53.708405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965596+0000","last_change":"2023-07-19T20:44:38.570267+0000","last_active":"2023-07-19T20:44:39.965596+0000","last_peered":"2023-07-19T20:44:39.965596+0000","last_clean":"2023-07-19T20:44:39.965596+0000","last_became_active":"2023-07-19T20:44:38.569970+0000","last_became_peered":"2023-07-19T20:44:38.569970+0000","last_unstale":"2023-07-19T20:44:39.965596+0000","last_undegraded":"2023-07-19T20:44:39.965596+0000","last_fullsized":"2023-07-19T20:44:39.965596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965824+0000","last_change":"2023-07-19T20:44:38.162813+0000","last_active":"2023-07-19T20:44:39.965824+0000","last_peered":"2023-07-19T20:44:39.965824+0000","last_clean":"2023-07-19T20:44:39.965824+0000","last_became_active":"2023-07-19T20:44:38.162512+0000","last_became_peered":"2023-07-19T20:44:38.162512+0000","last_unstale":"2023-07-19T20:44:39.965824+0000","last_undegraded":"2023-07-19T20:44:39.965824+0000","last_fullsized":"2023-07-19T20:44:39.965824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:56:20.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966572+0000","last_change":"2023-07-19T20:44:38.574677+0000","last_active":"2023-07-19T20:44:39.966572+0000","last_peered":"2023-07-19T20:44:39.966572+0000","last_clean":"2023-07-19T20:44:39.966572+0000","last_became_active":"2023-07-19T20:44:38.574384+0000","last_became_peered":"2023-07-19T20:44:38.574384+0000","last_unstale":"2023-07-19T20:44:39.966572+0000","last_undegraded":"2023-07-19T20:44:39.966572+0000","last_fullsized":"2023-07-19T20:44:39.966572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:56:39.985134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557050+0000","last_change":"2023-07-19T20:44:38.157897+0000","last_active":"2023-07-19T20:44:39.557050+0000","last_peered":"2023-07-19T20:44:39.557050+0000","last_clean":"2023-07-19T20:44:39.557050+0000","last_became_active":"2023-07-19T20:44:38.157613+0000","last_became_peered":"2023-07-19T20:44:38.157613+0000","last_unstale":"2023-07-19T20:44:39.557050+0000","last_undegraded":"2023-07-19T20:44:39.557050+0000","last_fullsized":"2023-07-19T20:44:39.557050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:10:43.091101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966876+0000","last_change":"2023-07-19T20:44:38.567166+0000","last_active":"2023-07-19T20:44:39.966876+0000","last_peered":"2023-07-19T20:44:39.966876+0000","last_clean":"2023-07-19T20:44:39.966876+0000","last_became_active":"2023-07-19T20:44:38.566539+0000","last_became_peered":"2023-07-19T20:44:38.566539+0000","last_unstale":"2023-07-19T20:44:39.966876+0000","last_undegraded":"2023-07-19T20:44:39.966876+0000","last_fullsized":"2023-07-19T20:44:39.966876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:57:34.828178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966584+0000","last_change":"2023-07-19T20:44:38.153301+0000","last_active":"2023-07-19T20:44:39.966584+0000","last_peered":"2023-07-19T20:44:39.966584+0000","last_clean":"2023-07-19T20:44:39.966584+0000","last_became_active":"2023-07-19T20:44:38.153036+0000","last_became_peered":"2023-07-19T20:44:38.153036+0000","last_unstale":"2023-07-19T20:44:39.966584+0000","last_undegraded":"2023-07-19T20:44:39.966584+0000","last_fullsized":"2023-07-19T20:44:39.966584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:29:36.129487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966373+0000","last_change":"2023-07-19T20:44:38.566702+0000","last_active":"2023-07-19T20:44:39.966373+0000","last_peered":"2023-07-19T20:44:39.966373+0000","last_clean":"2023-07-19T20:44:39.966373+0000","last_became_active":"2023-07-19T20:44:38.566298+0000","last_became_peered":"2023-07-19T20:44:38.566298+0000","last_unstale":"2023-07-19T20:44:39.966373+0000","last_undegraded":"2023-07-19T20:44:39.966373+0000","last_fullsized":"2023-07-19T20:44:39.966373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:40:21.960885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965195+0000","last_change":"2023-07-19T20:44:38.161123+0000","last_active":"2023-07-19T20:44:39.965195+0000","last_peered":"2023-07-19T20:44:39.965195+0000","last_clean":"2023-07-19T20:44:39.965195+0000","last_became_active":"2023-07-19T20:44:38.160828+0000","last_became_peered":"2023-07-19T20:44:38.160828+0000","last_unstale":"2023-07-19T20:44:39.965195+0000","last_undegraded":"2023-07-19T20:44:39.965195+0000","last_fullsized":"2023-07-19T20:44:39.965195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556893+0000","last_change":"2023-07-19T20:44:38.573695+0000","last_active":"2023-07-19T20:44:39.556893+0000","last_peered":"2023-07-19T20:44:39.556893+0000","last_clean":"2023-07-19T20:44:39.556893+0000","last_became_active":"2023-07-19T20:44:38.573109+0000","last_became_peered":"2023-07-19T20:44:38.573109+0000","last_unstale":"2023-07-19T20:44:39.556893+0000","last_undegraded":"2023-07-19T20:44:39.556893+0000","last_fullsized":"2023-07-19T20:44:39.556893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:10:27.373852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966776+0000","last_change":"2023-07-19T20:44:38.159710+0000","last_active":"2023-07-19T20:44:39.966776+0000","last_peered":"2023-07-19T20:44:39.966776+0000","last_clean":"2023-07-19T20:44:39.966776+0000","last_became_active":"2023-07-19T20:44:38.159491+0000","last_became_peered":"2023-07-19T20:44:38.159491+0000","last_unstale":"2023-07-19T20:44:39.966776+0000","last_undegraded":"2023-07-19T20:44:39.966776+0000","last_fullsized":"2023-07-19T20:44:39.966776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:48:53.708405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.556794+0000","last_change":"2023-07-19T20:44:33.123673+0000","last_active":"2023-07-19T20:44:38.556794+0000","last_peered":"2023-07-19T20:44:38.556794+0000","last_clean":"2023-07-19T20:44:38.556794+0000","last_became_active":"2023-07-19T20:44:33.123400+0000","last_became_peered":"2023-07-19T20:44:33.123400+0000","last_unstale":"2023-07-19T20:44:38.556794+0000","last_undegraded":"2023-07-19T20:44:38.556794+0000","last_fullsized":"2023-07-19T20:44:38.556794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:29:32.159769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965145+0000","last_change":"2023-07-19T20:44:38.578403+0000","last_active":"2023-07-19T20:44:39.965145+0000","last_peered":"2023-07-19T20:44:39.965145+0000","last_clean":"2023-07-19T20:44:39.965145+0000","last_became_active":"2023-07-19T20:44:38.578137+0000","last_became_peered":"2023-07-19T20:44:38.578137+0000","last_unstale":"2023-07-19T20:44:39.965145+0000","last_undegraded":"2023-07-19T20:44:39.965145+0000","last_fullsized":"2023-07-19T20:44:39.965145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:31:08.854923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.556588+0000","last_change":"2023-07-19T20:44:33.124105+0000","last_active":"2023-07-19T20:44:38.556588+0000","last_peered":"2023-07-19T20:44:38.556588+0000","last_clean":"2023-07-19T20:44:38.556588+0000","last_became_active":"2023-07-19T20:44:33.123795+0000","last_became_peered":"2023-07-19T20:44:33.123795+0000","last_unstale":"2023-07-19T20:44:38.556588+0000","last_undegraded":"2023-07-19T20:44:38.556588+0000","last_fullsized":"2023-07-19T20:44:38.556588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:14:19.759142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:40.744072+0000","last_change":"2023-07-19T20:44:38.153628+0000","last_active":"2023-07-19T20:44:40.744072+0000","last_peered":"2023-07-19T20:44:40.744072+0000","last_clean":"2023-07-19T20:44:40.744072+0000","last_became_active":"2023-07-19T20:44:38.153300+0000","last_became_peered":"2023-07-19T20:44:38.153300+0000","last_unstale":"2023-07-19T20:44:40.744072+0000","last_undegraded":"2023-07-19T20:44:40.744072+0000","last_fullsized":"2023-07-19T20:44:40.744072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966636+0000","last_change":"2023-07-19T20:44:38.565069+0000","last_active":"2023-07-19T20:44:39.966636+0000","last_peered":"2023-07-19T20:44:39.966636+0000","last_clean":"2023-07-19T20:44:39.966636+0000","last_became_active":"2023-07-19T20:44:38.564602+0000","last_became_peered":"2023-07-19T20:44:38.564602+0000","last_unstale":"2023-07-19T20:44:39.966636+0000","last_undegraded":"2023-07-19T20:44:39.966636+0000","last_fullsized":"2023-07-19T20:44:39.966636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:16:09.390291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.576773+0000","last_change":"2023-07-19T20:44:33.124619+0000","last_active":"2023-07-19T20:44:38.576773+0000","last_peered":"2023-07-19T20:44:38.576773+0000","last_clean":"2023-07-19T20:44:38.576773+0000","last_became_active":"2023-07-19T20:44:33.124278+0000","last_became_peered":"2023-07-19T20:44:33.124278+0000","last_unstale":"2023-07-19T20:44:38.576773+0000","last_undegraded":"2023-07-19T20:44:38.576773+0000","last_fullsized":"2023-07-19T20:44:38.576773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:57:12.956476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.570350+0000","last_change":"2023-07-19T20:44:33.129185+0000","last_active":"2023-07-19T20:44:38.570350+0000","last_peered":"2023-07-19T20:44:38.570350+0000","last_clean":"2023-07-19T20:44:38.570350+0000","last_became_active":"2023-07-19T20:44:33.128873+0000","last_became_peered":"2023-07-19T20:44:33.128873+0000","last_unstale":"2023-07-19T20:44:38.570350+0000","last_undegraded":"2023-07-19T20:44:38.570350+0000","last_fullsized":"2023-07-19T20:44:38.570350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:59:43.504158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965507+0000","last_change":"2023-07-19T20:44:38.157781+0000","last_active":"2023-07-19T20:44:39.965507+0000","last_peered":"2023-07-19T20:44:39.965507+0000","last_clean":"2023-07-19T20:44:39.965507+0000","last_became_active":"2023-07-19T20:44:38.157521+0000","last_became_peered":"2023-07-19T20:44:38.157521+0000","last_unstale":"2023-07-19T20:44:39.965507+0000","last_undegraded":"2023-07-19T20:44:39.965507+0000","last_fullsized":"2023-07-19T20:44:39.965507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:48:53.708405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965790+0000","last_change":"2023-07-19T20:44:38.569844+0000","last_active":"2023-07-19T20:44:39.965790+0000","last_peered":"2023-07-19T20:44:39.965790+0000","last_clean":"2023-07-19T20:44:39.965790+0000","last_became_active":"2023-07-19T20:44:38.569612+0000","last_became_peered":"2023-07-19T20:44:38.569612+0000","last_unstale":"2023-07-19T20:44:39.965790+0000","last_undegraded":"2023-07-19T20:44:39.965790+0000","last_fullsized":"2023-07-19T20:44:39.965790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:30:42.451874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.571549+0000","last_change":"2023-07-19T20:44:33.746155+0000","last_active":"2023-07-19T20:44:38.571549+0000","last_peered":"2023-07-19T20:44:38.571549+0000","last_clean":"2023-07-19T20:44:38.571549+0000","last_became_active":"2023-07-19T20:44:33.745839+0000","last_became_peered":"2023-07-19T20:44:33.745839+0000","last_unstale":"2023-07-19T20:44:38.571549+0000","last_undegraded":"2023-07-19T20:44:38.571549+0000","last_fullsized":"2023-07-19T20:44:38.571549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:27:53.622247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556163+0000","last_change":"2023-07-19T20:44:38.156539+0000","last_active":"2023-07-19T20:44:39.556163+0000","last_peered":"2023-07-19T20:44:39.556163+0000","last_clean":"2023-07-19T20:44:39.556163+0000","last_became_active":"2023-07-19T20:44:38.156248+0000","last_became_peered":"2023-07-19T20:44:38.156248+0000","last_unstale":"2023-07-19T20:44:39.556163+0000","last_undegraded":"2023-07-19T20:44:39.556163+0000","last_fullsized":"2023-07-19T20:44:39.556163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:27:24.261526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556806+0000","last_change":"2023-07-19T20:44:38.574341+0000","last_active":"2023-07-19T20:44:39.556806+0000","last_peered":"2023-07-19T20:44:39.556806+0000","last_clean":"2023-07-19T20:44:39.556806+0000","last_became_active":"2023-07-19T20:44:38.574094+0000","last_became_peered":"2023-07-19T20:44:38.574094+0000","last_unstale":"2023-07-19T20:44:39.556806+0000","last_undegraded":"2023-07-19T20:44:39.556806+0000","last_fullsized":"2023-07-19T20:44:39.556806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:47:25.794801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.569883+0000","last_change":"2023-07-19T20:44:33.746397+0000","last_active":"2023-07-19T20:44:38.569883+0000","last_peered":"2023-07-19T20:44:38.569883+0000","last_clean":"2023-07-19T20:44:38.569883+0000","last_became_active":"2023-07-19T20:44:33.746140+0000","last_became_peered":"2023-07-19T20:44:33.746140+0000","last_unstale":"2023-07-19T20:44:38.569883+0000","last_undegraded":"2023-07-19T20:44:38.569883+0000","last_fullsized":"2023-07-19T20:44:38.569883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:56:34.826030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965682+0000","last_change":"2023-07-19T20:44:38.155907+0000","last_active":"2023-07-19T20:44:39.965682+0000","last_peered":"2023-07-19T20:44:39.965682+0000","last_clean":"2023-07-19T20:44:39.965682+0000","last_became_active":"2023-07-19T20:44:38.155624+0000","last_became_peered":"2023-07-19T20:44:38.155624+0000","last_unstale":"2023-07-19T20:44:39.965682+0000","last_undegraded":"2023-07-19T20:44:39.965682+0000","last_fullsized":"2023-07-19T20:44:39.965682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:58:48.815316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557161+0000","last_change":"2023-07-19T20:44:38.564337+0000","last_active":"2023-07-19T20:44:39.557161+0000","last_peered":"2023-07-19T20:44:39.557161+0000","last_clean":"2023-07-19T20:44:39.557161+0000","last_became_active":"2023-07-19T20:44:38.563991+0000","last_became_peered":"2023-07-19T20:44:38.563991+0000","last_unstale":"2023-07-19T20:44:39.557161+0000","last_undegraded":"2023-07-19T20:44:39.557161+0000","last_fullsized":"2023-07-19T20:44:39.557161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:48:50.207451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.554572+0000","last_change":"2023-07-19T20:44:33.746552+0000","last_active":"2023-07-19T20:44:38.554572+0000","last_peered":"2023-07-19T20:44:38.554572+0000","last_clean":"2023-07-19T20:44:38.554572+0000","last_became_active":"2023-07-19T20:44:33.745934+0000","last_became_peered":"2023-07-19T20:44:33.745934+0000","last_unstale":"2023-07-19T20:44:38.554572+0000","last_undegraded":"2023-07-19T20:44:38.554572+0000","last_fullsized":"2023-07-19T20:44:38.554572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:19:16.931517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966394+0000","last_change":"2023-07-19T20:44:38.152599+0000","last_active":"2023-07-19T20:44:39.966394+0000","last_peered":"2023-07-19T20:44:39.966394+0000","last_clean":"2023-07-19T20:44:39.966394+0000","last_became_active":"2023-07-19T20:44:38.152331+0000","last_became_peered":"2023-07-19T20:44:38.152331+0000","last_unstale":"2023-07-19T20:44:39.966394+0000","last_undegraded":"2023-07-19T20:44:39.966394+0000","last_fullsized":"2023-07-19T20:44:39.966394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:43:49.400337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556867+0000","last_change":"2023-07-19T20:44:38.573279+0000","last_active":"2023-07-19T20:44:39.556867+0000","last_peered":"2023-07-19T20:44:39.556867+0000","last_clean":"2023-07-19T20:44:39.556867+0000","last_became_active":"2023-07-19T20:44:38.572918+0000","last_became_peered":"2023-07-19T20:44:38.572918+0000","last_unstale":"2023-07-19T20:44:39.556867+0000","last_undegraded":"2023-07-19T20:44:39.556867+0000","last_fullsized":"2023-07-19T20:44:39.556867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:12:57.038089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.560127+0000","last_change":"2023-07-19T20:44:33.746879+0000","last_active":"2023-07-19T20:44:38.560127+0000","last_peered":"2023-07-19T20:44:38.560127+0000","last_clean":"2023-07-19T20:44:38.560127+0000","last_became_active":"2023-07-19T20:44:33.746120+0000","last_became_peered":"2023-07-19T20:44:33.746120+0000","last_unstale":"2023-07-19T20:44:38.560127+0000","last_undegraded":"2023-07-19T20:44:38.560127+0000","last_fullsized":"2023-07-19T20:44:38.560127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:34:22.791863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556786+0000","last_change":"2023-07-19T20:44:38.157438+0000","last_active":"2023-07-19T20:44:39.556786+0000","last_peered":"2023-07-19T20:44:39.556786+0000","last_clean":"2023-07-19T20:44:39.556786+0000","last_became_active":"2023-07-19T20:44:38.157152+0000","last_became_peered":"2023-07-19T20:44:38.157152+0000","last_unstale":"2023-07-19T20:44:39.556786+0000","last_undegraded":"2023-07-19T20:44:39.556786+0000","last_fullsized":"2023-07-19T20:44:39.556786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:51:22.297960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965788+0000","last_change":"2023-07-19T20:44:38.570259+0000","last_active":"2023-07-19T20:44:39.965788+0000","last_peered":"2023-07-19T20:44:39.965788+0000","last_clean":"2023-07-19T20:44:39.965788+0000","last_became_active":"2023-07-19T20:44:38.569979+0000","last_became_peered":"2023-07-19T20:44:38.569979+0000","last_unstale":"2023-07-19T20:44:39.965788+0000","last_undegraded":"2023-07-19T20:44:39.965788+0000","last_fullsized":"2023-07-19T20:44:39.965788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:54:57.194368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.561428+0000","last_change":"2023-07-19T20:44:33.129202+0000","last_active":"2023-07-19T20:44:38.561428+0000","last_peered":"2023-07-19T20:44:38.561428+0000","last_clean":"2023-07-19T20:44:38.561428+0000","last_became_active":"2023-07-19T20:44:33.128920+0000","last_became_peered":"2023-07-19T20:44:33.128920+0000","last_unstale":"2023-07-19T20:44:38.561428+0000","last_undegraded":"2023-07-19T20:44:38.561428+0000","last_fullsized":"2023-07-19T20:44:38.561428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:43:18.861932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967383+0000","last_change":"2023-07-19T20:44:38.161925+0000","last_active":"2023-07-19T20:44:39.967383+0000","last_peered":"2023-07-19T20:44:39.967383+0000","last_clean":"2023-07-19T20:44:39.967383+0000","last_became_active":"2023-07-19T20:44:38.161648+0000","last_became_peered":"2023-07-19T20:44:38.161648+0000","last_unstale":"2023-07-19T20:44:39.967383+0000","last_undegraded":"2023-07-19T20:44:39.967383+0000","last_fullsized":"2023-07-19T20:44:39.967383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:03:08.671248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556470+0000","last_change":"2023-07-19T20:44:38.570962+0000","last_active":"2023-07-19T20:44:39.556470+0000","last_peered":"2023-07-19T20:44:39.556470+0000","last_clean":"2023-07-19T20:44:39.556470+0000","last_became_active":"2023-07-19T20:44:38.570620+0000","last_became_peered":"2023-07-19T20:44:38.570620+0000","last_unstale":"2023-07-19T20:44:39.556470+0000","last_undegraded":"2023-07-19T20:44:39.556470+0000","last_fullsized":"2023-07-19T20:44:39.556470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:09:27.024650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965931+0000","last_change":"2023-07-19T20:44:38.158044+0000","last_active":"2023-07-19T20:44:39.965931+0000","last_peered":"2023-07-19T20:44:39.965931+0000","last_clean":"2023-07-19T20:44:39.965931+0000","last_became_active":"2023-07-19T20:44:38.157760+0000","last_became_peered":"2023-07-19T20:44:38.157760+0000","last_unstale":"2023-07-19T20:44:39.965931+0000","last_undegraded":"2023-07-19T20:44:39.965931+0000","last_fullsized":"2023-07-19T20:44:39.965931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:03:08.671248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557350+0000","last_change":"2023-07-19T20:44:38.569229+0000","last_active":"2023-07-19T20:44:39.557350+0000","last_peered":"2023-07-19T20:44:39.557350+0000","last_clean":"2023-07-19T20:44:39.557350+0000","last_became_active":"2023-07-19T20:44:38.568732+0000","last_became_peered":"2023-07-19T20:44:38.568732+0000","last_unstale":"2023-07-19T20:44:39.557350+0000","last_undegraded":"2023-07-19T20:44:39.557350+0000","last_fullsized":"2023-07-19T20:44:39.557350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:43:50.405654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967067+0000","last_change":"2023-07-19T20:44:38.158368+0000","last_active":"2023-07-19T20:44:39.967067+0000","last_peered":"2023-07-19T20:44:39.967067+0000","last_clean":"2023-07-19T20:44:39.967067+0000","last_became_active":"2023-07-19T20:44:38.158097+0000","last_became_peered":"2023-07-19T20:44:38.158097+0000","last_unstale":"2023-07-19T20:44:39.967067+0000","last_undegraded":"2023-07-19T20:44:39.967067+0000","last_fullsized":"2023-07-19T20:44:39.967067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966104+0000","last_change":"2023-07-19T20:44:38.574231+0000","last_active":"2023-07-19T20:44:39.966104+0000","last_peered":"2023-07-19T20:44:39.966104+0000","last_clean":"2023-07-19T20:44:39.966104+0000","last_became_active":"2023-07-19T20:44:38.573954+0000","last_became_peered":"2023-07-19T20:44:38.573954+0000","last_unstale":"2023-07-19T20:44:39.966104+0000","last_undegraded":"2023-07-19T20:44:39.966104+0000","last_fullsized":"2023-07-19T20:44:39.966104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:44:27.891825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967472+0000","last_change":"2023-07-19T20:44:38.158334+0000","last_active":"2023-07-19T20:44:39.967472+0000","last_peered":"2023-07-19T20:44:39.967472+0000","last_clean":"2023-07-19T20:44:39.967472+0000","last_became_active":"2023-07-19T20:44:38.158046+0000","last_became_peered":"2023-07-19T20:44:38.158046+0000","last_unstale":"2023-07-19T20:44:39.967472+0000","last_undegraded":"2023-07-19T20:44:39.967472+0000","last_fullsized":"2023-07-19T20:44:39.967472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:49:55.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966062+0000","last_change":"2023-07-19T20:44:38.574118+0000","last_active":"2023-07-19T20:44:39.966062+0000","last_peered":"2023-07-19T20:44:39.966062+0000","last_clean":"2023-07-19T20:44:39.966062+0000","last_became_active":"2023-07-19T20:44:38.573825+0000","last_became_peered":"2023-07-19T20:44:38.573825+0000","last_unstale":"2023-07-19T20:44:39.966062+0000","last_undegraded":"2023-07-19T20:44:39.966062+0000","last_fullsized":"2023-07-19T20:44:39.966062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:12:33.443843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965892+0000","last_change":"2023-07-19T20:44:38.158463+0000","last_active":"2023-07-19T20:44:39.965892+0000","last_peered":"2023-07-19T20:44:39.965892+0000","last_clean":"2023-07-19T20:44:39.965892+0000","last_became_active":"2023-07-19T20:44:38.158210+0000","last_became_peered":"2023-07-19T20:44:38.158210+0000","last_unstale":"2023-07-19T20:44:39.965892+0000","last_undegraded":"2023-07-19T20:44:39.965892+0000","last_fullsized":"2023-07-19T20:44:39.965892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:03:08.671248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965328+0000","last_change":"2023-07-19T20:44:38.561250+0000","last_active":"2023-07-19T20:44:39.965328+0000","last_peered":"2023-07-19T20:44:39.965328+0000","last_clean":"2023-07-19T20:44:39.965328+0000","last_became_active":"2023-07-19T20:44:38.561001+0000","last_became_peered":"2023-07-19T20:44:38.561001+0000","last_unstale":"2023-07-19T20:44:39.965328+0000","last_undegraded":"2023-07-19T20:44:39.965328+0000","last_fullsized":"2023-07-19T20:44:39.965328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965583+0000","last_change":"2023-07-19T20:44:38.156696+0000","last_active":"2023-07-19T20:44:39.965583+0000","last_peered":"2023-07-19T20:44:39.965583+0000","last_clean":"2023-07-19T20:44:39.965583+0000","last_became_active":"2023-07-19T20:44:38.156455+0000","last_became_peered":"2023-07-19T20:44:38.156455+0000","last_unstale":"2023-07-19T20:44:39.965583+0000","last_undegraded":"2023-07-19T20:44:39.965583+0000","last_fullsized":"2023-07-19T20:44:39.965583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:00:17.913421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965669+0000","last_change":"2023-07-19T20:44:38.568760+0000","last_active":"2023-07-19T20:44:39.965669+0000","last_peered":"2023-07-19T20:44:39.965669+0000","last_clean":"2023-07-19T20:44:39.965669+0000","last_became_active":"2023-07-19T20:44:38.568148+0000","last_became_peered":"2023-07-19T20:44:38.568148+0000","last_unstale":"2023-07-19T20:44:39.965669+0000","last_undegraded":"2023-07-19T20:44:39.965669+0000","last_fullsized":"2023-07-19T20:44:39.965669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:29:06.966551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556998+0000","last_change":"2023-07-19T20:44:38.574672+0000","last_active":"2023-07-19T20:44:39.556998+0000","last_peered":"2023-07-19T20:44:39.556998+0000","last_clean":"2023-07-19T20:44:39.556998+0000","last_became_active":"2023-07-19T20:44:38.574318+0000","last_became_peered":"2023-07-19T20:44:38.574318+0000","last_unstale":"2023-07-19T20:44:39.556998+0000","last_undegraded":"2023-07-19T20:44:39.556998+0000","last_fullsized":"2023-07-19T20:44:39.556998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:29:14.941818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965294+0000","last_change":"2023-07-19T20:44:38.574389+0000","last_active":"2023-07-19T20:44:39.965294+0000","last_peered":"2023-07-19T20:44:39.965294+0000","last_clean":"2023-07-19T20:44:39.965294+0000","last_became_active":"2023-07-19T20:44:38.574112+0000","last_became_peered":"2023-07-19T20:44:38.574112+0000","last_unstale":"2023-07-19T20:44:39.965294+0000","last_undegraded":"2023-07-19T20:44:39.965294+0000","last_fullsized":"2023-07-19T20:44:39.965294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:19:13.016609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966463+0000","last_change":"2023-07-19T20:44:38.566538+0000","last_active":"2023-07-19T20:44:39.966463+0000","last_peered":"2023-07-19T20:44:39.966463+0000","last_clean":"2023-07-19T20:44:39.966463+0000","last_became_active":"2023-07-19T20:44:38.566260+0000","last_became_peered":"2023-07-19T20:44:38.566260+0000","last_unstale":"2023-07-19T20:44:39.966463+0000","last_undegraded":"2023-07-19T20:44:39.966463+0000","last_fullsized":"2023-07-19T20:44:39.966463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:39:41.156243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965832+0000","last_change":"2023-07-19T20:44:38.583615+0000","last_active":"2023-07-19T20:44:39.965832+0000","last_peered":"2023-07-19T20:44:39.965832+0000","last_clean":"2023-07-19T20:44:39.965832+0000","last_became_active":"2023-07-19T20:44:38.583193+0000","last_became_peered":"2023-07-19T20:44:38.583193+0000","last_unstale":"2023-07-19T20:44:39.965832+0000","last_undegraded":"2023-07-19T20:44:39.965832+0000","last_fullsized":"2023-07-19T20:44:39.965832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:30:42.451874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556700+0000","last_change":"2023-07-19T20:44:38.578448+0000","last_active":"2023-07-19T20:44:39.556700+0000","last_peered":"2023-07-19T20:44:39.556700+0000","last_clean":"2023-07-19T20:44:39.556700+0000","last_became_active":"2023-07-19T20:44:38.578182+0000","last_became_peered":"2023-07-19T20:44:38.578182+0000","last_unstale":"2023-07-19T20:44:39.556700+0000","last_undegraded":"2023-07-19T20:44:39.556700+0000","last_fullsized":"2023-07-19T20:44:39.556700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:20:24.991572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":847872,"data_stored":674320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":82172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":819200,"data_stored":672540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":81211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.5419999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":83792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":81863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-19T20:44:47.297 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-19T20:44:47.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.459+0000 7f7ec6533700 1 Processor -- start 2023-07-19T20:44:47.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.459+0000 7f7ec6533700 1 -- start start 2023-07-19T20:44:47.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.460+0000 7f7ec6533700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7ec006a560 0x7f7ec0071990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.460+0000 7f7ec6533700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ec00b9bc0 0x7f7ec014e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.460+0000 7f7ec6533700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec014df40 con 0x7f7ec006a930 2023-07-19T20:44:47.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.460+0000 7f7ec6533700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec0070480 con 0x7f7ec006a560 2023-07-19T20:44:47.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.460+0000 7f7ec6533700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0071fb0 con 0x7f7ec00b9bc0 2023-07-19T20:44:47.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.460+0000 7f7ec4ad0700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7ec006a930 0x7f7ec006d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41346/0 (socket says 172.21.15.117:41346) 2023-07-19T20:44:47.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.460+0000 7f7ec4ad0700 1 -- 172.21.15.117:0/184225562 learned_addr learned my addr 172.21.15.117:0/184225562 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.460+0000 7f7ebffff700 1 --2- 172.21.15.117:0/184225562 >> v2:172.21.15.124:3300/0 conn(0x7f7ec006a560 0x7f7ec0071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.460+0000 7f7eb7fff700 1 --2- 172.21.15.117:0/184225562 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ec00b9bc0 0x7f7ec014e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.460+0000 7f7ebf7fe700 1 -- 172.21.15.117:0/184225562 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904040804 0 0) 0x7f7ec014df40 con 0x7f7ec006a930 2023-07-19T20:44:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.460+0000 7f7ebf7fe700 1 -- 172.21.15.117:0/184225562 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eac0035b0 con 0x7f7ec006a930 2023-07-19T20:44:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 -- 172.21.15.117:0/184225562 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3387637051 0 0) 0x7f7eac0035b0 con 0x7f7ec006a930 2023-07-19T20:44:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 -- 172.21.15.117:0/184225562 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ec00b9bc0 msgr2=0x7f7ec014e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 --2- 172.21.15.117:0/184225562 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ec00b9bc0 0x7f7ec014e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 -- 172.21.15.117:0/184225562 >> v2:172.21.15.124:3300/0 conn(0x7f7ec006a560 msgr2=0x7f7ec0071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 --2- 172.21.15.117:0/184225562 >> v2:172.21.15.124:3300/0 conn(0x7f7ec006a560 0x7f7ec0071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 -- 172.21.15.117:0/184225562 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec0072290 con 0x7f7ec006a930 2023-07-19T20:44:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 -- 172.21.15.117:0/184225562 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f7eb80019f0 con 0x7f7ec006a930 2023-07-19T20:44:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 -- 172.21.15.117:0/184225562 >> v1:172.21.15.117:6789/0 conn(0x7f7ec006a930 legacy=0x7f7ec006d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 --2- 172.21.15.117:0/184225562 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7eac003a00 0x7f7eac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 --2- 172.21.15.117:0/184225562 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ec00b9bc0 0x7f7eac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 --2- 172.21.15.117:0/184225562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7eac004d90 0x7f7eac005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 -- 172.21.15.117:0/184225562 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0070480 con 0x7f7eac004d90 2023-07-19T20:44:47.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 -- 172.21.15.117:0/184225562 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0071fb0 con 0x7f7eac003a00 2023-07-19T20:44:47.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 -- 172.21.15.117:0/184225562 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac00ba10 con 0x7f7ec00b9bc0 2023-07-19T20:44:47.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ec4ad0700 1 --2- 172.21.15.117:0/184225562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7eac004d90 0x7f7eac005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7eb7fff700 1 --2- 172.21.15.117:0/184225562 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ec00b9bc0 0x7f7eac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebffff700 1 --2- 172.21.15.117:0/184225562 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7eac003a00 0x7f7eac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ec4ad0700 1 -- 172.21.15.117:0/184225562 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ec00b9bc0 msgr2=0x7f7eac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:47.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ec4ad0700 1 --2- 172.21.15.117:0/184225562 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ec00b9bc0 0x7f7eac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ec4ad0700 1 -- 172.21.15.117:0/184225562 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7eac003a00 msgr2=0x7f7eac003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:47.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ec4ad0700 1 --2- 172.21.15.117:0/184225562 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7eac003a00 0x7f7eac003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ec4ad0700 1 -- 172.21.15.117:0/184225562 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac0035b0 con 0x7f7eac004d90 2023-07-19T20:44:47.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ec4ad0700 1 --2- 172.21.15.117:0/184225562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7eac004d90 0x7f7eac005200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800a8d0 tx=0x7f7eac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982ec670ed13974f server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:47.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 -- 172.21.15.117:0/184225562 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800a340 con 0x7f7eac004d90 2023-07-19T20:44:47.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 -- 172.21.15.117:0/184225562 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb8012600 con 0x7f7eac004d90 2023-07-19T20:44:47.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.461+0000 7f7ebf7fe700 1 -- 172.21.15.117:0/184225562 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb80129b0 con 0x7f7eac004d90 2023-07-19T20:44:47.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.462+0000 7f7ec6533700 1 -- 172.21.15.117:0/184225562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7eac004d90 msgr2=0x7f7eac005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.462+0000 7f7ec6533700 1 --2- 172.21.15.117:0/184225562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7eac004d90 0x7f7eac005200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800a8d0 tx=0x7f7eac005880 comp rx=0 tx=0).stop 2023-07-19T20:44:47.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.462+0000 7f7ec4ad0700 1 -- 172.21.15.117:0/184225562 reap_dead start 2023-07-19T20:44:47.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.462+0000 7f7ec6533700 1 -- 172.21.15.117:0/184225562 shutdown_connections 2023-07-19T20:44:47.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.462+0000 7f7ec6533700 1 -- 172.21.15.117:0/184225562 >> 172.21.15.117:0/184225562 conn(0x7f7ec00bd8b0 msgr2=0x7f7ec00bdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:47.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.462+0000 7f7ec6533700 1 -- 172.21.15.117:0/184225562 shutdown_connections 2023-07-19T20:44:47.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.462+0000 7f7ec6533700 1 -- 172.21.15.117:0/184225562 wait complete. 2023-07-19T20:44:47.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.463+0000 7f7ec6533700 1 Processor -- start 2023-07-19T20:44:47.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.464+0000 7f7ec6533700 1 -- start start 2023-07-19T20:44:47.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.464+0000 7f7ec6533700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ec00b1940 0x7f7ec00b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.464+0000 7f7ec6533700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ec00b7a10 0x7f7ec00b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.464+0000 7f7ec6533700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ec00b2b80 0x7f7ec00afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.464+0000 7f7ec6533700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00b66d0 con 0x7f7ec00b2b80 2023-07-19T20:44:47.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.464+0000 7f7ec6533700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec01e1200 con 0x7f7ec00b7a10 2023-07-19T20:44:47.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.464+0000 7f7ec6533700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00b09f0 con 0x7f7ec00b1940 2023-07-19T20:44:47.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.464+0000 7f7ec4ad0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ec00b2b80 0x7f7ec00afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.464+0000 7f7ec4ad0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ec00b2b80 0x7f7ec00afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43924/0 (socket says 172.21.15.117:43924) 2023-07-19T20:44:47.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.464+0000 7f7ec4ad0700 1 -- 172.21.15.117:0/3479697523 learned_addr learned my addr 172.21.15.117:0/3479697523 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:47.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7ebffff700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ec00b1940 0x7f7ec00b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7eb7fff700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ec00b7a10 0x7f7ec00b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7ec4ad0700 1 -- 172.21.15.117:0/3479697523 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ec00b1940 msgr2=0x7f7ec00b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7ec4ad0700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ec00b1940 0x7f7ec00b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7ec4ad0700 1 -- 172.21.15.117:0/3479697523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ec00b7a10 msgr2=0x7f7ec00b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7ec4ad0700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ec00b7a10 0x7f7ec00b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7ec4ad0700 1 -- 172.21.15.117:0/3479697523 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec01e0930 con 0x7f7ec00b2b80 2023-07-19T20:44:47.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7ebffff700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ec00b1940 0x7f7ec00b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:47.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7eb7fff700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ec00b7a10 0x7f7ec00b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:47.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7ec4ad0700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ec00b2b80 0x7f7ec00afbd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0046d0 tx=0x7f7eb8001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:47.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7ebd7fa700 1 -- 172.21.15.117:0/3479697523 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800a340 con 0x7f7ec00b2b80 2023-07-19T20:44:47.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7ebd7fa700 1 -- 172.21.15.117:0/3479697523 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb80019c0 con 0x7f7ec00b2b80 2023-07-19T20:44:47.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7ec6533700 1 -- 172.21.15.117:0/3479697523 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec00b3000 con 0x7f7ec00b2b80 2023-07-19T20:44:47.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7ebd7fa700 1 -- 172.21.15.117:0/3479697523 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8027410 con 0x7f7ec00b2b80 2023-07-19T20:44:47.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.465+0000 7f7ec6533700 1 -- 172.21.15.117:0/3479697523 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec01e0e90 con 0x7f7ec00b2b80 2023-07-19T20:44:47.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.466+0000 7f7ec6533700 1 -- 172.21.15.117:0/3479697523 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec00ba7c0 con 0x7f7ec00b2b80 2023-07-19T20:44:47.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.466+0000 7f7ebd7fa700 1 -- 172.21.15.117:0/3479697523 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f7eb8019070 con 0x7f7ec00b2b80 2023-07-19T20:44:47.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.467+0000 7f7ebd7fa700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7ea006a660 0x7f7ea006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.467+0000 7f7ebffff700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7ea006a660 0x7f7ea006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.467+0000 7f7ebd7fa700 1 -- 172.21.15.117:0/3479697523 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7eb8089d90 con 0x7f7ec00b2b80 2023-07-19T20:44:47.472 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.467+0000 7f7ebffff700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7ea006a660 0x7f7ea006cb10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009c60 tx=0x7f7eb0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:47.472 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.471+0000 7f7ebd7fa700 1 -- 172.21.15.117:0/3479697523 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7eb8055220 con 0x7f7ec00b2b80 2023-07-19T20:44:47.648 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.654+0000 7f7ec6533700 1 -- 172.21.15.117:0/3479697523 --> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ec0072570 con 0x7f7ea006a660 2023-07-19T20:44:47.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.661+0000 7f7ebd7fa700 1 -- 172.21.15.117:0/3479697523 <== mgr.4107 v2:172.21.15.117:6832/146126 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286811 (secure 0 0 0) 0x7f7eb0009da0 con 0x7f7ea006a660 2023-07-19T20:44:47.659 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:47.661 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.665+0000 7f7ec6533700 1 -- 172.21.15.117:0/3479697523 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7ea006a660 msgr2=0x7f7ea006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.661 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.665+0000 7f7ec6533700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7ea006a660 0x7f7ea006cb10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009c60 tx=0x7f7eb0008040 comp rx=0 tx=0).stop 2023-07-19T20:44:47.661 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.665+0000 7f7ec6533700 1 -- 172.21.15.117:0/3479697523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ec00b2b80 msgr2=0x7f7ec00afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.662 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.665+0000 7f7ec6533700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ec00b2b80 0x7f7ec00afbd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0046d0 tx=0x7f7eb8001360 comp rx=0 tx=0).stop 2023-07-19T20:44:47.662 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.665+0000 7f7ec6533700 1 -- 172.21.15.117:0/3479697523 shutdown_connections 2023-07-19T20:44:47.662 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.665+0000 7f7ec6533700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7ea006a660 0x7f7ea006cb10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.662 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.665+0000 7f7ec6533700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ec00b2b80 0x7f7ec00afbd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.662 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.665+0000 7f7ec6533700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ec00b1940 0x7f7ec00b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.662 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.665+0000 7f7ec6533700 1 --2- 172.21.15.117:0/3479697523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ec00b7a10 0x7f7ec00b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.663 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.665+0000 7f7ec6533700 1 -- 172.21.15.117:0/3479697523 >> 172.21.15.117:0/3479697523 conn(0x7f7ec00bd8b0 msgr2=0x7f7ec00bd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:47.663 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.665+0000 7f7ec6533700 1 -- 172.21.15.117:0/3479697523 shutdown_connections 2023-07-19T20:44:47.663 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.665+0000 7f7ec6533700 1 -- 172.21.15.117:0/3479697523 wait complete. 2023-07-19T20:44:47.663 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2023-07-19T20:44:47.673 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-07-19T20:44:45.686970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218592,"kb_used_data":2976,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756128,"statfs":{"total":773094113280,"available":772870275072,"internally_reserved":0,"allocated":3047424,"data_stored":1840914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.547390"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557519+0000","last_change":"2023-07-19T20:44:38.557553+0000","last_active":"2023-07-19T20:44:39.557519+0000","last_peered":"2023-07-19T20:44:39.557519+0000","last_clean":"2023-07-19T20:44:39.557519+0000","last_became_active":"2023-07-19T20:44:38.557300+0000","last_became_peered":"2023-07-19T20:44:38.557300+0000","last_unstale":"2023-07-19T20:44:39.557519+0000","last_undegraded":"2023-07-19T20:44:39.557519+0000","last_fullsized":"2023-07-19T20:44:39.557519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:51:24.459453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967118+0000","last_change":"2023-07-19T20:44:38.568068+0000","last_active":"2023-07-19T20:44:39.967118+0000","last_peered":"2023-07-19T20:44:39.967118+0000","last_clean":"2023-07-19T20:44:39.967118+0000","last_became_active":"2023-07-19T20:44:38.567801+0000","last_became_peered":"2023-07-19T20:44:38.567801+0000","last_unstale":"2023-07-19T20:44:39.967118+0000","last_undegraded":"2023-07-19T20:44:39.967118+0000","last_fullsized":"2023-07-19T20:44:39.967118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:54:57.194368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966678+0000","last_change":"2023-07-19T20:44:38.570481+0000","last_active":"2023-07-19T20:44:39.966678+0000","last_peered":"2023-07-19T20:44:39.966678+0000","last_clean":"2023-07-19T20:44:39.966678+0000","last_became_active":"2023-07-19T20:44:38.570229+0000","last_became_peered":"2023-07-19T20:44:38.570229+0000","last_unstale":"2023-07-19T20:44:39.966678+0000","last_undegraded":"2023-07-19T20:44:39.966678+0000","last_fullsized":"2023-07-19T20:44:39.966678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:14:05.967200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557053+0000","last_change":"2023-07-19T20:44:38.570166+0000","last_active":"2023-07-19T20:44:39.557053+0000","last_peered":"2023-07-19T20:44:39.557053+0000","last_clean":"2023-07-19T20:44:39.557053+0000","last_became_active":"2023-07-19T20:44:38.569877+0000","last_became_peered":"2023-07-19T20:44:38.569877+0000","last_unstale":"2023-07-19T20:44:39.557053+0000","last_undegraded":"2023-07-19T20:44:39.557053+0000","last_fullsized":"2023-07-19T20:44:39.557053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:50:18.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965691+0000","last_change":"2023-07-19T20:44:38.571798+0000","last_active":"2023-07-19T20:44:39.965691+0000","last_peered":"2023-07-19T20:44:39.965691+0000","last_clean":"2023-07-19T20:44:39.965691+0000","last_became_active":"2023-07-19T20:44:38.571402+0000","last_became_peered":"2023-07-19T20:44:38.571402+0000","last_unstale":"2023-07-19T20:44:39.965691+0000","last_undegraded":"2023-07-19T20:44:39.965691+0000","last_fullsized":"2023-07-19T20:44:39.965691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:15:18.131376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965752+0000","last_change":"2023-07-19T20:44:38.572155+0000","last_active":"2023-07-19T20:44:39.965752+0000","last_peered":"2023-07-19T20:44:39.965752+0000","last_clean":"2023-07-19T20:44:39.965752+0000","last_became_active":"2023-07-19T20:44:38.571889+0000","last_became_peered":"2023-07-19T20:44:38.571889+0000","last_unstale":"2023-07-19T20:44:39.965752+0000","last_undegraded":"2023-07-19T20:44:39.965752+0000","last_fullsized":"2023-07-19T20:44:39.965752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:05:47.118546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965842+0000","last_change":"2023-07-19T20:44:38.583148+0000","last_active":"2023-07-19T20:44:39.965842+0000","last_peered":"2023-07-19T20:44:39.965842+0000","last_clean":"2023-07-19T20:44:39.965842+0000","last_became_active":"2023-07-19T20:44:38.582674+0000","last_became_peered":"2023-07-19T20:44:38.582674+0000","last_unstale":"2023-07-19T20:44:39.965842+0000","last_undegraded":"2023-07-19T20:44:39.965842+0000","last_fullsized":"2023-07-19T20:44:39.965842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966760+0000","last_change":"2023-07-19T20:44:38.563551+0000","last_active":"2023-07-19T20:44:39.966760+0000","last_peered":"2023-07-19T20:44:39.966760+0000","last_clean":"2023-07-19T20:44:39.966760+0000","last_became_active":"2023-07-19T20:44:38.563241+0000","last_became_peered":"2023-07-19T20:44:38.563241+0000","last_unstale":"2023-07-19T20:44:39.966760+0000","last_undegraded":"2023-07-19T20:44:39.966760+0000","last_fullsized":"2023-07-19T20:44:39.966760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:41:57.896806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965333+0000","last_change":"2023-07-19T20:44:38.568101+0000","last_active":"2023-07-19T20:44:39.965333+0000","last_peered":"2023-07-19T20:44:39.965333+0000","last_clean":"2023-07-19T20:44:39.965333+0000","last_became_active":"2023-07-19T20:44:38.567841+0000","last_became_peered":"2023-07-19T20:44:38.567841+0000","last_unstale":"2023-07-19T20:44:39.965333+0000","last_undegraded":"2023-07-19T20:44:39.965333+0000","last_fullsized":"2023-07-19T20:44:39.965333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:47:51.985998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967220+0000","last_change":"2023-07-19T20:44:38.573636+0000","last_active":"2023-07-19T20:44:39.967220+0000","last_peered":"2023-07-19T20:44:39.967220+0000","last_clean":"2023-07-19T20:44:39.967220+0000","last_became_active":"2023-07-19T20:44:38.572946+0000","last_became_peered":"2023-07-19T20:44:38.572946+0000","last_unstale":"2023-07-19T20:44:39.967220+0000","last_undegraded":"2023-07-19T20:44:39.967220+0000","last_fullsized":"2023-07-19T20:44:39.967220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:44:21.312824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966695+0000","last_change":"2023-07-19T20:44:38.569267+0000","last_active":"2023-07-19T20:44:39.966695+0000","last_peered":"2023-07-19T20:44:39.966695+0000","last_clean":"2023-07-19T20:44:39.966695+0000","last_became_active":"2023-07-19T20:44:38.568642+0000","last_became_peered":"2023-07-19T20:44:38.568642+0000","last_unstale":"2023-07-19T20:44:39.966695+0000","last_undegraded":"2023-07-19T20:44:39.966695+0000","last_fullsized":"2023-07-19T20:44:39.966695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:05:25.043607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557296+0000","last_change":"2023-07-19T20:44:38.563272+0000","last_active":"2023-07-19T20:44:39.557296+0000","last_peered":"2023-07-19T20:44:39.557296+0000","last_clean":"2023-07-19T20:44:39.557296+0000","last_became_active":"2023-07-19T20:44:38.562986+0000","last_became_peered":"2023-07-19T20:44:38.562986+0000","last_unstale":"2023-07-19T20:44:39.557296+0000","last_undegraded":"2023-07-19T20:44:39.557296+0000","last_fullsized":"2023-07-19T20:44:39.557296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:10:44.096418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557003+0000","last_change":"2023-07-19T20:44:38.558158+0000","last_active":"2023-07-19T20:44:39.557003+0000","last_peered":"2023-07-19T20:44:39.557003+0000","last_clean":"2023-07-19T20:44:39.557003+0000","last_became_active":"2023-07-19T20:44:38.557930+0000","last_became_peered":"2023-07-19T20:44:38.557930+0000","last_unstale":"2023-07-19T20:44:39.557003+0000","last_undegraded":"2023-07-19T20:44:39.557003+0000","last_fullsized":"2023-07-19T20:44:39.557003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:29:27.698047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967203+0000","last_change":"2023-07-19T20:44:38.561137+0000","last_active":"2023-07-19T20:44:39.967203+0000","last_peered":"2023-07-19T20:44:39.967203+0000","last_clean":"2023-07-19T20:44:39.967203+0000","last_became_active":"2023-07-19T20:44:38.560853+0000","last_became_peered":"2023-07-19T20:44:38.560853+0000","last_unstale":"2023-07-19T20:44:39.967203+0000","last_undegraded":"2023-07-19T20:44:39.967203+0000","last_fullsized":"2023-07-19T20:44:39.967203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:01:57.502720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965944+0000","last_change":"2023-07-19T20:44:38.583262+0000","last_active":"2023-07-19T20:44:39.965944+0000","last_peered":"2023-07-19T20:44:39.965944+0000","last_clean":"2023-07-19T20:44:39.965944+0000","last_became_active":"2023-07-19T20:44:38.582950+0000","last_became_peered":"2023-07-19T20:44:38.582950+0000","last_unstale":"2023-07-19T20:44:39.965944+0000","last_undegraded":"2023-07-19T20:44:39.965944+0000","last_fullsized":"2023-07-19T20:44:39.965944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:47:20.937341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965794+0000","last_change":"2023-07-19T20:44:38.572479+0000","last_active":"2023-07-19T20:44:39.965794+0000","last_peered":"2023-07-19T20:44:39.965794+0000","last_clean":"2023-07-19T20:44:39.965794+0000","last_became_active":"2023-07-19T20:44:38.572213+0000","last_became_peered":"2023-07-19T20:44:38.572213+0000","last_unstale":"2023-07-19T20:44:39.965794+0000","last_undegraded":"2023-07-19T20:44:39.965794+0000","last_fullsized":"2023-07-19T20:44:39.965794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:21:54.976852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965428+0000","last_change":"2023-07-19T20:44:38.568103+0000","last_active":"2023-07-19T20:44:39.965428+0000","last_peered":"2023-07-19T20:44:39.965428+0000","last_clean":"2023-07-19T20:44:39.965428+0000","last_became_active":"2023-07-19T20:44:38.567824+0000","last_became_peered":"2023-07-19T20:44:38.567824+0000","last_unstale":"2023-07-19T20:44:39.965428+0000","last_undegraded":"2023-07-19T20:44:39.965428+0000","last_fullsized":"2023-07-19T20:44:39.965428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:45:53.848298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966933+0000","last_change":"2023-07-19T20:44:38.567578+0000","last_active":"2023-07-19T20:44:39.966933+0000","last_peered":"2023-07-19T20:44:39.966933+0000","last_clean":"2023-07-19T20:44:39.966933+0000","last_became_active":"2023-07-19T20:44:38.567290+0000","last_became_peered":"2023-07-19T20:44:38.567290+0000","last_unstale":"2023-07-19T20:44:39.966933+0000","last_undegraded":"2023-07-19T20:44:39.966933+0000","last_fullsized":"2023-07-19T20:44:39.966933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:58:55.531091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557561+0000","last_change":"2023-07-19T20:44:38.572691+0000","last_active":"2023-07-19T20:44:39.557561+0000","last_peered":"2023-07-19T20:44:39.557561+0000","last_clean":"2023-07-19T20:44:39.557561+0000","last_became_active":"2023-07-19T20:44:38.572438+0000","last_became_peered":"2023-07-19T20:44:38.572438+0000","last_unstale":"2023-07-19T20:44:39.557561+0000","last_undegraded":"2023-07-19T20:44:39.557561+0000","last_fullsized":"2023-07-19T20:44:39.557561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:40:43.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966413+0000","last_change":"2023-07-19T20:44:38.567705+0000","last_active":"2023-07-19T20:44:39.966413+0000","last_peered":"2023-07-19T20:44:39.966413+0000","last_clean":"2023-07-19T20:44:39.966413+0000","last_became_active":"2023-07-19T20:44:38.567230+0000","last_became_peered":"2023-07-19T20:44:38.567230+0000","last_unstale":"2023-07-19T20:44:39.966413+0000","last_undegraded":"2023-07-19T20:44:39.966413+0000","last_fullsized":"2023-07-19T20:44:39.966413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:16:57.118793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966275+0000","last_change":"2023-07-19T20:44:38.583001+0000","last_active":"2023-07-19T20:44:39.966275+0000","last_peered":"2023-07-19T20:44:39.966275+0000","last_clean":"2023-07-19T20:44:39.966275+0000","last_became_active":"2023-07-19T20:44:38.582767+0000","last_became_peered":"2023-07-19T20:44:38.582767+0000","last_unstale":"2023-07-19T20:44:39.966275+0000","last_undegraded":"2023-07-19T20:44:39.966275+0000","last_fullsized":"2023-07-19T20:44:39.966275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:30:42.451874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965394+0000","last_change":"2023-07-19T20:44:38.571958+0000","last_active":"2023-07-19T20:44:39.965394+0000","last_peered":"2023-07-19T20:44:39.965394+0000","last_clean":"2023-07-19T20:44:39.965394+0000","last_became_active":"2023-07-19T20:44:38.571485+0000","last_became_peered":"2023-07-19T20:44:38.571485+0000","last_unstale":"2023-07-19T20:44:39.965394+0000","last_undegraded":"2023-07-19T20:44:39.965394+0000","last_fullsized":"2023-07-19T20:44:39.965394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965238+0000","last_change":"2023-07-19T20:44:38.566759+0000","last_active":"2023-07-19T20:44:39.965238+0000","last_peered":"2023-07-19T20:44:39.965238+0000","last_clean":"2023-07-19T20:44:39.965238+0000","last_became_active":"2023-07-19T20:44:38.566496+0000","last_became_peered":"2023-07-19T20:44:38.566496+0000","last_unstale":"2023-07-19T20:44:39.965238+0000","last_undegraded":"2023-07-19T20:44:39.965238+0000","last_fullsized":"2023-07-19T20:44:39.965238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:40:30.028440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966363+0000","last_change":"2023-07-19T20:44:38.582748+0000","last_active":"2023-07-19T20:44:39.966363+0000","last_peered":"2023-07-19T20:44:39.966363+0000","last_clean":"2023-07-19T20:44:39.966363+0000","last_became_active":"2023-07-19T20:44:38.582492+0000","last_became_peered":"2023-07-19T20:44:38.582492+0000","last_unstale":"2023-07-19T20:44:39.966363+0000","last_undegraded":"2023-07-19T20:44:39.966363+0000","last_fullsized":"2023-07-19T20:44:39.966363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556709+0000","last_change":"2023-07-19T20:44:38.573862+0000","last_active":"2023-07-19T20:44:39.556709+0000","last_peered":"2023-07-19T20:44:39.556709+0000","last_clean":"2023-07-19T20:44:39.556709+0000","last_became_active":"2023-07-19T20:44:38.573438+0000","last_became_peered":"2023-07-19T20:44:38.573438+0000","last_unstale":"2023-07-19T20:44:39.556709+0000","last_undegraded":"2023-07-19T20:44:39.556709+0000","last_fullsized":"2023-07-19T20:44:39.556709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:48:50.207451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556599+0000","last_change":"2023-07-19T20:44:38.573890+0000","last_active":"2023-07-19T20:44:39.556599+0000","last_peered":"2023-07-19T20:44:39.556599+0000","last_clean":"2023-07-19T20:44:39.556599+0000","last_became_active":"2023-07-19T20:44:38.573657+0000","last_became_peered":"2023-07-19T20:44:38.573657+0000","last_unstale":"2023-07-19T20:44:39.556599+0000","last_undegraded":"2023-07-19T20:44:39.556599+0000","last_fullsized":"2023-07-19T20:44:39.556599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:50:18.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967285+0000","last_change":"2023-07-19T20:44:38.578334+0000","last_active":"2023-07-19T20:44:39.967285+0000","last_peered":"2023-07-19T20:44:39.967285+0000","last_clean":"2023-07-19T20:44:39.967285+0000","last_became_active":"2023-07-19T20:44:38.578066+0000","last_became_peered":"2023-07-19T20:44:38.578066+0000","last_unstale":"2023-07-19T20:44:39.967285+0000","last_undegraded":"2023-07-19T20:44:39.967285+0000","last_fullsized":"2023-07-19T20:44:39.967285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965878+0000","last_change":"2023-07-19T20:44:38.150761+0000","last_active":"2023-07-19T20:44:39.965878+0000","last_peered":"2023-07-19T20:44:39.965878+0000","last_clean":"2023-07-19T20:44:39.965878+0000","last_became_active":"2023-07-19T20:44:38.150480+0000","last_became_peered":"2023-07-19T20:44:38.150480+0000","last_unstale":"2023-07-19T20:44:39.965878+0000","last_undegraded":"2023-07-19T20:44:39.965878+0000","last_fullsized":"2023-07-19T20:44:39.965878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:29:26.692730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965845+0000","last_change":"2023-07-19T20:44:38.573757+0000","last_active":"2023-07-19T20:44:39.965845+0000","last_peered":"2023-07-19T20:44:39.965845+0000","last_clean":"2023-07-19T20:44:39.965845+0000","last_became_active":"2023-07-19T20:44:38.573579+0000","last_became_peered":"2023-07-19T20:44:38.573579+0000","last_unstale":"2023-07-19T20:44:39.965845+0000","last_undegraded":"2023-07-19T20:44:39.965845+0000","last_fullsized":"2023-07-19T20:44:39.965845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:45:53.848298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556369+0000","last_change":"2023-07-19T20:44:38.163117+0000","last_active":"2023-07-19T20:44:39.556369+0000","last_peered":"2023-07-19T20:44:39.556369+0000","last_clean":"2023-07-19T20:44:39.556369+0000","last_became_active":"2023-07-19T20:44:38.162834+0000","last_became_peered":"2023-07-19T20:44:38.162834+0000","last_unstale":"2023-07-19T20:44:39.556369+0000","last_undegraded":"2023-07-19T20:44:39.556369+0000","last_fullsized":"2023-07-19T20:44:39.556369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:40:42.266562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965931+0000","last_change":"2023-07-19T20:44:38.582906+0000","last_active":"2023-07-19T20:44:39.965931+0000","last_peered":"2023-07-19T20:44:39.965931+0000","last_clean":"2023-07-19T20:44:39.965931+0000","last_became_active":"2023-07-19T20:44:38.582633+0000","last_became_peered":"2023-07-19T20:44:38.582633+0000","last_unstale":"2023-07-19T20:44:39.965931+0000","last_undegraded":"2023-07-19T20:44:39.965931+0000","last_fullsized":"2023-07-19T20:44:39.965931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:07:43.608434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965284+0000","last_change":"2023-07-19T20:44:38.162257+0000","last_active":"2023-07-19T20:44:39.965284+0000","last_peered":"2023-07-19T20:44:39.965284+0000","last_clean":"2023-07-19T20:44:39.965284+0000","last_became_active":"2023-07-19T20:44:38.161974+0000","last_became_peered":"2023-07-19T20:44:38.161974+0000","last_unstale":"2023-07-19T20:44:39.965284+0000","last_undegraded":"2023-07-19T20:44:39.965284+0000","last_fullsized":"2023-07-19T20:44:39.965284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:27:00.609956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557276+0000","last_change":"2023-07-19T20:44:38.570736+0000","last_active":"2023-07-19T20:44:39.557276+0000","last_peered":"2023-07-19T20:44:39.557276+0000","last_clean":"2023-07-19T20:44:39.557276+0000","last_became_active":"2023-07-19T20:44:38.570456+0000","last_became_peered":"2023-07-19T20:44:38.570456+0000","last_unstale":"2023-07-19T20:44:39.557276+0000","last_undegraded":"2023-07-19T20:44:39.557276+0000","last_fullsized":"2023-07-19T20:44:39.557276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:47:25.794801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965516+0000","last_change":"2023-07-19T20:44:38.156406+0000","last_active":"2023-07-19T20:44:39.965516+0000","last_peered":"2023-07-19T20:44:39.965516+0000","last_clean":"2023-07-19T20:44:39.965516+0000","last_became_active":"2023-07-19T20:44:38.156105+0000","last_became_peered":"2023-07-19T20:44:38.156105+0000","last_unstale":"2023-07-19T20:44:39.965516+0000","last_undegraded":"2023-07-19T20:44:39.965516+0000","last_fullsized":"2023-07-19T20:44:39.965516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:27:00.609956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965254+0000","last_change":"2023-07-19T20:44:38.566993+0000","last_active":"2023-07-19T20:44:39.965254+0000","last_peered":"2023-07-19T20:44:39.965254+0000","last_clean":"2023-07-19T20:44:39.965254+0000","last_became_active":"2023-07-19T20:44:38.566840+0000","last_became_peered":"2023-07-19T20:44:38.566840+0000","last_unstale":"2023-07-19T20:44:39.965254+0000","last_undegraded":"2023-07-19T20:44:39.965254+0000","last_fullsized":"2023-07-19T20:44:39.965254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:47:51.985998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967138+0000","last_change":"2023-07-19T20:44:38.158430+0000","last_active":"2023-07-19T20:44:39.967138+0000","last_peered":"2023-07-19T20:44:39.967138+0000","last_clean":"2023-07-19T20:44:39.967138+0000","last_became_active":"2023-07-19T20:44:38.158144+0000","last_became_peered":"2023-07-19T20:44:38.158144+0000","last_unstale":"2023-07-19T20:44:39.967138+0000","last_undegraded":"2023-07-19T20:44:39.967138+0000","last_fullsized":"2023-07-19T20:44:39.967138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:27:00.609956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965414+0000","last_change":"2023-07-19T20:44:38.578647+0000","last_active":"2023-07-19T20:44:39.965414+0000","last_peered":"2023-07-19T20:44:39.965414+0000","last_clean":"2023-07-19T20:44:39.965414+0000","last_became_active":"2023-07-19T20:44:38.578203+0000","last_became_peered":"2023-07-19T20:44:38.578203+0000","last_unstale":"2023-07-19T20:44:39.965414+0000","last_undegraded":"2023-07-19T20:44:39.965414+0000","last_fullsized":"2023-07-19T20:44:39.965414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:15:18.131376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966763+0000","last_change":"2023-07-19T20:44:38.162400+0000","last_active":"2023-07-19T20:44:39.966763+0000","last_peered":"2023-07-19T20:44:39.966763+0000","last_clean":"2023-07-19T20:44:39.966763+0000","last_became_active":"2023-07-19T20:44:38.161909+0000","last_became_peered":"2023-07-19T20:44:38.161909+0000","last_unstale":"2023-07-19T20:44:39.966763+0000","last_undegraded":"2023-07-19T20:44:39.966763+0000","last_fullsized":"2023-07-19T20:44:39.966763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:06:03.165653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556326+0000","last_change":"2023-07-19T20:44:38.576965+0000","last_active":"2023-07-19T20:44:39.556326+0000","last_peered":"2023-07-19T20:44:39.556326+0000","last_clean":"2023-07-19T20:44:39.556326+0000","last_became_active":"2023-07-19T20:44:38.574467+0000","last_became_peered":"2023-07-19T20:44:38.574467+0000","last_unstale":"2023-07-19T20:44:39.556326+0000","last_undegraded":"2023-07-19T20:44:39.556326+0000","last_fullsized":"2023-07-19T20:44:39.556326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:29:14.941818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966551+0000","last_change":"2023-07-19T20:44:38.159725+0000","last_active":"2023-07-19T20:44:39.966551+0000","last_peered":"2023-07-19T20:44:39.966551+0000","last_clean":"2023-07-19T20:44:39.966551+0000","last_became_active":"2023-07-19T20:44:38.159461+0000","last_became_peered":"2023-07-19T20:44:38.159461+0000","last_unstale":"2023-07-19T20:44:39.966551+0000","last_undegraded":"2023-07-19T20:44:39.966551+0000","last_fullsized":"2023-07-19T20:44:39.966551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:10:43.091101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966298+0000","last_change":"2023-07-19T20:44:38.570213+0000","last_active":"2023-07-19T20:44:39.966298+0000","last_peered":"2023-07-19T20:44:39.966298+0000","last_clean":"2023-07-19T20:44:39.966298+0000","last_became_active":"2023-07-19T20:44:38.567536+0000","last_became_peered":"2023-07-19T20:44:38.567536+0000","last_unstale":"2023-07-19T20:44:39.966298+0000","last_undegraded":"2023-07-19T20:44:39.966298+0000","last_fullsized":"2023-07-19T20:44:39.966298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:43:36.018520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966166+0000","last_change":"2023-07-19T20:44:38.161200+0000","last_active":"2023-07-19T20:44:39.966166+0000","last_peered":"2023-07-19T20:44:39.966166+0000","last_clean":"2023-07-19T20:44:39.966166+0000","last_became_active":"2023-07-19T20:44:38.160914+0000","last_became_peered":"2023-07-19T20:44:38.160914+0000","last_unstale":"2023-07-19T20:44:39.966166+0000","last_undegraded":"2023-07-19T20:44:39.966166+0000","last_fullsized":"2023-07-19T20:44:39.966166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:22:47.753831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965319+0000","last_change":"2023-07-19T20:44:38.573870+0000","last_active":"2023-07-19T20:44:39.965319+0000","last_peered":"2023-07-19T20:44:39.965319+0000","last_clean":"2023-07-19T20:44:39.965319+0000","last_became_active":"2023-07-19T20:44:38.573603+0000","last_became_peered":"2023-07-19T20:44:38.573603+0000","last_unstale":"2023-07-19T20:44:39.965319+0000","last_undegraded":"2023-07-19T20:44:39.965319+0000","last_fullsized":"2023-07-19T20:44:39.965319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:07:43.608434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965884+0000","last_change":"2023-07-19T20:44:38.158352+0000","last_active":"2023-07-19T20:44:39.965884+0000","last_peered":"2023-07-19T20:44:39.965884+0000","last_clean":"2023-07-19T20:44:39.965884+0000","last_became_active":"2023-07-19T20:44:38.158108+0000","last_became_peered":"2023-07-19T20:44:38.158108+0000","last_unstale":"2023-07-19T20:44:39.965884+0000","last_undegraded":"2023-07-19T20:44:39.965884+0000","last_fullsized":"2023-07-19T20:44:39.965884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:56:20.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967338+0000","last_change":"2023-07-19T20:44:38.578475+0000","last_active":"2023-07-19T20:44:39.967338+0000","last_peered":"2023-07-19T20:44:39.967338+0000","last_clean":"2023-07-19T20:44:39.967338+0000","last_became_active":"2023-07-19T20:44:38.578148+0000","last_became_peered":"2023-07-19T20:44:38.578148+0000","last_unstale":"2023-07-19T20:44:39.967338+0000","last_undegraded":"2023-07-19T20:44:39.967338+0000","last_fullsized":"2023-07-19T20:44:39.967338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:47:20.937341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966031+0000","last_change":"2023-07-19T20:44:38.161146+0000","last_active":"2023-07-19T20:44:39.966031+0000","last_peered":"2023-07-19T20:44:39.966031+0000","last_clean":"2023-07-19T20:44:39.966031+0000","last_became_active":"2023-07-19T20:44:38.160826+0000","last_became_peered":"2023-07-19T20:44:38.160826+0000","last_unstale":"2023-07-19T20:44:39.966031+0000","last_undegraded":"2023-07-19T20:44:39.966031+0000","last_fullsized":"2023-07-19T20:44:39.966031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:00:17.913421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965696+0000","last_change":"2023-07-19T20:44:38.575529+0000","last_active":"2023-07-19T20:44:39.965696+0000","last_peered":"2023-07-19T20:44:39.965696+0000","last_clean":"2023-07-19T20:44:39.965696+0000","last_became_active":"2023-07-19T20:44:38.571437+0000","last_became_peered":"2023-07-19T20:44:38.571437+0000","last_unstale":"2023-07-19T20:44:39.965696+0000","last_undegraded":"2023-07-19T20:44:39.965696+0000","last_fullsized":"2023-07-19T20:44:39.965696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:31:08.854923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556868+0000","last_change":"2023-07-19T20:44:38.151428+0000","last_active":"2023-07-19T20:44:39.556868+0000","last_peered":"2023-07-19T20:44:39.556868+0000","last_clean":"2023-07-19T20:44:39.556868+0000","last_became_active":"2023-07-19T20:44:38.150814+0000","last_became_peered":"2023-07-19T20:44:38.150814+0000","last_unstale":"2023-07-19T20:44:39.556868+0000","last_undegraded":"2023-07-19T20:44:39.556868+0000","last_fullsized":"2023-07-19T20:44:39.556868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:43:49.400337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966925+0000","last_change":"2023-07-19T20:44:38.578498+0000","last_active":"2023-07-19T20:44:39.966925+0000","last_peered":"2023-07-19T20:44:39.966925+0000","last_clean":"2023-07-19T20:44:39.966925+0000","last_became_active":"2023-07-19T20:44:38.578229+0000","last_became_peered":"2023-07-19T20:44:38.578229+0000","last_unstale":"2023-07-19T20:44:39.966925+0000","last_undegraded":"2023-07-19T20:44:39.966925+0000","last_fullsized":"2023-07-19T20:44:39.966925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965996+0000","last_change":"2023-07-19T20:44:38.162523+0000","last_active":"2023-07-19T20:44:39.965996+0000","last_peered":"2023-07-19T20:44:39.965996+0000","last_clean":"2023-07-19T20:44:39.965996+0000","last_became_active":"2023-07-19T20:44:38.162180+0000","last_became_peered":"2023-07-19T20:44:38.162180+0000","last_unstale":"2023-07-19T20:44:39.965996+0000","last_undegraded":"2023-07-19T20:44:39.965996+0000","last_fullsized":"2023-07-19T20:44:39.965996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:51:41.425413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966943+0000","last_change":"2023-07-19T20:44:38.578374+0000","last_active":"2023-07-19T20:44:39.966943+0000","last_peered":"2023-07-19T20:44:39.966943+0000","last_clean":"2023-07-19T20:44:39.966943+0000","last_became_active":"2023-07-19T20:44:38.578063+0000","last_became_peered":"2023-07-19T20:44:38.578063+0000","last_unstale":"2023-07-19T20:44:39.966943+0000","last_undegraded":"2023-07-19T20:44:39.966943+0000","last_fullsized":"2023-07-19T20:44:39.966943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966034+0000","last_change":"2023-07-19T20:44:38.161133+0000","last_active":"2023-07-19T20:44:39.966034+0000","last_peered":"2023-07-19T20:44:39.966034+0000","last_clean":"2023-07-19T20:44:39.966034+0000","last_became_active":"2023-07-19T20:44:38.160858+0000","last_became_peered":"2023-07-19T20:44:38.160858+0000","last_unstale":"2023-07-19T20:44:39.966034+0000","last_undegraded":"2023-07-19T20:44:39.966034+0000","last_fullsized":"2023-07-19T20:44:39.966034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966513+0000","last_change":"2023-07-19T20:44:38.569109+0000","last_active":"2023-07-19T20:44:39.966513+0000","last_peered":"2023-07-19T20:44:39.966513+0000","last_clean":"2023-07-19T20:44:39.966513+0000","last_became_active":"2023-07-19T20:44:38.568655+0000","last_became_peered":"2023-07-19T20:44:38.568655+0000","last_unstale":"2023-07-19T20:44:39.966513+0000","last_undegraded":"2023-07-19T20:44:39.966513+0000","last_fullsized":"2023-07-19T20:44:39.966513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:22:21.797390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966727+0000","last_change":"2023-07-19T20:44:38.159979+0000","last_active":"2023-07-19T20:44:39.966727+0000","last_peered":"2023-07-19T20:44:39.966727+0000","last_clean":"2023-07-19T20:44:39.966727+0000","last_became_active":"2023-07-19T20:44:38.159724+0000","last_became_peered":"2023-07-19T20:44:38.159724+0000","last_unstale":"2023-07-19T20:44:39.966727+0000","last_undegraded":"2023-07-19T20:44:39.966727+0000","last_fullsized":"2023-07-19T20:44:39.966727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:13:29.703932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557319+0000","last_change":"2023-07-19T20:44:38.573821+0000","last_active":"2023-07-19T20:44:39.557319+0000","last_peered":"2023-07-19T20:44:39.557319+0000","last_clean":"2023-07-19T20:44:39.557319+0000","last_became_active":"2023-07-19T20:44:38.573531+0000","last_became_peered":"2023-07-19T20:44:38.573531+0000","last_unstale":"2023-07-19T20:44:39.557319+0000","last_undegraded":"2023-07-19T20:44:39.557319+0000","last_fullsized":"2023-07-19T20:44:39.557319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:12:57.038089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967186+0000","last_change":"2023-07-19T20:44:38.161247+0000","last_active":"2023-07-19T20:44:39.967186+0000","last_peered":"2023-07-19T20:44:39.967186+0000","last_clean":"2023-07-19T20:44:39.967186+0000","last_became_active":"2023-07-19T20:44:38.160983+0000","last_became_peered":"2023-07-19T20:44:38.160983+0000","last_unstale":"2023-07-19T20:44:39.967186+0000","last_undegraded":"2023-07-19T20:44:39.967186+0000","last_fullsized":"2023-07-19T20:44:39.967186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:48:53.708405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965596+0000","last_change":"2023-07-19T20:44:38.570267+0000","last_active":"2023-07-19T20:44:39.965596+0000","last_peered":"2023-07-19T20:44:39.965596+0000","last_clean":"2023-07-19T20:44:39.965596+0000","last_became_active":"2023-07-19T20:44:38.569970+0000","last_became_peered":"2023-07-19T20:44:38.569970+0000","last_unstale":"2023-07-19T20:44:39.965596+0000","last_undegraded":"2023-07-19T20:44:39.965596+0000","last_fullsized":"2023-07-19T20:44:39.965596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:19:06.136607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965824+0000","last_change":"2023-07-19T20:44:38.162813+0000","last_active":"2023-07-19T20:44:39.965824+0000","last_peered":"2023-07-19T20:44:39.965824+0000","last_clean":"2023-07-19T20:44:39.965824+0000","last_became_active":"2023-07-19T20:44:38.162512+0000","last_became_peered":"2023-07-19T20:44:38.162512+0000","last_unstale":"2023-07-19T20:44:39.965824+0000","last_undegraded":"2023-07-19T20:44:39.965824+0000","last_fullsized":"2023-07-19T20:44:39.965824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:56:20.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966572+0000","last_change":"2023-07-19T20:44:38.574677+0000","last_active":"2023-07-19T20:44:39.966572+0000","last_peered":"2023-07-19T20:44:39.966572+0000","last_clean":"2023-07-19T20:44:39.966572+0000","last_became_active":"2023-07-19T20:44:38.574384+0000","last_became_peered":"2023-07-19T20:44:38.574384+0000","last_unstale":"2023-07-19T20:44:39.966572+0000","last_undegraded":"2023-07-19T20:44:39.966572+0000","last_fullsized":"2023-07-19T20:44:39.966572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:56:39.985134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557050+0000","last_change":"2023-07-19T20:44:38.157897+0000","last_active":"2023-07-19T20:44:39.557050+0000","last_peered":"2023-07-19T20:44:39.557050+0000","last_clean":"2023-07-19T20:44:39.557050+0000","last_became_active":"2023-07-19T20:44:38.157613+0000","last_became_peered":"2023-07-19T20:44:38.157613+0000","last_unstale":"2023-07-19T20:44:39.557050+0000","last_undegraded":"2023-07-19T20:44:39.557050+0000","last_fullsized":"2023-07-19T20:44:39.557050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:10:43.091101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966876+0000","last_change":"2023-07-19T20:44:38.567166+0000","last_active":"2023-07-19T20:44:39.966876+0000","last_peered":"2023-07-19T20:44:39.966876+0000","last_clean":"2023-07-19T20:44:39.966876+0000","last_became_active":"2023-07-19T20:44:38.566539+0000","last_became_peered":"2023-07-19T20:44:38.566539+0000","last_unstale":"2023-07-19T20:44:39.966876+0000","last_undegraded":"2023-07-19T20:44:39.966876+0000","last_fullsized":"2023-07-19T20:44:39.966876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:57:34.828178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966584+0000","last_change":"2023-07-19T20:44:38.153301+0000","last_active":"2023-07-19T20:44:39.966584+0000","last_peered":"2023-07-19T20:44:39.966584+0000","last_clean":"2023-07-19T20:44:39.966584+0000","last_became_active":"2023-07-19T20:44:38.153036+0000","last_became_peered":"2023-07-19T20:44:38.153036+0000","last_unstale":"2023-07-19T20:44:39.966584+0000","last_undegraded":"2023-07-19T20:44:39.966584+0000","last_fullsized":"2023-07-19T20:44:39.966584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:29:36.129487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966373+0000","last_change":"2023-07-19T20:44:38.566702+0000","last_active":"2023-07-19T20:44:39.966373+0000","last_peered":"2023-07-19T20:44:39.966373+0000","last_clean":"2023-07-19T20:44:39.966373+0000","last_became_active":"2023-07-19T20:44:38.566298+0000","last_became_peered":"2023-07-19T20:44:38.566298+0000","last_unstale":"2023-07-19T20:44:39.966373+0000","last_undegraded":"2023-07-19T20:44:39.966373+0000","last_fullsized":"2023-07-19T20:44:39.966373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:40:21.960885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965195+0000","last_change":"2023-07-19T20:44:38.161123+0000","last_active":"2023-07-19T20:44:39.965195+0000","last_peered":"2023-07-19T20:44:39.965195+0000","last_clean":"2023-07-19T20:44:39.965195+0000","last_became_active":"2023-07-19T20:44:38.160828+0000","last_became_peered":"2023-07-19T20:44:38.160828+0000","last_unstale":"2023-07-19T20:44:39.965195+0000","last_undegraded":"2023-07-19T20:44:39.965195+0000","last_fullsized":"2023-07-19T20:44:39.965195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556893+0000","last_change":"2023-07-19T20:44:38.573695+0000","last_active":"2023-07-19T20:44:39.556893+0000","last_peered":"2023-07-19T20:44:39.556893+0000","last_clean":"2023-07-19T20:44:39.556893+0000","last_became_active":"2023-07-19T20:44:38.573109+0000","last_became_peered":"2023-07-19T20:44:38.573109+0000","last_unstale":"2023-07-19T20:44:39.556893+0000","last_undegraded":"2023-07-19T20:44:39.556893+0000","last_fullsized":"2023-07-19T20:44:39.556893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:10:27.373852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966776+0000","last_change":"2023-07-19T20:44:38.159710+0000","last_active":"2023-07-19T20:44:39.966776+0000","last_peered":"2023-07-19T20:44:39.966776+0000","last_clean":"2023-07-19T20:44:39.966776+0000","last_became_active":"2023-07-19T20:44:38.159491+0000","last_became_peered":"2023-07-19T20:44:38.159491+0000","last_unstale":"2023-07-19T20:44:39.966776+0000","last_undegraded":"2023-07-19T20:44:39.966776+0000","last_fullsized":"2023-07-19T20:44:39.966776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:48:53.708405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.556794+0000","last_change":"2023-07-19T20:44:33.123673+0000","last_active":"2023-07-19T20:44:38.556794+0000","last_peered":"2023-07-19T20:44:38.556794+0000","last_clean":"2023-07-19T20:44:38.556794+0000","last_became_active":"2023-07-19T20:44:33.123400+0000","last_became_peered":"2023-07-19T20:44:33.123400+0000","last_unstale":"2023-07-19T20:44:38.556794+0000","last_undegraded":"2023-07-19T20:44:38.556794+0000","last_fullsized":"2023-07-19T20:44:38.556794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:29:32.159769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965145+0000","last_change":"2023-07-19T20:44:38.578403+0000","last_active":"2023-07-19T20:44:39.965145+0000","last_peered":"2023-07-19T20:44:39.965145+0000","last_clean":"2023-07-19T20:44:39.965145+0000","last_became_active":"2023-07-19T20:44:38.578137+0000","last_became_peered":"2023-07-19T20:44:38.578137+0000","last_unstale":"2023-07-19T20:44:39.965145+0000","last_undegraded":"2023-07-19T20:44:39.965145+0000","last_fullsized":"2023-07-19T20:44:39.965145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:31:08.854923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.556588+0000","last_change":"2023-07-19T20:44:33.124105+0000","last_active":"2023-07-19T20:44:38.556588+0000","last_peered":"2023-07-19T20:44:38.556588+0000","last_clean":"2023-07-19T20:44:38.556588+0000","last_became_active":"2023-07-19T20:44:33.123795+0000","last_became_peered":"2023-07-19T20:44:33.123795+0000","last_unstale":"2023-07-19T20:44:38.556588+0000","last_undegraded":"2023-07-19T20:44:38.556588+0000","last_fullsized":"2023-07-19T20:44:38.556588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:14:19.759142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:40.744072+0000","last_change":"2023-07-19T20:44:38.153628+0000","last_active":"2023-07-19T20:44:40.744072+0000","last_peered":"2023-07-19T20:44:40.744072+0000","last_clean":"2023-07-19T20:44:40.744072+0000","last_became_active":"2023-07-19T20:44:38.153300+0000","last_became_peered":"2023-07-19T20:44:38.153300+0000","last_unstale":"2023-07-19T20:44:40.744072+0000","last_undegraded":"2023-07-19T20:44:40.744072+0000","last_fullsized":"2023-07-19T20:44:40.744072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966636+0000","last_change":"2023-07-19T20:44:38.565069+0000","last_active":"2023-07-19T20:44:39.966636+0000","last_peered":"2023-07-19T20:44:39.966636+0000","last_clean":"2023-07-19T20:44:39.966636+0000","last_became_active":"2023-07-19T20:44:38.564602+0000","last_became_peered":"2023-07-19T20:44:38.564602+0000","last_unstale":"2023-07-19T20:44:39.966636+0000","last_undegraded":"2023-07-19T20:44:39.966636+0000","last_fullsized":"2023-07-19T20:44:39.966636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:16:09.390291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.576773+0000","last_change":"2023-07-19T20:44:33.124619+0000","last_active":"2023-07-19T20:44:38.576773+0000","last_peered":"2023-07-19T20:44:38.576773+0000","last_clean":"2023-07-19T20:44:38.576773+0000","last_became_active":"2023-07-19T20:44:33.124278+0000","last_became_peered":"2023-07-19T20:44:33.124278+0000","last_unstale":"2023-07-19T20:44:38.576773+0000","last_undegraded":"2023-07-19T20:44:38.576773+0000","last_fullsized":"2023-07-19T20:44:38.576773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:57:12.956476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.570350+0000","last_change":"2023-07-19T20:44:33.129185+0000","last_active":"2023-07-19T20:44:38.570350+0000","last_peered":"2023-07-19T20:44:38.570350+0000","last_clean":"2023-07-19T20:44:38.570350+0000","last_became_active":"2023-07-19T20:44:33.128873+0000","last_became_peered":"2023-07-19T20:44:33.128873+0000","last_unstale":"2023-07-19T20:44:38.570350+0000","last_undegraded":"2023-07-19T20:44:38.570350+0000","last_fullsized":"2023-07-19T20:44:38.570350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:59:43.504158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965507+0000","last_change":"2023-07-19T20:44:38.157781+0000","last_active":"2023-07-19T20:44:39.965507+0000","last_peered":"2023-07-19T20:44:39.965507+0000","last_clean":"2023-07-19T20:44:39.965507+0000","last_became_active":"2023-07-19T20:44:38.157521+0000","last_became_peered":"2023-07-19T20:44:38.157521+0000","last_unstale":"2023-07-19T20:44:39.965507+0000","last_undegraded":"2023-07-19T20:44:39.965507+0000","last_fullsized":"2023-07-19T20:44:39.965507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:48:53.708405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965790+0000","last_change":"2023-07-19T20:44:38.569844+0000","last_active":"2023-07-19T20:44:39.965790+0000","last_peered":"2023-07-19T20:44:39.965790+0000","last_clean":"2023-07-19T20:44:39.965790+0000","last_became_active":"2023-07-19T20:44:38.569612+0000","last_became_peered":"2023-07-19T20:44:38.569612+0000","last_unstale":"2023-07-19T20:44:39.965790+0000","last_undegraded":"2023-07-19T20:44:39.965790+0000","last_fullsized":"2023-07-19T20:44:39.965790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:30:42.451874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.571549+0000","last_change":"2023-07-19T20:44:33.746155+0000","last_active":"2023-07-19T20:44:38.571549+0000","last_peered":"2023-07-19T20:44:38.571549+0000","last_clean":"2023-07-19T20:44:38.571549+0000","last_became_active":"2023-07-19T20:44:33.745839+0000","last_became_peered":"2023-07-19T20:44:33.745839+0000","last_unstale":"2023-07-19T20:44:38.571549+0000","last_undegraded":"2023-07-19T20:44:38.571549+0000","last_fullsized":"2023-07-19T20:44:38.571549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:27:53.622247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556163+0000","last_change":"2023-07-19T20:44:38.156539+0000","last_active":"2023-07-19T20:44:39.556163+0000","last_peered":"2023-07-19T20:44:39.556163+0000","last_clean":"2023-07-19T20:44:39.556163+0000","last_became_active":"2023-07-19T20:44:38.156248+0000","last_became_peered":"2023-07-19T20:44:38.156248+0000","last_unstale":"2023-07-19T20:44:39.556163+0000","last_undegraded":"2023-07-19T20:44:39.556163+0000","last_fullsized":"2023-07-19T20:44:39.556163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:27:24.261526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556806+0000","last_change":"2023-07-19T20:44:38.574341+0000","last_active":"2023-07-19T20:44:39.556806+0000","last_peered":"2023-07-19T20:44:39.556806+0000","last_clean":"2023-07-19T20:44:39.556806+0000","last_became_active":"2023-07-19T20:44:38.574094+0000","last_became_peered":"2023-07-19T20:44:38.574094+0000","last_unstale":"2023-07-19T20:44:39.556806+0000","last_undegraded":"2023-07-19T20:44:39.556806+0000","last_fullsized":"2023-07-19T20:44:39.556806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:47:25.794801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.569883+0000","last_change":"2023-07-19T20:44:33.746397+0000","last_active":"2023-07-19T20:44:38.569883+0000","last_peered":"2023-07-19T20:44:38.569883+0000","last_clean":"2023-07-19T20:44:38.569883+0000","last_became_active":"2023-07-19T20:44:33.746140+0000","last_became_peered":"2023-07-19T20:44:33.746140+0000","last_unstale":"2023-07-19T20:44:38.569883+0000","last_undegraded":"2023-07-19T20:44:38.569883+0000","last_fullsized":"2023-07-19T20:44:38.569883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:56:34.826030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965682+0000","last_change":"2023-07-19T20:44:38.155907+0000","last_active":"2023-07-19T20:44:39.965682+0000","last_peered":"2023-07-19T20:44:39.965682+0000","last_clean":"2023-07-19T20:44:39.965682+0000","last_became_active":"2023-07-19T20:44:38.155624+0000","last_became_peered":"2023-07-19T20:44:38.155624+0000","last_unstale":"2023-07-19T20:44:39.965682+0000","last_undegraded":"2023-07-19T20:44:39.965682+0000","last_fullsized":"2023-07-19T20:44:39.965682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:58:48.815316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557161+0000","last_change":"2023-07-19T20:44:38.564337+0000","last_active":"2023-07-19T20:44:39.557161+0000","last_peered":"2023-07-19T20:44:39.557161+0000","last_clean":"2023-07-19T20:44:39.557161+0000","last_became_active":"2023-07-19T20:44:38.563991+0000","last_became_peered":"2023-07-19T20:44:38.563991+0000","last_unstale":"2023-07-19T20:44:39.557161+0000","last_undegraded":"2023-07-19T20:44:39.557161+0000","last_fullsized":"2023-07-19T20:44:39.557161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:48:50.207451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.554572+0000","last_change":"2023-07-19T20:44:33.746552+0000","last_active":"2023-07-19T20:44:38.554572+0000","last_peered":"2023-07-19T20:44:38.554572+0000","last_clean":"2023-07-19T20:44:38.554572+0000","last_became_active":"2023-07-19T20:44:33.745934+0000","last_became_peered":"2023-07-19T20:44:33.745934+0000","last_unstale":"2023-07-19T20:44:38.554572+0000","last_undegraded":"2023-07-19T20:44:38.554572+0000","last_fullsized":"2023-07-19T20:44:38.554572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:19:16.931517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966394+0000","last_change":"2023-07-19T20:44:38.152599+0000","last_active":"2023-07-19T20:44:39.966394+0000","last_peered":"2023-07-19T20:44:39.966394+0000","last_clean":"2023-07-19T20:44:39.966394+0000","last_became_active":"2023-07-19T20:44:38.152331+0000","last_became_peered":"2023-07-19T20:44:38.152331+0000","last_unstale":"2023-07-19T20:44:39.966394+0000","last_undegraded":"2023-07-19T20:44:39.966394+0000","last_fullsized":"2023-07-19T20:44:39.966394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:43:49.400337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556867+0000","last_change":"2023-07-19T20:44:38.573279+0000","last_active":"2023-07-19T20:44:39.556867+0000","last_peered":"2023-07-19T20:44:39.556867+0000","last_clean":"2023-07-19T20:44:39.556867+0000","last_became_active":"2023-07-19T20:44:38.572918+0000","last_became_peered":"2023-07-19T20:44:38.572918+0000","last_unstale":"2023-07-19T20:44:39.556867+0000","last_undegraded":"2023-07-19T20:44:39.556867+0000","last_fullsized":"2023-07-19T20:44:39.556867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:12:57.038089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.560127+0000","last_change":"2023-07-19T20:44:33.746879+0000","last_active":"2023-07-19T20:44:38.560127+0000","last_peered":"2023-07-19T20:44:38.560127+0000","last_clean":"2023-07-19T20:44:38.560127+0000","last_became_active":"2023-07-19T20:44:33.746120+0000","last_became_peered":"2023-07-19T20:44:33.746120+0000","last_unstale":"2023-07-19T20:44:38.560127+0000","last_undegraded":"2023-07-19T20:44:38.560127+0000","last_fullsized":"2023-07-19T20:44:38.560127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:34:22.791863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556786+0000","last_change":"2023-07-19T20:44:38.157438+0000","last_active":"2023-07-19T20:44:39.556786+0000","last_peered":"2023-07-19T20:44:39.556786+0000","last_clean":"2023-07-19T20:44:39.556786+0000","last_became_active":"2023-07-19T20:44:38.157152+0000","last_became_peered":"2023-07-19T20:44:38.157152+0000","last_unstale":"2023-07-19T20:44:39.556786+0000","last_undegraded":"2023-07-19T20:44:39.556786+0000","last_fullsized":"2023-07-19T20:44:39.556786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:51:22.297960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965788+0000","last_change":"2023-07-19T20:44:38.570259+0000","last_active":"2023-07-19T20:44:39.965788+0000","last_peered":"2023-07-19T20:44:39.965788+0000","last_clean":"2023-07-19T20:44:39.965788+0000","last_became_active":"2023-07-19T20:44:38.569979+0000","last_became_peered":"2023-07-19T20:44:38.569979+0000","last_unstale":"2023-07-19T20:44:39.965788+0000","last_undegraded":"2023-07-19T20:44:39.965788+0000","last_fullsized":"2023-07-19T20:44:39.965788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:54:57.194368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-19T20:44:38.561428+0000","last_change":"2023-07-19T20:44:33.129202+0000","last_active":"2023-07-19T20:44:38.561428+0000","last_peered":"2023-07-19T20:44:38.561428+0000","last_clean":"2023-07-19T20:44:38.561428+0000","last_became_active":"2023-07-19T20:44:33.128920+0000","last_became_peered":"2023-07-19T20:44:33.128920+0000","last_unstale":"2023-07-19T20:44:38.561428+0000","last_undegraded":"2023-07-19T20:44:38.561428+0000","last_fullsized":"2023-07-19T20:44:38.561428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:43:18.861932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967383+0000","last_change":"2023-07-19T20:44:38.161925+0000","last_active":"2023-07-19T20:44:39.967383+0000","last_peered":"2023-07-19T20:44:39.967383+0000","last_clean":"2023-07-19T20:44:39.967383+0000","last_became_active":"2023-07-19T20:44:38.161648+0000","last_became_peered":"2023-07-19T20:44:38.161648+0000","last_unstale":"2023-07-19T20:44:39.967383+0000","last_undegraded":"2023-07-19T20:44:39.967383+0000","last_fullsized":"2023-07-19T20:44:39.967383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:03:08.671248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556470+0000","last_change":"2023-07-19T20:44:38.570962+0000","last_active":"2023-07-19T20:44:39.556470+0000","last_peered":"2023-07-19T20:44:39.556470+0000","last_clean":"2023-07-19T20:44:39.556470+0000","last_became_active":"2023-07-19T20:44:38.570620+0000","last_became_peered":"2023-07-19T20:44:38.570620+0000","last_unstale":"2023-07-19T20:44:39.556470+0000","last_undegraded":"2023-07-19T20:44:39.556470+0000","last_fullsized":"2023-07-19T20:44:39.556470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:09:27.024650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965931+0000","last_change":"2023-07-19T20:44:38.158044+0000","last_active":"2023-07-19T20:44:39.965931+0000","last_peered":"2023-07-19T20:44:39.965931+0000","last_clean":"2023-07-19T20:44:39.965931+0000","last_became_active":"2023-07-19T20:44:38.157760+0000","last_became_peered":"2023-07-19T20:44:38.157760+0000","last_unstale":"2023-07-19T20:44:39.965931+0000","last_undegraded":"2023-07-19T20:44:39.965931+0000","last_fullsized":"2023-07-19T20:44:39.965931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:03:08.671248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.557350+0000","last_change":"2023-07-19T20:44:38.569229+0000","last_active":"2023-07-19T20:44:39.557350+0000","last_peered":"2023-07-19T20:44:39.557350+0000","last_clean":"2023-07-19T20:44:39.557350+0000","last_became_active":"2023-07-19T20:44:38.568732+0000","last_became_peered":"2023-07-19T20:44:38.568732+0000","last_unstale":"2023-07-19T20:44:39.557350+0000","last_undegraded":"2023-07-19T20:44:39.557350+0000","last_fullsized":"2023-07-19T20:44:39.557350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:43:50.405654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967067+0000","last_change":"2023-07-19T20:44:38.158368+0000","last_active":"2023-07-19T20:44:39.967067+0000","last_peered":"2023-07-19T20:44:39.967067+0000","last_clean":"2023-07-19T20:44:39.967067+0000","last_became_active":"2023-07-19T20:44:38.158097+0000","last_became_peered":"2023-07-19T20:44:38.158097+0000","last_unstale":"2023-07-19T20:44:39.967067+0000","last_undegraded":"2023-07-19T20:44:39.967067+0000","last_fullsized":"2023-07-19T20:44:39.967067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:44:37.348181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966104+0000","last_change":"2023-07-19T20:44:38.574231+0000","last_active":"2023-07-19T20:44:39.966104+0000","last_peered":"2023-07-19T20:44:39.966104+0000","last_clean":"2023-07-19T20:44:39.966104+0000","last_became_active":"2023-07-19T20:44:38.573954+0000","last_became_peered":"2023-07-19T20:44:38.573954+0000","last_unstale":"2023-07-19T20:44:39.966104+0000","last_undegraded":"2023-07-19T20:44:39.966104+0000","last_fullsized":"2023-07-19T20:44:39.966104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:44:27.891825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.967472+0000","last_change":"2023-07-19T20:44:38.158334+0000","last_active":"2023-07-19T20:44:39.967472+0000","last_peered":"2023-07-19T20:44:39.967472+0000","last_clean":"2023-07-19T20:44:39.967472+0000","last_became_active":"2023-07-19T20:44:38.158046+0000","last_became_peered":"2023-07-19T20:44:38.158046+0000","last_unstale":"2023-07-19T20:44:39.967472+0000","last_undegraded":"2023-07-19T20:44:39.967472+0000","last_fullsized":"2023-07-19T20:44:39.967472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:49:55.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966062+0000","last_change":"2023-07-19T20:44:38.574118+0000","last_active":"2023-07-19T20:44:39.966062+0000","last_peered":"2023-07-19T20:44:39.966062+0000","last_clean":"2023-07-19T20:44:39.966062+0000","last_became_active":"2023-07-19T20:44:38.573825+0000","last_became_peered":"2023-07-19T20:44:38.573825+0000","last_unstale":"2023-07-19T20:44:39.966062+0000","last_undegraded":"2023-07-19T20:44:39.966062+0000","last_fullsized":"2023-07-19T20:44:39.966062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:12:33.443843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965892+0000","last_change":"2023-07-19T20:44:38.158463+0000","last_active":"2023-07-19T20:44:39.965892+0000","last_peered":"2023-07-19T20:44:39.965892+0000","last_clean":"2023-07-19T20:44:39.965892+0000","last_became_active":"2023-07-19T20:44:38.158210+0000","last_became_peered":"2023-07-19T20:44:38.158210+0000","last_unstale":"2023-07-19T20:44:39.965892+0000","last_undegraded":"2023-07-19T20:44:39.965892+0000","last_fullsized":"2023-07-19T20:44:39.965892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:03:08.671248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965328+0000","last_change":"2023-07-19T20:44:38.561250+0000","last_active":"2023-07-19T20:44:39.965328+0000","last_peered":"2023-07-19T20:44:39.965328+0000","last_clean":"2023-07-19T20:44:39.965328+0000","last_became_active":"2023-07-19T20:44:38.561001+0000","last_became_peered":"2023-07-19T20:44:38.561001+0000","last_unstale":"2023-07-19T20:44:39.965328+0000","last_undegraded":"2023-07-19T20:44:39.965328+0000","last_fullsized":"2023-07-19T20:44:39.965328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:44.845816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965583+0000","last_change":"2023-07-19T20:44:38.156696+0000","last_active":"2023-07-19T20:44:39.965583+0000","last_peered":"2023-07-19T20:44:39.965583+0000","last_clean":"2023-07-19T20:44:39.965583+0000","last_became_active":"2023-07-19T20:44:38.156455+0000","last_became_peered":"2023-07-19T20:44:38.156455+0000","last_unstale":"2023-07-19T20:44:39.965583+0000","last_undegraded":"2023-07-19T20:44:39.965583+0000","last_fullsized":"2023-07-19T20:44:39.965583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:37.128819+0000","last_clean_scrub_stamp":"2023-07-19T20:44:37.128819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:00:17.913421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965669+0000","last_change":"2023-07-19T20:44:38.568760+0000","last_active":"2023-07-19T20:44:39.965669+0000","last_peered":"2023-07-19T20:44:39.965669+0000","last_clean":"2023-07-19T20:44:39.965669+0000","last_became_active":"2023-07-19T20:44:38.568148+0000","last_became_peered":"2023-07-19T20:44:38.568148+0000","last_unstale":"2023-07-19T20:44:39.965669+0000","last_undegraded":"2023-07-19T20:44:39.965669+0000","last_fullsized":"2023-07-19T20:44:39.965669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:29:06.966551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556998+0000","last_change":"2023-07-19T20:44:38.574672+0000","last_active":"2023-07-19T20:44:39.556998+0000","last_peered":"2023-07-19T20:44:39.556998+0000","last_clean":"2023-07-19T20:44:39.556998+0000","last_became_active":"2023-07-19T20:44:38.574318+0000","last_became_peered":"2023-07-19T20:44:38.574318+0000","last_unstale":"2023-07-19T20:44:39.556998+0000","last_undegraded":"2023-07-19T20:44:39.556998+0000","last_fullsized":"2023-07-19T20:44:39.556998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:29:14.941818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965294+0000","last_change":"2023-07-19T20:44:38.574389+0000","last_active":"2023-07-19T20:44:39.965294+0000","last_peered":"2023-07-19T20:44:39.965294+0000","last_clean":"2023-07-19T20:44:39.965294+0000","last_became_active":"2023-07-19T20:44:38.574112+0000","last_became_peered":"2023-07-19T20:44:38.574112+0000","last_unstale":"2023-07-19T20:44:39.965294+0000","last_undegraded":"2023-07-19T20:44:39.965294+0000","last_fullsized":"2023-07-19T20:44:39.965294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:19:13.016609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.966463+0000","last_change":"2023-07-19T20:44:38.566538+0000","last_active":"2023-07-19T20:44:39.966463+0000","last_peered":"2023-07-19T20:44:39.966463+0000","last_clean":"2023-07-19T20:44:39.966463+0000","last_became_active":"2023-07-19T20:44:38.566260+0000","last_became_peered":"2023-07-19T20:44:38.566260+0000","last_unstale":"2023-07-19T20:44:39.966463+0000","last_undegraded":"2023-07-19T20:44:39.966463+0000","last_fullsized":"2023-07-19T20:44:39.966463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:39:41.156243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.965832+0000","last_change":"2023-07-19T20:44:38.583615+0000","last_active":"2023-07-19T20:44:39.965832+0000","last_peered":"2023-07-19T20:44:39.965832+0000","last_clean":"2023-07-19T20:44:39.965832+0000","last_became_active":"2023-07-19T20:44:38.583193+0000","last_became_peered":"2023-07-19T20:44:38.583193+0000","last_unstale":"2023-07-19T20:44:39.965832+0000","last_undegraded":"2023-07-19T20:44:39.965832+0000","last_fullsized":"2023-07-19T20:44:39.965832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:30:42.451874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-19T20:44:39.556700+0000","last_change":"2023-07-19T20:44:38.578448+0000","last_active":"2023-07-19T20:44:39.556700+0000","last_peered":"2023-07-19T20:44:39.556700+0000","last_clean":"2023-07-19T20:44:39.556700+0000","last_became_active":"2023-07-19T20:44:38.578182+0000","last_became_peered":"2023-07-19T20:44:38.578182+0000","last_unstale":"2023-07-19T20:44:39.556700+0000","last_undegraded":"2023-07-19T20:44:39.556700+0000","last_fullsized":"2023-07-19T20:44:39.556700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:38.134135+0000","last_clean_scrub_stamp":"2023-07-19T20:44:38.134135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:20:24.991572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":847872,"data_stored":674320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":82172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":819200,"data_stored":672540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":81211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.5419999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":83792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":81863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-19T20:44:47.681 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-19T20:44:47.681 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-19T20:44:47.681 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-19T20:44:47.682 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-19T20:44:47.835 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.841+0000 7feb0280f700 1 Processor -- start 2023-07-19T20:44:47.835 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.841+0000 7feb0280f700 1 -- start start 2023-07-19T20:44:47.846 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feb0280f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7feafc0b8a20 0x7feafc153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feb0280f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc0b7900 con 0x7feafc0baa40 2023-07-19T20:44:47.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feb0280f700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc147a70 con 0x7feafc1475e0 2023-07-19T20:44:47.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feb0280f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feafc147d50 con 0x7feafc0b8a20 2023-07-19T20:44:47.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafbfff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7feafc0baa40 0x7feafc0b8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41350/0 (socket says 172.21.15.117:41350) 2023-07-19T20:44:47.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafbfff700 1 -- 172.21.15.117:0/936865994 learned_addr learned my addr 172.21.15.117:0/936865994 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:47.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feb00dac700 1 --2- 172.21.15.117:0/936865994 >> v2:172.21.15.124:3300/0 conn(0x7feafc0b8a20 0x7feafc153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 -- 172.21.15.117:0/936865994 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037285727 0 0) 0x7feafc0b7900 con 0x7feafc0baa40 2023-07-19T20:44:47.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 -- 172.21.15.117:0/936865994 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feae40057c0 con 0x7feafc0baa40 2023-07-19T20:44:47.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 -- 172.21.15.117:0/936865994 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3587360389 0 0) 0x7feae40057c0 con 0x7feafc0baa40 2023-07-19T20:44:47.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 -- 172.21.15.117:0/936865994 >> v2:172.21.15.124:3300/0 conn(0x7feafc0b8a20 msgr2=0x7feafc153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:47.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 --2- 172.21.15.117:0/936865994 >> v2:172.21.15.124:3300/0 conn(0x7feafc0b8a20 0x7feafc153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 -- 172.21.15.117:0/936865994 >> v1:172.21.15.124:6789/0 conn(0x7feafc1475e0 legacy=0x7feafc14fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 -- 172.21.15.117:0/936865994 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc148030 con 0x7feafc0baa40 2023-07-19T20:44:47.848 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 -- 172.21.15.117:0/936865994 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7feaec001670 con 0x7feafc0baa40 2023-07-19T20:44:47.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 -- 172.21.15.117:0/936865994 >> v1:172.21.15.117:6789/0 conn(0x7feafc0baa40 legacy=0x7feafc0b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 --2- 172.21.15.117:0/936865994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feae4005c10 0x7feae4006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 --2- 172.21.15.117:0/936865994 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feae4006a60 0x7feae4006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 --2- 172.21.15.117:0/936865994 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feae4007410 0x7feae400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 -- 172.21.15.117:0/936865994 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc147d50 con 0x7feae4005c10 2023-07-19T20:44:47.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 -- 172.21.15.117:0/936865994 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae400e2a0 con 0x7feae4006a60 2023-07-19T20:44:47.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafaffd700 1 -- 172.21.15.117:0/936865994 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae400e460 con 0x7feae4007410 2023-07-19T20:44:47.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafbfff700 1 --2- 172.21.15.117:0/936865994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feae4005c10 0x7feae4006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.842+0000 7feafb7fe700 1 --2- 172.21.15.117:0/936865994 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feae4006a60 0x7feae4006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feb00dac700 1 --2- 172.21.15.117:0/936865994 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feae4007410 0x7feae400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feafbfff700 1 -- 172.21.15.117:0/936865994 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feae4007410 msgr2=0x7feae400dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:47.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feafbfff700 1 --2- 172.21.15.117:0/936865994 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feae4007410 0x7feae400dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feafbfff700 1 -- 172.21.15.117:0/936865994 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feae4006a60 msgr2=0x7feae4006ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:47.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feafbfff700 1 --2- 172.21.15.117:0/936865994 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feae4006a60 0x7feae4006ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feafbfff700 1 -- 172.21.15.117:0/936865994 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40057c0 con 0x7feae4005c10 2023-07-19T20:44:47.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feb00dac700 1 --2- 172.21.15.117:0/936865994 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feae4007410 0x7feae400dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:47.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feafb7fe700 1 --2- 172.21.15.117:0/936865994 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feae4006a60 0x7feae4006ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:47.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feb00dac700 1 -- 172.21.15.117:0/936865994 reap_dead start 2023-07-19T20:44:47.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feafbfff700 1 --2- 172.21.15.117:0/936865994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feae4005c10 0x7feae4006040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feaec00c2a0 tx=0x7feae4007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43d1c689f38623 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:47.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feafaffd700 1 -- 172.21.15.117:0/936865994 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec007c10 con 0x7feae4005c10 2023-07-19T20:44:47.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feafaffd700 1 -- 172.21.15.117:0/936865994 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec00cde0 con 0x7feae4005c10 2023-07-19T20:44:47.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feafaffd700 1 -- 172.21.15.117:0/936865994 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec005ba0 con 0x7feae4005c10 2023-07-19T20:44:47.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feb0280f700 1 -- 172.21.15.117:0/936865994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feae4005c10 msgr2=0x7feae4006040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feb0280f700 1 --2- 172.21.15.117:0/936865994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feae4005c10 0x7feae4006040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feaec00c2a0 tx=0x7feae4007a90 comp rx=0 tx=0).stop 2023-07-19T20:44:47.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feb0280f700 1 -- 172.21.15.117:0/936865994 shutdown_connections 2023-07-19T20:44:47.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feb0280f700 1 --2- 172.21.15.117:0/936865994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feae4005c10 0x7feae4006040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feb0280f700 1 -- 172.21.15.117:0/936865994 >> 172.21.15.117:0/936865994 conn(0x7feafc0be4b0 msgr2=0x7feafc0ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:47.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feb0280f700 1 -- 172.21.15.117:0/936865994 shutdown_connections 2023-07-19T20:44:47.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.843+0000 7feb0280f700 1 -- 172.21.15.117:0/936865994 wait complete. 2023-07-19T20:44:47.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.845+0000 7feb0280f700 1 Processor -- start 2023-07-19T20:44:47.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.845+0000 7feb0280f700 1 -- start start 2023-07-19T20:44:47.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb0280f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feae4005c10 0x7feafc1d2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb0280f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feafc144d00 0x7feafc0b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb0280f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feafc13ea60 0x7feafc13eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb0280f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc1d04f0 con 0x7feafc13ea60 2023-07-19T20:44:47.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb0280f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc1d31d0 con 0x7feafc144d00 2023-07-19T20:44:47.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb0280f700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc1d0000 con 0x7feae4005c10 2023-07-19T20:44:47.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb00dac700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feafc13ea60 0x7feafc13eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb00dac700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feafc13ea60 0x7feafc13eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43940/0 (socket says 172.21.15.117:43940) 2023-07-19T20:44:47.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb00dac700 1 -- 172.21.15.117:0/3637594301 learned_addr learned my addr 172.21.15.117:0/3637594301 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:47.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feafbfff700 1 --2- 172.21.15.117:0/3637594301 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feae4005c10 0x7feafc1d2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feafb7fe700 1 --2- 172.21.15.117:0/3637594301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feafc144d00 0x7feafc0b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb00dac700 1 -- 172.21.15.117:0/3637594301 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feae4005c10 msgr2=0x7feafc1d2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb00dac700 1 --2- 172.21.15.117:0/3637594301 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feae4005c10 0x7feafc1d2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb00dac700 1 -- 172.21.15.117:0/3637594301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feafc144d00 msgr2=0x7feafc0b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:47.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb00dac700 1 --2- 172.21.15.117:0/3637594301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feafc144d00 0x7feafc0b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:47.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb00dac700 1 -- 172.21.15.117:0/3637594301 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc1cf990 con 0x7feafc13ea60 2023-07-19T20:44:47.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.846+0000 7feb00dac700 1 --2- 172.21.15.117:0/3637594301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feafc13ea60 0x7feafc13eed0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feafc072350 tx=0x7feaf40104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:47.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.847+0000 7feaf8ff9700 1 -- 172.21.15.117:0/3637594301 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf401b070 con 0x7feafc13ea60 2023-07-19T20:44:47.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.847+0000 7feaf8ff9700 1 -- 172.21.15.117:0/3637594301 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf400f040 con 0x7feafc13ea60 2023-07-19T20:44:47.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.847+0000 7feaf8ff9700 1 -- 172.21.15.117:0/3637594301 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf400e050 con 0x7feafc13ea60 2023-07-19T20:44:47.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.847+0000 7feb0280f700 1 -- 172.21.15.117:0/3637594301 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feafc1ce470 con 0x7feafc13ea60 2023-07-19T20:44:47.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.847+0000 7feb0280f700 1 -- 172.21.15.117:0/3637594301 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feafc1ce100 con 0x7feafc13ea60 2023-07-19T20:44:47.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.848+0000 7feb0280f700 1 -- 172.21.15.117:0/3637594301 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feafc1cdf60 con 0x7feafc13ea60 2023-07-19T20:44:47.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.848+0000 7feaf8ff9700 1 -- 172.21.15.117:0/3637594301 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7feaf4003a20 con 0x7feafc13ea60 2023-07-19T20:44:47.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.848+0000 7feaf8ff9700 1 --2- 172.21.15.117:0/3637594301 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7feae806a690 0x7feae806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:47.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.848+0000 7feaf8ff9700 1 -- 172.21.15.117:0/3637594301 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feaf4088e80 con 0x7feafc13ea60 2023-07-19T20:44:47.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.848+0000 7feafbfff700 1 --2- 172.21.15.117:0/3637594301 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7feae806a690 0x7feae806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:47.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.849+0000 7feafbfff700 1 --2- 172.21.15.117:0/3637594301 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7feae806a690 0x7feae806cb40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feaec000c00 tx=0x7feaec007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:47.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:47.852+0000 7feaf8ff9700 1 -- 172.21.15.117:0/3637594301 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7feafc1cdf60 con 0x7feafc13ea60 2023-07-19T20:44:48.077 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.082+0000 7feb0280f700 1 -- 172.21.15.117:0/3637594301 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7feafc1cdf60 con 0x7feafc13ea60 2023-07-19T20:44:48.078 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.082+0000 7feaf8ff9700 1 -- 172.21.15.117:0/3637594301 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7feafc1cdf60 con 0x7feafc13ea60 2023-07-19T20:44:48.079 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:48.079 INFO:teuthology.orchestra.run.smithi117.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-19T20:44:48.080 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.084+0000 7feb0280f700 1 -- 172.21.15.117:0/3637594301 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7feae806a690 msgr2=0x7feae806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.081 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.084+0000 7feb0280f700 1 --2- 172.21.15.117:0/3637594301 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7feae806a690 0x7feae806cb40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feaec000c00 tx=0x7feaec007000 comp rx=0 tx=0).stop 2023-07-19T20:44:48.081 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.084+0000 7feb0280f700 1 -- 172.21.15.117:0/3637594301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feafc13ea60 msgr2=0x7feafc13eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.081 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.084+0000 7feb0280f700 1 --2- 172.21.15.117:0/3637594301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feafc13ea60 0x7feafc13eed0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feafc072350 tx=0x7feaf40104a0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.081 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.084+0000 7feb0280f700 1 -- 172.21.15.117:0/3637594301 shutdown_connections 2023-07-19T20:44:48.081 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.084+0000 7feb0280f700 1 --2- 172.21.15.117:0/3637594301 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7feae806a690 0x7feae806cb40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.081 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.084+0000 7feb0280f700 1 --2- 172.21.15.117:0/3637594301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feafc13ea60 0x7feafc13eed0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.082 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.084+0000 7feb0280f700 1 --2- 172.21.15.117:0/3637594301 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feae4005c10 0x7feafc1d2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.082 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.084+0000 7feb0280f700 1 --2- 172.21.15.117:0/3637594301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feafc144d00 0x7feafc0b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.082 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.084+0000 7feb0280f700 1 -- 172.21.15.117:0/3637594301 >> 172.21.15.117:0/3637594301 conn(0x7feafc0be4b0 msgr2=0x7feafc1464f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:48.082 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.084+0000 7feb0280f700 1 -- 172.21.15.117:0/3637594301 shutdown_connections 2023-07-19T20:44:48.082 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.084+0000 7feb0280f700 1 -- 172.21.15.117:0/3637594301 wait complete. 2023-07-19T20:44:48.091 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-19T20:44:48.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:48.214 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.219+0000 7fba6ad58700 1 Processor -- start 2023-07-19T20:44:48.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.219+0000 7fba6ad58700 1 -- start start 2023-07-19T20:44:48.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.219+0000 7fba6ad58700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fba640bacb0 0x7fba640702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.219+0000 7fba6ad58700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fba640b8da0 0x7fba640b91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.219+0000 7fba6ad58700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba640729d0 con 0x7fba64071be0 2023-07-19T20:44:48.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.219+0000 7fba6ad58700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba640715e0 con 0x7fba640b8da0 2023-07-19T20:44:48.217 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.219+0000 7fba6ad58700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba640717c0 con 0x7fba640bacb0 2023-07-19T20:44:48.217 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.219+0000 7fba692f5700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fba640b8da0 0x7fba640b91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.217 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.219+0000 7fba692f5700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fba640b8da0 0x7fba640b91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43950/0 (socket says 172.21.15.117:43950) 2023-07-19T20:44:48.217 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.219+0000 7fba692f5700 1 -- 172.21.15.117:0/4014240401 learned_addr learned my addr 172.21.15.117:0/4014240401 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:48.217 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.220+0000 7fba68af4700 1 --2- 172.21.15.117:0/4014240401 >> v2:172.21.15.124:3300/0 conn(0x7fba640bacb0 0x7fba640702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.217 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.220+0000 7fba692f5700 1 -- 172.21.15.117:0/4014240401 >> v2:172.21.15.124:3300/0 conn(0x7fba640bacb0 msgr2=0x7fba640702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:48.218 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.220+0000 7fba692f5700 1 --2- 172.21.15.117:0/4014240401 >> v2:172.21.15.124:3300/0 conn(0x7fba640bacb0 0x7fba640702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.218 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.220+0000 7fba692f5700 1 -- 172.21.15.117:0/4014240401 >> v1:172.21.15.124:6789/0 conn(0x7fba64071be0 legacy=0x7fba641446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:48.219 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.220+0000 7fba692f5700 1 -- 172.21.15.117:0/4014240401 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba64072130 con 0x7fba640b8da0 2023-07-19T20:44:48.219 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.220+0000 7fba692f5700 1 --2- 172.21.15.117:0/4014240401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba640b8da0 0x7fba640b91a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fba64072d40 tx=0x7fba5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a76108270b7c07 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:48.220 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.220+0000 7fba637fe700 1 -- 172.21.15.117:0/4014240401 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c00e070 con 0x7fba640b8da0 2023-07-19T20:44:48.220 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.220+0000 7fba637fe700 1 -- 172.21.15.117:0/4014240401 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c003a20 con 0x7fba640b8da0 2023-07-19T20:44:48.220 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.220+0000 7fba637fe700 1 -- 172.21.15.117:0/4014240401 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c003dd0 con 0x7fba640b8da0 2023-07-19T20:44:48.229 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.221+0000 7fba6ad58700 1 -- 172.21.15.117:0/4014240401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba640b8da0 msgr2=0x7fba640b91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.229 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.221+0000 7fba6ad58700 1 --2- 172.21.15.117:0/4014240401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba640b8da0 0x7fba640b91a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fba64072d40 tx=0x7fba5c00b330 comp rx=0 tx=0).stop 2023-07-19T20:44:48.229 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.221+0000 7fba6ad58700 1 -- 172.21.15.117:0/4014240401 shutdown_connections 2023-07-19T20:44:48.230 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.221+0000 7fba6ad58700 1 --2- 172.21.15.117:0/4014240401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba640b8da0 0x7fba640b91a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.231 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.221+0000 7fba6ad58700 1 --2- 172.21.15.117:0/4014240401 >> v2:172.21.15.124:3300/0 conn(0x7fba640bacb0 0x7fba640702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.231 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.221+0000 7fba6ad58700 1 -- 172.21.15.117:0/4014240401 >> 172.21.15.117:0/4014240401 conn(0x7fba640be4b0 msgr2=0x7fba640ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:48.231 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.221+0000 7fba6ad58700 1 -- 172.21.15.117:0/4014240401 shutdown_connections 2023-07-19T20:44:48.231 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.221+0000 7fba6ad58700 1 -- 172.21.15.117:0/4014240401 wait complete. 2023-07-19T20:44:48.231 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.222+0000 7fba6ad58700 1 Processor -- start 2023-07-19T20:44:48.231 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.222+0000 7fba6ad58700 1 -- start start 2023-07-19T20:44:48.232 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.222+0000 7fba6ad58700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fba64071be0 0x7fba640bd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.232 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.222+0000 7fba6ad58700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fba640b8da0 0x7fba641e3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.232 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.222+0000 7fba6ad58700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba640bacb0 0x7fba641e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.232 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.222+0000 7fba6ad58700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba64145060 con 0x7fba640bacb0 2023-07-19T20:44:48.232 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.222+0000 7fba6ad58700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba640bd730 con 0x7fba64071be0 2023-07-19T20:44:48.232 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.222+0000 7fba6ad58700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba64141bf0 con 0x7fba640b8da0 2023-07-19T20:44:48.233 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.222+0000 7fba692f5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba640bacb0 0x7fba641e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.233 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba692f5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba640bacb0 0x7fba641e4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43958/0 (socket says 172.21.15.117:43958) 2023-07-19T20:44:48.233 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba692f5700 1 -- 172.21.15.117:0/764249769 learned_addr learned my addr 172.21.15.117:0/764249769 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:48.233 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba68af4700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fba64071be0 0x7fba640bd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.234 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba63fff700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fba640b8da0 0x7fba641e3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.234 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba692f5700 1 -- 172.21.15.117:0/764249769 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fba640b8da0 msgr2=0x7fba641e3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.234 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba692f5700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fba640b8da0 0x7fba641e3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.234 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba692f5700 1 -- 172.21.15.117:0/764249769 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fba64071be0 msgr2=0x7fba640bd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.234 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba692f5700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fba64071be0 0x7fba640bd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.234 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba692f5700 1 -- 172.21.15.117:0/764249769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c009b30 con 0x7fba640bacb0 2023-07-19T20:44:48.234 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba68af4700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fba64071be0 0x7fba640bd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:48.235 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba692f5700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba640bacb0 0x7fba641e4200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00b370 tx=0x7fba5c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:48.236 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba617fa700 1 -- 172.21.15.117:0/764249769 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c004440 con 0x7fba640bacb0 2023-07-19T20:44:48.236 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba617fa700 1 -- 172.21.15.117:0/764249769 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c0045c0 con 0x7fba640bacb0 2023-07-19T20:44:48.236 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba6ad58700 1 -- 172.21.15.117:0/764249769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba64144e10 con 0x7fba640bacb0 2023-07-19T20:44:48.237 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba617fa700 1 -- 172.21.15.117:0/764249769 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c004970 con 0x7fba640bacb0 2023-07-19T20:44:48.237 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.223+0000 7fba6ad58700 1 -- 172.21.15.117:0/764249769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba64141530 con 0x7fba640bacb0 2023-07-19T20:44:48.237 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.224+0000 7fba6ad58700 1 -- 172.21.15.117:0/764249769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba64141390 con 0x7fba640bacb0 2023-07-19T20:44:48.239 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.224+0000 7fba617fa700 1 -- 172.21.15.117:0/764249769 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fba5c012430 con 0x7fba640bacb0 2023-07-19T20:44:48.239 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.225+0000 7fba617fa700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fba5006a660 0x7fba5006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.239 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.225+0000 7fba617fa700 1 -- 172.21.15.117:0/764249769 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba5c089eb0 con 0x7fba640bacb0 2023-07-19T20:44:48.239 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.225+0000 7fba68af4700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fba5006a660 0x7fba5006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.240 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.225+0000 7fba68af4700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fba5006a660 0x7fba5006cb10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fba54007a50 tx=0x7fba54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:48.240 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.229+0000 7fba617fa700 1 -- 172.21.15.117:0/764249769 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fba64141390 con 0x7fba640bacb0 2023-07-19T20:44:48.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.415+0000 7fba6ad58700 1 -- 172.21.15.117:0/764249769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba64141390 con 0x7fba640bacb0 2023-07-19T20:44:48.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.416+0000 7fba617fa700 1 -- 172.21.15.117:0/764249769 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17897 (secure 0 0 0) 0x7fba64141390 con 0x7fba640bacb0 2023-07-19T20:44:48.411 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:48.411 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:39.549566+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:48.412 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.418+0000 7fba6ad58700 1 -- 172.21.15.117:0/764249769 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fba5006a660 msgr2=0x7fba5006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.418+0000 7fba6ad58700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fba5006a660 0x7fba5006cb10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fba54007a50 tx=0x7fba54008040 comp rx=0 tx=0).stop 2023-07-19T20:44:48.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.418+0000 7fba6ad58700 1 -- 172.21.15.117:0/764249769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba640bacb0 msgr2=0x7fba641e4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.418+0000 7fba6ad58700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba640bacb0 0x7fba641e4200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00b370 tx=0x7fba5c004ad0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.418+0000 7fba6ad58700 1 -- 172.21.15.117:0/764249769 shutdown_connections 2023-07-19T20:44:48.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.418+0000 7fba6ad58700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fba5006a660 0x7fba5006cb10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.418+0000 7fba6ad58700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba640bacb0 0x7fba641e4200 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.418+0000 7fba6ad58700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fba64071be0 0x7fba640bd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.418+0000 7fba6ad58700 1 --2- 172.21.15.117:0/764249769 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fba640b8da0 0x7fba641e3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.418+0000 7fba6ad58700 1 -- 172.21.15.117:0/764249769 >> 172.21.15.117:0/764249769 conn(0x7fba640be4b0 msgr2=0x7fba6406fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:48.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.418+0000 7fba6ad58700 1 -- 172.21.15.117:0/764249769 shutdown_connections 2023-07-19T20:44:48.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.418+0000 7fba6ad58700 1 -- 172.21.15.117:0/764249769 wait complete. 2023-07-19T20:44:48.425 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-19T20:44:31.325778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-19T20:44:31.728215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-19T20:44:36.280405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-19T20:44:37.509195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-19T20:44:48.426 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-19T20:44:48.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.555+0000 7fc2a3c71700 1 Processor -- start 2023-07-19T20:44:48.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.555+0000 7fc2a3c71700 1 -- start start 2023-07-19T20:44:48.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a3c71700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc29c0a2b60 0x7fc29c152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a3c71700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc29c06a930 0x7fc29c1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a3c71700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c0b8490 con 0x7fc29c06a560 2023-07-19T20:44:48.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a3c71700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c0bcda0 con 0x7fc29c06a930 2023-07-19T20:44:48.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a3c71700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0b9ab0 con 0x7fc29c0a2b60 2023-07-19T20:44:48.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a220e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc29c06a930 0x7fc29c1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a220e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc29c06a930 0x7fc29c1550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43974/0 (socket says 172.21.15.117:43974) 2023-07-19T20:44:48.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a220e700 1 -- 172.21.15.117:0/1309208500 learned_addr learned my addr 172.21.15.117:0/1309208500 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:48.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a120c700 1 --2- 172.21.15.117:0/1309208500 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc29c0a2b60 0x7fc29c152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a220e700 1 -- 172.21.15.117:0/1309208500 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc29c0a2b60 msgr2=0x7fc29c152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:48.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a220e700 1 --2- 172.21.15.117:0/1309208500 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc29c0a2b60 0x7fc29c152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a220e700 1 -- 172.21.15.117:0/1309208500 >> v1:172.21.15.124:6789/0 conn(0x7fc29c06a560 legacy=0x7fc29c0a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:48.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a220e700 1 -- 172.21.15.117:0/1309208500 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0b9560 con 0x7fc29c06a930 2023-07-19T20:44:48.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a220e700 1 --2- 172.21.15.117:0/1309208500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc29c06a930 0x7fc29c1550f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc294009e50 tx=0x7fc29400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec2989ab858317b server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:48.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.556+0000 7fc2a0a0b700 1 -- 172.21.15.117:0/1309208500 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29400e070 con 0x7fc29c06a930 2023-07-19T20:44:48.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.557+0000 7fc2a0a0b700 1 -- 172.21.15.117:0/1309208500 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc294003a20 con 0x7fc29c06a930 2023-07-19T20:44:48.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.557+0000 7fc2a0a0b700 1 -- 172.21.15.117:0/1309208500 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294003dd0 con 0x7fc29c06a930 2023-07-19T20:44:48.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.557+0000 7fc2a3c71700 1 -- 172.21.15.117:0/1309208500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc29c06a930 msgr2=0x7fc29c1550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.557+0000 7fc2a3c71700 1 --2- 172.21.15.117:0/1309208500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc29c06a930 0x7fc29c1550f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc294009e50 tx=0x7fc29400b330 comp rx=0 tx=0).stop 2023-07-19T20:44:48.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.557+0000 7fc2a3c71700 1 -- 172.21.15.117:0/1309208500 shutdown_connections 2023-07-19T20:44:48.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.557+0000 7fc2a3c71700 1 --2- 172.21.15.117:0/1309208500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc29c06a930 0x7fc29c1550f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.557+0000 7fc2a3c71700 1 --2- 172.21.15.117:0/1309208500 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc29c0a2b60 0x7fc29c152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.557+0000 7fc2a3c71700 1 -- 172.21.15.117:0/1309208500 >> 172.21.15.117:0/1309208500 conn(0x7fc29c09f570 msgr2=0x7fc29c09f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:48.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.557+0000 7fc2a3c71700 1 -- 172.21.15.117:0/1309208500 shutdown_connections 2023-07-19T20:44:48.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.557+0000 7fc2a3c71700 1 -- 172.21.15.117:0/1309208500 wait complete. 2023-07-19T20:44:48.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.558+0000 7fc2a3c71700 1 Processor -- start 2023-07-19T20:44:48.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.558+0000 7fc2a3c71700 1 -- start start 2023-07-19T20:44:48.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a3c71700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc29c06a560 0x7fc29c1d3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a3c71700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc29c06a930 0x7fc29c1cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a3c71700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc29c0a2b60 0x7fc29c1cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a3c71700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c06e2f0 con 0x7fc29c06a930 2023-07-19T20:44:48.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a3c71700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c06dd50 con 0x7fc29c0a2b60 2023-07-19T20:44:48.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a3c71700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c1d4a90 con 0x7fc29c06a560 2023-07-19T20:44:48.559 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a120c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc29c06a930 0x7fc29c1cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a120c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc29c06a930 0x7fc29c1cbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43978/0 (socket says 172.21.15.117:43978) 2023-07-19T20:44:48.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a120c700 1 -- 172.21.15.117:0/2568734462 learned_addr learned my addr 172.21.15.117:0/2568734462 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:48.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a220e700 1 --2- 172.21.15.117:0/2568734462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc29c0a2b60 0x7fc29c1cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a1a0d700 1 --2- 172.21.15.117:0/2568734462 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc29c06a560 0x7fc29c1d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a120c700 1 -- 172.21.15.117:0/2568734462 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc29c06a560 msgr2=0x7fc29c1d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a120c700 1 --2- 172.21.15.117:0/2568734462 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc29c06a560 0x7fc29c1d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a120c700 1 -- 172.21.15.117:0/2568734462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc29c0a2b60 msgr2=0x7fc29c1cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a120c700 1 --2- 172.21.15.117:0/2568734462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc29c0a2b60 0x7fc29c1cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a120c700 1 -- 172.21.15.117:0/2568734462 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc294009b30 con 0x7fc29c06a930 2023-07-19T20:44:48.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.559+0000 7fc2a120c700 1 --2- 172.21.15.117:0/2568734462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc29c06a930 0x7fc29c1cbd60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c7f0 tx=0x7fc29800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:48.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.560+0000 7fc2927fc700 1 -- 172.21.15.117:0/2568734462 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298004220 con 0x7fc29c06a930 2023-07-19T20:44:48.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.560+0000 7fc2927fc700 1 -- 172.21.15.117:0/2568734462 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc298004380 con 0x7fc29c06a930 2023-07-19T20:44:48.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.560+0000 7fc2a3c71700 1 -- 172.21.15.117:0/2568734462 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c1d4d70 con 0x7fc29c06a930 2023-07-19T20:44:48.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.560+0000 7fc2927fc700 1 -- 172.21.15.117:0/2568734462 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980036a0 con 0x7fc29c06a930 2023-07-19T20:44:48.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.560+0000 7fc2a3c71700 1 -- 172.21.15.117:0/2568734462 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c1d5050 con 0x7fc29c06a930 2023-07-19T20:44:48.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.560+0000 7fc2a3c71700 1 -- 172.21.15.117:0/2568734462 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c0b8900 con 0x7fc29c06a930 2023-07-19T20:44:48.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.561+0000 7fc2927fc700 1 -- 172.21.15.117:0/2568734462 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fc298003800 con 0x7fc29c06a930 2023-07-19T20:44:48.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.561+0000 7fc2927fc700 1 --2- 172.21.15.117:0/2568734462 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc28006a690 0x7fc28006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.561+0000 7fc2927fc700 1 -- 172.21.15.117:0/2568734462 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc298088560 con 0x7fc29c06a930 2023-07-19T20:44:48.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.561+0000 7fc2a1a0d700 1 --2- 172.21.15.117:0/2568734462 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc28006a690 0x7fc28006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.562+0000 7fc2a1a0d700 1 --2- 172.21.15.117:0/2568734462 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc28006a690 0x7fc28006cb40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009960 tx=0x7fc28c0090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:48.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.566+0000 7fc2927fc700 1 -- 172.21.15.117:0/2568734462 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fc29c0b8900 con 0x7fc29c06a930 2023-07-19T20:44:48.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.751+0000 7fc2a3c71700 1 -- 172.21.15.117:0/2568734462 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc29c0b8900 con 0x7fc29c06a930 2023-07-19T20:44:48.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.751+0000 7fc2927fc700 1 -- 172.21.15.117:0/2568734462 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc29c0b8900 con 0x7fc29c06a930 2023-07-19T20:44:48.747 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 8 2023-07-19T20:44:48.749 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.753+0000 7fc2a3c71700 1 -- 172.21.15.117:0/2568734462 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc28006a690 msgr2=0x7fc28006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.749 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.753+0000 7fc2a3c71700 1 --2- 172.21.15.117:0/2568734462 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc28006a690 0x7fc28006cb40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009960 tx=0x7fc28c0090e0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.749 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.753+0000 7fc2a3c71700 1 -- 172.21.15.117:0/2568734462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc29c06a930 msgr2=0x7fc29c1cbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.749 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.753+0000 7fc2a3c71700 1 --2- 172.21.15.117:0/2568734462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc29c06a930 0x7fc29c1cbd60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c7f0 tx=0x7fc29800cb00 comp rx=0 tx=0).stop 2023-07-19T20:44:48.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.753+0000 7fc2a3c71700 1 -- 172.21.15.117:0/2568734462 shutdown_connections 2023-07-19T20:44:48.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.753+0000 7fc2a3c71700 1 --2- 172.21.15.117:0/2568734462 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc28006a690 0x7fc28006cb40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.753+0000 7fc2a3c71700 1 --2- 172.21.15.117:0/2568734462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc29c0a2b60 0x7fc29c1cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.751 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.753+0000 7fc2a3c71700 1 --2- 172.21.15.117:0/2568734462 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc29c06a560 0x7fc29c1d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.751 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.753+0000 7fc2a3c71700 1 --2- 172.21.15.117:0/2568734462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc29c06a930 0x7fc29c1cbd60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.752 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.753+0000 7fc2a3c71700 1 -- 172.21.15.117:0/2568734462 >> 172.21.15.117:0/2568734462 conn(0x7fc29c09f570 msgr2=0x7fc29c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:48.752 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.753+0000 7fc2a3c71700 1 -- 172.21.15.117:0/2568734462 shutdown_connections 2023-07-19T20:44:48.752 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.753+0000 7fc2a3c71700 1 -- 172.21.15.117:0/2568734462 wait complete. 2023-07-19T20:44:48.760 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-19T20:44:48.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.892+0000 7fe1485c4700 1 Processor -- start 2023-07-19T20:44:48.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.892+0000 7fe1485c4700 1 -- start start 2023-07-19T20:44:48.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.892+0000 7fe1485c4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe14006c790 0x7fe140147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.888 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.892+0000 7fe1485c4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1401480f0 0x7fe140151f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.888 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.892+0000 7fe1485c4700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe140147720 con 0x7fe14006b7e0 2023-07-19T20:44:48.888 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.892+0000 7fe1485c4700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1400b3920 con 0x7fe14006c790 2023-07-19T20:44:48.888 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.892+0000 7fe1485c4700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14006cbe0 con 0x7fe1401480f0 2023-07-19T20:44:48.888 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.892+0000 7fe145b5f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe14006c790 0x7fe140147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.888 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.892+0000 7fe146360700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe14006b7e0 0x7fe140141610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41366/0 (socket says 172.21.15.117:41366) 2023-07-19T20:44:48.888 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.893+0000 7fe146360700 1 -- 172.21.15.117:0/3222687158 learned_addr learned my addr 172.21.15.117:0/3222687158 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:48.889 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.893+0000 7fe146b61700 1 --2- 172.21.15.117:0/3222687158 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1401480f0 0x7fe140151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.889 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.893+0000 7fe145b5f700 1 -- 172.21.15.117:0/3222687158 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1401480f0 msgr2=0x7fe140151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:48.889 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.893+0000 7fe145b5f700 1 --2- 172.21.15.117:0/3222687158 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1401480f0 0x7fe140151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.889 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.893+0000 7fe145b5f700 1 -- 172.21.15.117:0/3222687158 >> v1:172.21.15.117:6789/0 conn(0x7fe14006b7e0 legacy=0x7fe140141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.889 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.893+0000 7fe145b5f700 1 -- 172.21.15.117:0/3222687158 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe140148570 con 0x7fe14006c790 2023-07-19T20:44:48.889 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.893+0000 7fe14535e700 1 -- 172.21.15.117:0/3222687158 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540951381 0 0) 0x7fe140147720 con 0x7fe14006b7e0 2023-07-19T20:44:48.889 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.893+0000 7fe145b5f700 1 --2- 172.21.15.117:0/3222687158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14006c790 0x7fe140147bb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009840 tx=0x7fe13c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bc5ddcee7b9e2a server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:48.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.893+0000 7fe14535e700 1 -- 172.21.15.117:0/3222687158 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c011830 con 0x7fe14006c790 2023-07-19T20:44:48.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.893+0000 7fe14535e700 1 -- 172.21.15.117:0/3222687158 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c011990 con 0x7fe14006c790 2023-07-19T20:44:48.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.893+0000 7fe14535e700 1 -- 172.21.15.117:0/3222687158 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c011d20 con 0x7fe14006c790 2023-07-19T20:44:48.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.894+0000 7fe1485c4700 1 -- 172.21.15.117:0/3222687158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14006c790 msgr2=0x7fe140147bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.894+0000 7fe1485c4700 1 --2- 172.21.15.117:0/3222687158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14006c790 0x7fe140147bb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009840 tx=0x7fe13c009b50 comp rx=0 tx=0).stop 2023-07-19T20:44:48.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.894+0000 7fe1485c4700 1 -- 172.21.15.117:0/3222687158 shutdown_connections 2023-07-19T20:44:48.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.894+0000 7fe1485c4700 1 --2- 172.21.15.117:0/3222687158 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1401480f0 0x7fe140151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.894+0000 7fe1485c4700 1 --2- 172.21.15.117:0/3222687158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14006c790 0x7fe140147bb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.894+0000 7fe1485c4700 1 -- 172.21.15.117:0/3222687158 >> 172.21.15.117:0/3222687158 conn(0x7fe1400bdc50 msgr2=0x7fe14006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:48.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.894+0000 7fe1485c4700 1 -- 172.21.15.117:0/3222687158 shutdown_connections 2023-07-19T20:44:48.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.894+0000 7fe1485c4700 1 -- 172.21.15.117:0/3222687158 wait complete. 2023-07-19T20:44:48.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.895+0000 7fe1485c4700 1 Processor -- start 2023-07-19T20:44:48.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.895+0000 7fe1485c4700 1 -- start start 2023-07-19T20:44:48.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe1485c4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14006b7e0 0x7fe1400b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe1485c4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe14006c790 0x7fe14014b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe1485c4700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1401480f0 0x7fe1400b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe1485c4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14014b8b0 con 0x7fe14006b7e0 2023-07-19T20:44:48.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe1485c4700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400bc480 con 0x7fe1401480f0 2023-07-19T20:44:48.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe1485c4700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400b5c30 con 0x7fe14006c790 2023-07-19T20:44:48.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe146360700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14006b7e0 0x7fe1400b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe146360700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14006b7e0 0x7fe1400b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43992/0 (socket says 172.21.15.117:43992) 2023-07-19T20:44:48.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe146360700 1 -- 172.21.15.117:0/712888693 learned_addr learned my addr 172.21.15.117:0/712888693 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:48.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe146360700 1 -- 172.21.15.117:0/712888693 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe14006c790 msgr2=0x7fe14014b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe146360700 1 --2- 172.21.15.117:0/712888693 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe14006c790 0x7fe14014b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe146360700 1 -- 172.21.15.117:0/712888693 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1401480f0 msgr2=0x7fe1400b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:48.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe146360700 1 --2- 172.21.15.117:0/712888693 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1401480f0 0x7fe1400b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:48.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe146360700 1 -- 172.21.15.117:0/712888693 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c0094a0 con 0x7fe14006b7e0 2023-07-19T20:44:48.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.896+0000 7fe146360700 1 --2- 172.21.15.117:0/712888693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14006b7e0 0x7fe1400b5520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1300011e0 tx=0x7fe13000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:48.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.897+0000 7fe136ffd700 1 -- 172.21.15.117:0/712888693 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130004c80 con 0x7fe14006b7e0 2023-07-19T20:44:48.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.897+0000 7fe136ffd700 1 -- 172.21.15.117:0/712888693 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe130004e00 con 0x7fe14006b7e0 2023-07-19T20:44:48.897 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.897+0000 7fe136ffd700 1 -- 172.21.15.117:0/712888693 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130007310 con 0x7fe14006b7e0 2023-07-19T20:44:48.897 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.897+0000 7fe1485c4700 1 -- 172.21.15.117:0/712888693 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe140072560 con 0x7fe14006b7e0 2023-07-19T20:44:48.897 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.897+0000 7fe1485c4700 1 -- 172.21.15.117:0/712888693 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1400b4640 con 0x7fe14006b7e0 2023-07-19T20:44:48.897 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.897+0000 7fe1485c4700 1 -- 172.21.15.117:0/712888693 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14013ec40 con 0x7fe14006b7e0 2023-07-19T20:44:48.899 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.898+0000 7fe136ffd700 1 -- 172.21.15.117:0/712888693 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fe130007470 con 0x7fe14006b7e0 2023-07-19T20:44:48.899 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.898+0000 7fe136ffd700 1 --2- 172.21.15.117:0/712888693 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe12406a660 0x7fe12406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:48.900 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.899+0000 7fe145b5f700 1 --2- 172.21.15.117:0/712888693 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe12406a660 0x7fe12406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:48.900 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.899+0000 7fe136ffd700 1 -- 172.21.15.117:0/712888693 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe130088740 con 0x7fe14006b7e0 2023-07-19T20:44:48.901 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.899+0000 7fe145b5f700 1 --2- 172.21.15.117:0/712888693 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe12406a660 0x7fe12406cb10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe14013dc60 tx=0x7fe13c010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:48.901 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:48.903+0000 7fe136ffd700 1 -- 172.21.15.117:0/712888693 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fe130053bd0 con 0x7fe14006b7e0 2023-07-19T20:44:49.080 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.085+0000 7fe1485c4700 1 -- 172.21.15.117:0/712888693 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe140067940 con 0x7fe14006b7e0 2023-07-19T20:44:49.080 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.086+0000 7fe136ffd700 1 -- 172.21.15.117:0/712888693 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1300571f0 con 0x7fe14006b7e0 2023-07-19T20:44:49.081 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2023-07-19T20:44:49.082 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.088+0000 7fe1485c4700 1 -- 172.21.15.117:0/712888693 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe12406a660 msgr2=0x7fe12406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.088+0000 7fe1485c4700 1 --2- 172.21.15.117:0/712888693 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe12406a660 0x7fe12406cb10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe14013dc60 tx=0x7fe13c010000 comp rx=0 tx=0).stop 2023-07-19T20:44:49.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.088+0000 7fe1485c4700 1 -- 172.21.15.117:0/712888693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14006b7e0 msgr2=0x7fe1400b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.088+0000 7fe1485c4700 1 --2- 172.21.15.117:0/712888693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14006b7e0 0x7fe1400b5520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1300011e0 tx=0x7fe13000cae0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.088+0000 7fe1485c4700 1 -- 172.21.15.117:0/712888693 shutdown_connections 2023-07-19T20:44:49.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.088+0000 7fe1485c4700 1 --2- 172.21.15.117:0/712888693 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe12406a660 0x7fe12406cb10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.088+0000 7fe1485c4700 1 --2- 172.21.15.117:0/712888693 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1401480f0 0x7fe1400b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.088+0000 7fe1485c4700 1 --2- 172.21.15.117:0/712888693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14006b7e0 0x7fe1400b5520 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.088+0000 7fe1485c4700 1 --2- 172.21.15.117:0/712888693 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe14006c790 0x7fe14014b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.088+0000 7fe1485c4700 1 -- 172.21.15.117:0/712888693 >> 172.21.15.117:0/712888693 conn(0x7fe1400bdc50 msgr2=0x7fe14013e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:49.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.088+0000 7fe1485c4700 1 -- 172.21.15.117:0/712888693 shutdown_connections 2023-07-19T20:44:49.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.088+0000 7fe1485c4700 1 -- 172.21.15.117:0/712888693 wait complete. 2023-07-19T20:44:49.095 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-19T20:44:49.218 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.224+0000 7fa124c05700 1 Processor -- start 2023-07-19T20:44:49.219 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.224+0000 7fa124c05700 1 -- start start 2023-07-19T20:44:49.221 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa124c05700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa1200bca00 0x7fa1200b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.221 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa124c05700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1200bd540 con 0x7fa12014ddd0 2023-07-19T20:44:49.221 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa124c05700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1200b8d70 con 0x7fa1200baa60 2023-07-19T20:44:49.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa124c05700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa120144ea0 con 0x7fa1200bca00 2023-07-19T20:44:49.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa11dd9b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa1200bca00 0x7fa1200b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa11ed9d700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa12014ddd0 0x7fa120155160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41370/0 (socket says 172.21.15.117:41370) 2023-07-19T20:44:49.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa11ed9d700 1 -- 172.21.15.117:0/3462431592 learned_addr learned my addr 172.21.15.117:0/3462431592 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:49.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa11dd9b700 1 -- 172.21.15.117:0/3462431592 >> v1:172.21.15.124:6789/0 conn(0x7fa1200baa60 legacy=0x7fa120144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa11dd9b700 1 -- 172.21.15.117:0/3462431592 >> v1:172.21.15.117:6789/0 conn(0x7fa12014ddd0 legacy=0x7fa120155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa11d59a700 1 -- 172.21.15.117:0/3462431592 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904647248 0 0) 0x7fa1200bd540 con 0x7fa12014ddd0 2023-07-19T20:44:49.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa11dd9b700 1 -- 172.21.15.117:0/3462431592 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200b8fe0 con 0x7fa1200bca00 2023-07-19T20:44:49.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa11dd9b700 1 --2- 172.21.15.117:0/3462431592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1200bca00 0x7fa1200b7f30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa110009840 tx=0x7fa110009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b11835fe94ac93a server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:49.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa11d59a700 1 -- 172.21.15.117:0/3462431592 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110011830 con 0x7fa1200bca00 2023-07-19T20:44:49.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa11d59a700 1 -- 172.21.15.117:0/3462431592 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa110011990 con 0x7fa1200bca00 2023-07-19T20:44:49.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.225+0000 7fa11d59a700 1 -- 172.21.15.117:0/3462431592 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110011d20 con 0x7fa1200bca00 2023-07-19T20:44:49.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.226+0000 7fa124c05700 1 -- 172.21.15.117:0/3462431592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1200bca00 msgr2=0x7fa1200b7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.226+0000 7fa124c05700 1 --2- 172.21.15.117:0/3462431592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1200bca00 0x7fa1200b7f30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa110009840 tx=0x7fa110009b50 comp rx=0 tx=0).stop 2023-07-19T20:44:49.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.226+0000 7fa124c05700 1 -- 172.21.15.117:0/3462431592 shutdown_connections 2023-07-19T20:44:49.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.226+0000 7fa124c05700 1 --2- 172.21.15.117:0/3462431592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1200bca00 0x7fa1200b7f30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.224 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.226+0000 7fa124c05700 1 -- 172.21.15.117:0/3462431592 >> 172.21.15.117:0/3462431592 conn(0x7fa120071c90 msgr2=0x7fa120072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:49.224 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.226+0000 7fa124c05700 1 -- 172.21.15.117:0/3462431592 shutdown_connections 2023-07-19T20:44:49.224 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.226+0000 7fa124c05700 1 -- 172.21.15.117:0/3462431592 wait complete. 2023-07-19T20:44:49.226 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.227+0000 7fa124c05700 1 Processor -- start 2023-07-19T20:44:49.226 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.227+0000 7fa124c05700 1 -- start start 2023-07-19T20:44:49.227 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa124c05700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa1200baa60 0x7fa1200a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.227 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa124c05700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1200bca00 0x7fa120146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.227 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa124c05700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa12014ddd0 0x7fa1201e0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.227 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa124c05700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa120146170 con 0x7fa12014ddd0 2023-07-19T20:44:49.227 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa124c05700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1200a6270 con 0x7fa1200bca00 2023-07-19T20:44:49.227 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa124c05700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1201d6500 con 0x7fa1200baa60 2023-07-19T20:44:49.228 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa11ed9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa12014ddd0 0x7fa1201e0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.228 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa11ed9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa12014ddd0 0x7fa1201e0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44022/0 (socket says 172.21.15.117:44022) 2023-07-19T20:44:49.228 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa11ed9d700 1 -- 172.21.15.117:0/1254469683 learned_addr learned my addr 172.21.15.117:0/1254469683 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:49.228 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa11dd9b700 1 --2- 172.21.15.117:0/1254469683 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1200bca00 0x7fa120146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.228 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa11e59c700 1 --2- 172.21.15.117:0/1254469683 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa1200baa60 0x7fa1200a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.228 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa11ed9d700 1 -- 172.21.15.117:0/1254469683 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa1200baa60 msgr2=0x7fa1200a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.228 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa11ed9d700 1 --2- 172.21.15.117:0/1254469683 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa1200baa60 0x7fa1200a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.229 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa11ed9d700 1 -- 172.21.15.117:0/1254469683 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1200bca00 msgr2=0x7fa120146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.229 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa11ed9d700 1 --2- 172.21.15.117:0/1254469683 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1200bca00 0x7fa120146400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.229 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa11ed9d700 1 -- 172.21.15.117:0/1254469683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1100094a0 con 0x7fa12014ddd0 2023-07-19T20:44:49.229 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.228+0000 7fa11ed9d700 1 --2- 172.21.15.117:0/1254469683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa12014ddd0 0x7fa1201e0a90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa11800cbd0 tx=0x7fa11800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:49.229 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.229+0000 7fa10effd700 1 -- 172.21.15.117:0/1254469683 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11800aac0 con 0x7fa12014ddd0 2023-07-19T20:44:49.229 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.229+0000 7fa10effd700 1 -- 172.21.15.117:0/1254469683 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11800ac40 con 0x7fa12014ddd0 2023-07-19T20:44:49.229 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.229+0000 7fa124c05700 1 -- 172.21.15.117:0/1254469683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa120145e90 con 0x7fa12014ddd0 2023-07-19T20:44:49.230 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.229+0000 7fa10effd700 1 -- 172.21.15.117:0/1254469683 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1180070d0 con 0x7fa12014ddd0 2023-07-19T20:44:49.230 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.229+0000 7fa124c05700 1 -- 172.21.15.117:0/1254469683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1200c18d0 con 0x7fa12014ddd0 2023-07-19T20:44:49.230 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.230+0000 7fa124c05700 1 -- 172.21.15.117:0/1254469683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1200b9800 con 0x7fa12014ddd0 2023-07-19T20:44:49.230 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.230+0000 7fa10effd700 1 -- 172.21.15.117:0/1254469683 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fa118007250 con 0x7fa12014ddd0 2023-07-19T20:44:49.230 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.230+0000 7fa10effd700 1 --2- 172.21.15.117:0/1254469683 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa10006a660 0x7fa10006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.231 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.230+0000 7fa10effd700 1 -- 172.21.15.117:0/1254469683 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa1180887f0 con 0x7fa12014ddd0 2023-07-19T20:44:49.231 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.230+0000 7fa11e59c700 1 --2- 172.21.15.117:0/1254469683 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa10006a660 0x7fa10006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.231 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.231+0000 7fa11e59c700 1 --2- 172.21.15.117:0/1254469683 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa10006a660 0x7fa10006cb10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa114000f60 tx=0x7fa114009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:49.231 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.235+0000 7fa10effd700 1 -- 172.21.15.117:0/1254469683 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fa118053c80 con 0x7fa12014ddd0 2023-07-19T20:44:49.412 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.417+0000 7fa124c05700 1 -- 172.21.15.117:0/1254469683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa120074890 con 0x7fa12014ddd0 2023-07-19T20:44:49.413 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.418+0000 7fa10effd700 1 -- 172.21.15.117:0/1254469683 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa1180572a0 con 0x7fa12014ddd0 2023-07-19T20:44:49.413 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2023-07-19T20:44:49.414 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.419+0000 7fa124c05700 1 -- 172.21.15.117:0/1254469683 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa10006a660 msgr2=0x7fa10006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.419+0000 7fa124c05700 1 --2- 172.21.15.117:0/1254469683 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa10006a660 0x7fa10006cb10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa114000f60 tx=0x7fa114009040 comp rx=0 tx=0).stop 2023-07-19T20:44:49.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.420+0000 7fa124c05700 1 -- 172.21.15.117:0/1254469683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa12014ddd0 msgr2=0x7fa1201e0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.420+0000 7fa124c05700 1 --2- 172.21.15.117:0/1254469683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa12014ddd0 0x7fa1201e0a90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa11800cbd0 tx=0x7fa11800cee0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.420+0000 7fa124c05700 1 -- 172.21.15.117:0/1254469683 shutdown_connections 2023-07-19T20:44:49.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.420+0000 7fa124c05700 1 --2- 172.21.15.117:0/1254469683 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa10006a660 0x7fa10006cb10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.420+0000 7fa124c05700 1 --2- 172.21.15.117:0/1254469683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa12014ddd0 0x7fa1201e0a90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.420+0000 7fa124c05700 1 --2- 172.21.15.117:0/1254469683 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa1200baa60 0x7fa1200a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.420+0000 7fa124c05700 1 --2- 172.21.15.117:0/1254469683 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1200bca00 0x7fa120146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.420+0000 7fa124c05700 1 -- 172.21.15.117:0/1254469683 >> 172.21.15.117:0/1254469683 conn(0x7fa120071c90 msgr2=0x7fa12014bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:49.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.420+0000 7fa124c05700 1 -- 172.21.15.117:0/1254469683 shutdown_connections 2023-07-19T20:44:49.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.420+0000 7fa124c05700 1 -- 172.21.15.117:0/1254469683 wait complete. 2023-07-19T20:44:49.426 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-19T20:44:49.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.556+0000 7f702c34b700 1 Processor -- start 2023-07-19T20:44:49.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.556+0000 7f702c34b700 1 -- start start 2023-07-19T20:44:49.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.557+0000 7f702c34b700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f702406d840 0x7f702414b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.557+0000 7f702c34b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f702414b8a0 0x7f702414bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.557+0000 7f702c34b700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702406cf40 con 0x7f70240bd1d0 2023-07-19T20:44:49.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.557+0000 7f702c34b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702414c200 con 0x7f702414b8a0 2023-07-19T20:44:49.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.557+0000 7f702c34b700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702406d360 con 0x7f702406d840 2023-07-19T20:44:49.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.557+0000 7f702a8e8700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f702414b8a0 0x7f702414bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.557+0000 7f702a8e8700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f702414b8a0 0x7f702414bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44024/0 (socket says 172.21.15.117:44024) 2023-07-19T20:44:49.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.557+0000 7f702a8e8700 1 -- 172.21.15.117:0/2577796598 learned_addr learned my addr 172.21.15.117:0/2577796598 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:49.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.557+0000 7f70298e6700 1 --2- 172.21.15.117:0/2577796598 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f702406d840 0x7f702414b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.557+0000 7f702a8e8700 1 -- 172.21.15.117:0/2577796598 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f702406d840 msgr2=0x7f702414b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:49.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.557+0000 7f702a8e8700 1 --2- 172.21.15.117:0/2577796598 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f702406d840 0x7f702414b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.557+0000 7f702a8e8700 1 -- 172.21.15.117:0/2577796598 >> v1:172.21.15.124:6789/0 conn(0x7f70240bd1d0 legacy=0x7f7024072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.558+0000 7f702a8e8700 1 -- 172.21.15.117:0/2577796598 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70240ba560 con 0x7f702414b8a0 2023-07-19T20:44:49.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.558+0000 7f70298e6700 1 --2- 172.21.15.117:0/2577796598 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f702406d840 0x7f702414b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:49.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.558+0000 7f702a8e8700 1 --2- 172.21.15.117:0/2577796598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702414b8a0 0x7f702414bcc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f701c00d150 tx=0x7f701c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d5beca9c6b1c08 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:49.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.558+0000 7f70290e5700 1 -- 172.21.15.117:0/2577796598 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c010070 con 0x7f702414b8a0 2023-07-19T20:44:49.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.558+0000 7f70290e5700 1 -- 172.21.15.117:0/2577796598 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701c00ddc0 con 0x7f702414b8a0 2023-07-19T20:44:49.556 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.558+0000 7f70290e5700 1 -- 172.21.15.117:0/2577796598 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c00b310 con 0x7f702414b8a0 2023-07-19T20:44:49.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.558+0000 7f702c34b700 1 -- 172.21.15.117:0/2577796598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702414b8a0 msgr2=0x7f702414bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.558+0000 7f702c34b700 1 --2- 172.21.15.117:0/2577796598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702414b8a0 0x7f702414bcc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f701c00d150 tx=0x7f701c00d460 comp rx=0 tx=0).stop 2023-07-19T20:44:49.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.558+0000 7f702c34b700 1 -- 172.21.15.117:0/2577796598 shutdown_connections 2023-07-19T20:44:49.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.558+0000 7f702c34b700 1 --2- 172.21.15.117:0/2577796598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702414b8a0 0x7f702414bcc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.558+0000 7f702c34b700 1 --2- 172.21.15.117:0/2577796598 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f702406d840 0x7f702414b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.558+0000 7f702c34b700 1 -- 172.21.15.117:0/2577796598 >> 172.21.15.117:0/2577796598 conn(0x7f702409f570 msgr2=0x7f702409f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:49.557 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.558+0000 7f702c34b700 1 -- 172.21.15.117:0/2577796598 shutdown_connections 2023-07-19T20:44:49.558 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.558+0000 7f702c34b700 1 -- 172.21.15.117:0/2577796598 wait complete. 2023-07-19T20:44:49.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.559+0000 7f702c34b700 1 Processor -- start 2023-07-19T20:44:49.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.559+0000 7f702c34b700 1 -- start start 2023-07-19T20:44:49.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702c34b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f702406d840 0x7f7024147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.560 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702c34b700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70240bd1d0 0x7f70240b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702c34b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702414b8a0 0x7f7024146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702c34b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7024071f20 con 0x7f702414b8a0 2023-07-19T20:44:49.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702c34b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70240b7130 con 0x7f702406d840 2023-07-19T20:44:49.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702c34b700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7024071b80 con 0x7f70240bd1d0 2023-07-19T20:44:49.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702a8e8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702414b8a0 0x7f7024146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702a8e8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702414b8a0 0x7f7024146650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44030/0 (socket says 172.21.15.117:44030) 2023-07-19T20:44:49.561 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702a8e8700 1 -- 172.21.15.117:0/3068748400 learned_addr learned my addr 172.21.15.117:0/3068748400 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:49.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702a0e7700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f702406d840 0x7f7024147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f70298e6700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70240bd1d0 0x7f70240b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702a8e8700 1 -- 172.21.15.117:0/3068748400 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70240bd1d0 msgr2=0x7f70240b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702a8e8700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70240bd1d0 0x7f70240b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702a8e8700 1 -- 172.21.15.117:0/3068748400 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f702406d840 msgr2=0x7f7024147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702a8e8700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f702406d840 0x7f7024147950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702a8e8700 1 -- 172.21.15.117:0/3068748400 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c00bd40 con 0x7f702414b8a0 2023-07-19T20:44:49.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f70298e6700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70240bd1d0 0x7f70240b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:49.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.560+0000 7f702a0e7700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f702406d840 0x7f7024147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:49.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.561+0000 7f702a8e8700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702414b8a0 0x7f7024146650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f70240a03a0 tx=0x7f701c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:49.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.561+0000 7f701affd700 1 -- 172.21.15.117:0/3068748400 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c00b4c0 con 0x7f702414b8a0 2023-07-19T20:44:49.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.561+0000 7f701affd700 1 -- 172.21.15.117:0/3068748400 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701c009810 con 0x7f702414b8a0 2023-07-19T20:44:49.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.561+0000 7f702c34b700 1 -- 172.21.15.117:0/3068748400 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7024145d90 con 0x7f702414b8a0 2023-07-19T20:44:49.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.561+0000 7f701affd700 1 -- 172.21.15.117:0/3068748400 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c009bc0 con 0x7f702414b8a0 2023-07-19T20:44:49.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.561+0000 7f702c34b700 1 -- 172.21.15.117:0/3068748400 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7024145820 con 0x7f702414b8a0 2023-07-19T20:44:49.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.562+0000 7f702c34b700 1 -- 172.21.15.117:0/3068748400 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7024067940 con 0x7f702414b8a0 2023-07-19T20:44:49.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.562+0000 7f701affd700 1 -- 172.21.15.117:0/3068748400 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f701c009d20 con 0x7f702414b8a0 2023-07-19T20:44:49.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.562+0000 7f701affd700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f700806a660 0x7f700806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.563+0000 7f701affd700 1 -- 172.21.15.117:0/3068748400 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f701c089fd0 con 0x7f702414b8a0 2023-07-19T20:44:49.565 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.563+0000 7f702a0e7700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f700806a660 0x7f700806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.565 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.563+0000 7f702a0e7700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f700806a660 0x7f700806cb10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7014000f60 tx=0x7f7014009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:49.566 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.567+0000 7f701affd700 1 -- 172.21.15.117:0/3068748400 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f701c055460 con 0x7f702414b8a0 2023-07-19T20:44:49.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.751+0000 7f702c34b700 1 -- 172.21.15.117:0/3068748400 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70240b8260 con 0x7f702414b8a0 2023-07-19T20:44:49.746 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.751+0000 7f701affd700 1 -- 172.21.15.117:0/3068748400 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f701c0220a0 con 0x7f702414b8a0 2023-07-19T20:44:49.746 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 64 2023-07-19T20:44:49.749 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.753+0000 7f702c34b700 1 -- 172.21.15.117:0/3068748400 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f700806a660 msgr2=0x7f700806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.749 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.753+0000 7f702c34b700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f700806a660 0x7f700806cb10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7014000f60 tx=0x7f7014009040 comp rx=0 tx=0).stop 2023-07-19T20:44:49.749 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.753+0000 7f702c34b700 1 -- 172.21.15.117:0/3068748400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702414b8a0 msgr2=0x7f7024146650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.753+0000 7f702c34b700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702414b8a0 0x7f7024146650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f70240a03a0 tx=0x7f701c004ad0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.754+0000 7f702c34b700 1 -- 172.21.15.117:0/3068748400 shutdown_connections 2023-07-19T20:44:49.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.754+0000 7f702c34b700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f700806a660 0x7f700806cb10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.754+0000 7f702c34b700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702414b8a0 0x7f7024146650 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.754+0000 7f702c34b700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f702406d840 0x7f7024147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.754+0000 7f702c34b700 1 --2- 172.21.15.117:0/3068748400 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70240bd1d0 0x7f70240b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.754+0000 7f702c34b700 1 -- 172.21.15.117:0/3068748400 >> 172.21.15.117:0/3068748400 conn(0x7f702409f570 msgr2=0x7f70240721a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:49.750 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.754+0000 7f702c34b700 1 -- 172.21.15.117:0/3068748400 shutdown_connections 2023-07-19T20:44:49.751 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.754+0000 7f702c34b700 1 -- 172.21.15.117:0/3068748400 wait complete. 2023-07-19T20:44:49.761 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-19T20:44:49.883 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.888+0000 7faa98ce7700 1 Processor -- start 2023-07-19T20:44:49.883 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.889+0000 7faa98ce7700 1 -- start start 2023-07-19T20:44:49.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa98ce7700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faa940b6dc0 0x7faa940b8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa98ce7700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7faa9414ad30 0x7faa941520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa98ce7700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa94141f60 con 0x7faa940b95e0 2023-07-19T20:44:49.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa98ce7700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa940719f0 con 0x7faa940b6dc0 2023-07-19T20:44:49.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa98ce7700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa9406bc80 con 0x7faa9414ad30 2023-07-19T20:44:49.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa9259c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faa940b6dc0 0x7faa940b8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa91d9b700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7faa940b95e0 0x7faa9406b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41374/0 (socket says 172.21.15.117:41374) 2023-07-19T20:44:49.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa91d9b700 1 -- 172.21.15.117:0/2427098867 learned_addr learned my addr 172.21.15.117:0/2427098867 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:49.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa92d9d700 1 --2- 172.21.15.117:0/2427098867 >> v2:172.21.15.124:3300/0 conn(0x7faa9414ad30 0x7faa941520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa9159a700 1 -- 172.21.15.117:0/2427098867 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431848381 0 0) 0x7faa94141f60 con 0x7faa940b95e0 2023-07-19T20:44:49.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa9159a700 1 -- 172.21.15.117:0/2427098867 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa7c0035b0 con 0x7faa940b95e0 2023-07-19T20:44:49.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa9259c700 1 -- 172.21.15.117:0/2427098867 >> v2:172.21.15.124:3300/0 conn(0x7faa9414ad30 msgr2=0x7faa941520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:49.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa9259c700 1 --2- 172.21.15.117:0/2427098867 >> v2:172.21.15.124:3300/0 conn(0x7faa9414ad30 0x7faa941520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa9259c700 1 -- 172.21.15.117:0/2427098867 >> v1:172.21.15.117:6789/0 conn(0x7faa940b95e0 legacy=0x7faa9406b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa9259c700 1 -- 172.21.15.117:0/2427098867 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa94070a50 con 0x7faa940b6dc0 2023-07-19T20:44:49.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa92d9d700 1 --2- 172.21.15.117:0/2427098867 >> v2:172.21.15.124:3300/0 conn(0x7faa9414ad30 0x7faa941520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:49.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.890+0000 7faa9259c700 1 --2- 172.21.15.117:0/2427098867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa940b6dc0 0x7faa940b8dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faa941488d0 tx=0x7faa84009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62899366e26fbe3 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:49.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.891+0000 7faa9159a700 1 -- 172.21.15.117:0/2427098867 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84011830 con 0x7faa940b6dc0 2023-07-19T20:44:49.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.891+0000 7faa9159a700 1 -- 172.21.15.117:0/2427098867 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa84011990 con 0x7faa940b6dc0 2023-07-19T20:44:49.888 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.891+0000 7faa9159a700 1 -- 172.21.15.117:0/2427098867 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84011d20 con 0x7faa940b6dc0 2023-07-19T20:44:49.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.891+0000 7faa98ce7700 1 -- 172.21.15.117:0/2427098867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa940b6dc0 msgr2=0x7faa940b8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.891+0000 7faa98ce7700 1 --2- 172.21.15.117:0/2427098867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa940b6dc0 0x7faa940b8dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faa941488d0 tx=0x7faa84009b20 comp rx=0 tx=0).stop 2023-07-19T20:44:49.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.891+0000 7faa98ce7700 1 -- 172.21.15.117:0/2427098867 shutdown_connections 2023-07-19T20:44:49.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.891+0000 7faa98ce7700 1 --2- 172.21.15.117:0/2427098867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa940b6dc0 0x7faa940b8dc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.891+0000 7faa98ce7700 1 --2- 172.21.15.117:0/2427098867 >> v2:172.21.15.124:3300/0 conn(0x7faa9414ad30 0x7faa941520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.891 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.891+0000 7faa98ce7700 1 -- 172.21.15.117:0/2427098867 >> 172.21.15.117:0/2427098867 conn(0x7faa940bdc00 msgr2=0x7faa940b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:49.891 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.891+0000 7faa98ce7700 1 -- 172.21.15.117:0/2427098867 shutdown_connections 2023-07-19T20:44:49.891 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.891+0000 7faa98ce7700 1 -- 172.21.15.117:0/2427098867 wait complete. 2023-07-19T20:44:49.891 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.893+0000 7faa98ce7700 1 Processor -- start 2023-07-19T20:44:49.891 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.893+0000 7faa98ce7700 1 -- start start 2023-07-19T20:44:49.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa98ce7700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa940b6dc0 0x7faa94146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa98ce7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa940b95e0 0x7faa94147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa98ce7700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa9414ad30 0x7faa940b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa98ce7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa94147110 con 0x7faa940b95e0 2023-07-19T20:44:49.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa98ce7700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa94145c90 con 0x7faa940b6dc0 2023-07-19T20:44:49.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa98ce7700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa94144df0 con 0x7faa9414ad30 2023-07-19T20:44:49.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa91d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa940b95e0 0x7faa94147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa91d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa940b95e0 0x7faa94147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44052/0 (socket says 172.21.15.117:44052) 2023-07-19T20:44:49.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa91d9b700 1 -- 172.21.15.117:0/3949339690 learned_addr learned my addr 172.21.15.117:0/3949339690 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:49.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa9259c700 1 --2- 172.21.15.117:0/3949339690 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa940b6dc0 0x7faa94146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa92d9d700 1 --2- 172.21.15.117:0/3949339690 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa9414ad30 0x7faa940b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa9259c700 1 -- 172.21.15.117:0/3949339690 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa9414ad30 msgr2=0x7faa940b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa9259c700 1 --2- 172.21.15.117:0/3949339690 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa9414ad30 0x7faa940b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa9259c700 1 -- 172.21.15.117:0/3949339690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa940b95e0 msgr2=0x7faa94147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:49.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa9259c700 1 --2- 172.21.15.117:0/3949339690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa940b95e0 0x7faa94147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:49.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa9259c700 1 -- 172.21.15.117:0/3949339690 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa840094a0 con 0x7faa940b6dc0 2023-07-19T20:44:49.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa9259c700 1 --2- 172.21.15.117:0/3949339690 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa940b6dc0 0x7faa94146bd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faa84016000 tx=0x7faa84004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:49.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.894+0000 7faa82ffd700 1 -- 172.21.15.117:0/3949339690 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840036a0 con 0x7faa940b6dc0 2023-07-19T20:44:49.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.895+0000 7faa82ffd700 1 -- 172.21.15.117:0/3949339690 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8401f070 con 0x7faa940b6dc0 2023-07-19T20:44:49.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.895+0000 7faa98ce7700 1 -- 172.21.15.117:0/3949339690 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa94145f50 con 0x7faa940b6dc0 2023-07-19T20:44:49.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.895+0000 7faa82ffd700 1 -- 172.21.15.117:0/3949339690 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84003a40 con 0x7faa940b6dc0 2023-07-19T20:44:49.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.895+0000 7faa98ce7700 1 -- 172.21.15.117:0/3949339690 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa94147f70 con 0x7faa940b6dc0 2023-07-19T20:44:49.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.895+0000 7faa98ce7700 1 -- 172.21.15.117:0/3949339690 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa94067940 con 0x7faa940b6dc0 2023-07-19T20:44:49.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.896+0000 7faa82ffd700 1 -- 172.21.15.117:0/3949339690 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7faa84003ba0 con 0x7faa940b6dc0 2023-07-19T20:44:49.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.896+0000 7faa82ffd700 1 --2- 172.21.15.117:0/3949339690 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faa7406a660 0x7faa7406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:49.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.896+0000 7faa82ffd700 1 -- 172.21.15.117:0/3949339690 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa84021070 con 0x7faa940b6dc0 2023-07-19T20:44:49.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.896+0000 7faa91d9b700 1 --2- 172.21.15.117:0/3949339690 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faa7406a660 0x7faa7406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:49.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.897+0000 7faa91d9b700 1 --2- 172.21.15.117:0/3949339690 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faa7406a660 0x7faa7406cb10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa941dbb30 tx=0x7faa88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:49.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:49.901+0000 7faa82ffd700 1 -- 172.21.15.117:0/3949339690 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7faa84055700 con 0x7faa940b6dc0 2023-07-19T20:44:50.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.129+0000 7faa98ce7700 1 -- 172.21.15.117:0/3949339690 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa94146740 con 0x7faa940b6dc0 2023-07-19T20:44:50.125 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.131+0000 7faa82ffd700 1 -- 172.21.15.117:0/3949339690 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3892 (secure 0 0 0) 0x7faa84058d20 con 0x7faa940b6dc0 2023-07-19T20:44:50.125 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:50.125 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6833/1121968339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":1121968339},{"type":"v1","addr":"172.21.15.124:6833","nonce":1121968339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3740070710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3740070710},{"type":"v1","addr":"172.21.15.117:6835","nonce":3740070710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-19T20:44:38.547955+0000","modified":"2023-07-19T20:44:41.558655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/479216080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":479216080},{"type":"v1","addr":"172.21.15.117:6837","nonce":479216080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-19T20:44:50.127 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.132+0000 7faa98ce7700 1 -- 172.21.15.117:0/3949339690 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faa7406a660 msgr2=0x7faa7406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.127 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.132+0000 7faa98ce7700 1 --2- 172.21.15.117:0/3949339690 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faa7406a660 0x7faa7406cb10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa941dbb30 tx=0x7faa88009040 comp rx=0 tx=0).stop 2023-07-19T20:44:50.127 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.132+0000 7faa98ce7700 1 -- 172.21.15.117:0/3949339690 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa940b6dc0 msgr2=0x7faa94146bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.132+0000 7faa98ce7700 1 --2- 172.21.15.117:0/3949339690 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa940b6dc0 0x7faa94146bd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faa84016000 tx=0x7faa84004750 comp rx=0 tx=0).stop 2023-07-19T20:44:50.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.133+0000 7faa98ce7700 1 -- 172.21.15.117:0/3949339690 shutdown_connections 2023-07-19T20:44:50.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.133+0000 7faa98ce7700 1 --2- 172.21.15.117:0/3949339690 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7faa7406a660 0x7faa7406cb10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.133+0000 7faa98ce7700 1 --2- 172.21.15.117:0/3949339690 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa9414ad30 0x7faa940b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.133+0000 7faa98ce7700 1 --2- 172.21.15.117:0/3949339690 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa940b6dc0 0x7faa94146bd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.133+0000 7faa98ce7700 1 --2- 172.21.15.117:0/3949339690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa940b95e0 0x7faa94147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.133+0000 7faa98ce7700 1 -- 172.21.15.117:0/3949339690 >> 172.21.15.117:0/3949339690 conn(0x7faa940bdc00 msgr2=0x7faa940bb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:50.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.133+0000 7faa98ce7700 1 -- 172.21.15.117:0/3949339690 shutdown_connections 2023-07-19T20:44:50.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.133+0000 7faa98ce7700 1 -- 172.21.15.117:0/3949339690 wait complete. 2023-07-19T20:44:50.130 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 8 2023-07-19T20:44:50.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.267+0000 7f0100007700 1 Processor -- start 2023-07-19T20:44:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.267+0000 7f0100007700 1 -- start start 2023-07-19T20:44:50.264 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.268+0000 7f0100007700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00f8154260 0x7f00f8156640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.264 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.268+0000 7f0100007700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f80bcd00 con 0x7f00f80c1470 2023-07-19T20:44:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.268+0000 7f0100007700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f80b8bd0 con 0x7f00f8149f50 2023-07-19T20:44:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.268+0000 7f0100007700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f80b8710 con 0x7f00f8154260 2023-07-19T20:44:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.268+0000 7f00fe5a4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00f8154260 0x7f00f8156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.268+0000 7f00fdda3700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f00f80c1470 0x7f00f80b8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41380/0 (socket says 172.21.15.117:41380) 2023-07-19T20:44:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.268+0000 7f00fe5a4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00f8154260 0x7f00f8156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44058/0 (socket says 172.21.15.117:44058) 2023-07-19T20:44:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.268+0000 7f00fdda3700 1 -- 172.21.15.117:0/3021488247 learned_addr learned my addr 172.21.15.117:0/3021488247 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f00fe5a4700 1 -- 172.21.15.117:0/3021488247 >> v1:172.21.15.124:6789/0 conn(0x7f00f8149f50 legacy=0x7f00f814a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f00fe5a4700 1 -- 172.21.15.117:0/3021488247 >> v1:172.21.15.117:6789/0 conn(0x7f00f80c1470 legacy=0x7f00f80b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f00fcda1700 1 -- 172.21.15.117:0/3021488247 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646832091 0 0) 0x7f00f80bcd00 con 0x7f00f80c1470 2023-07-19T20:44:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f00fe5a4700 1 -- 172.21.15.117:0/3021488247 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80bab50 con 0x7f00f8154260 2023-07-19T20:44:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f00fe5a4700 1 --2- 172.21.15.117:0/3021488247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00f8154260 0x7f00f8156640 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009d90 tx=0x7f00f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ae0ed355e6db87 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f00fcda1700 1 -- 172.21.15.117:0/3021488247 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f000e070 con 0x7f00f8154260 2023-07-19T20:44:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f00fcda1700 1 -- 172.21.15.117:0/3021488247 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f000bb90 con 0x7f00f8154260 2023-07-19T20:44:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f00fcda1700 1 -- 172.21.15.117:0/3021488247 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0003a20 con 0x7f00f8154260 2023-07-19T20:44:50.269 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f0100007700 1 -- 172.21.15.117:0/3021488247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00f8154260 msgr2=0x7f00f8156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.269 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f0100007700 1 --2- 172.21.15.117:0/3021488247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00f8154260 0x7f00f8156640 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009d90 tx=0x7f00f000b330 comp rx=0 tx=0).stop 2023-07-19T20:44:50.269 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f0100007700 1 -- 172.21.15.117:0/3021488247 shutdown_connections 2023-07-19T20:44:50.269 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f0100007700 1 --2- 172.21.15.117:0/3021488247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00f8154260 0x7f00f8156640 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.270 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f0100007700 1 -- 172.21.15.117:0/3021488247 >> 172.21.15.117:0/3021488247 conn(0x7f00f8072920 msgr2=0x7f00f80c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:50.270 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f0100007700 1 -- 172.21.15.117:0/3021488247 shutdown_connections 2023-07-19T20:44:50.270 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.269+0000 7f0100007700 1 -- 172.21.15.117:0/3021488247 wait complete. 2023-07-19T20:44:50.275 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.270+0000 7f0100007700 1 Processor -- start 2023-07-19T20:44:50.275 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.270+0000 7f0100007700 1 -- start start 2023-07-19T20:44:50.275 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f0100007700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00f80c1470 0x7f00f814fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.275 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f0100007700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00f8149f50 0x7f00f814e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f0100007700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00f8154260 0x7f00f81e3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f0100007700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f814bb20 con 0x7f00f80c1470 2023-07-19T20:44:50.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f0100007700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f814e470 con 0x7f00f8154260 2023-07-19T20:44:50.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f0100007700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f8151720 con 0x7f00f8149f50 2023-07-19T20:44:50.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f00fdda3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00f80c1470 0x7f00f814fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f00fdda3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00f80c1470 0x7f00f814fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44064/0 (socket says 172.21.15.117:44064) 2023-07-19T20:44:50.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f00fdda3700 1 -- 172.21.15.117:0/1390244724 learned_addr learned my addr 172.21.15.117:0/1390244724 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:50.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f00fe5a4700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00f8154260 0x7f00f81e3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f00fd5a2700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00f8149f50 0x7f00f814e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f00fdda3700 1 -- 172.21.15.117:0/1390244724 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00f8149f50 msgr2=0x7f00f814e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f00fdda3700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00f8149f50 0x7f00f814e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f00fdda3700 1 -- 172.21.15.117:0/1390244724 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00f8154260 msgr2=0x7f00f81e3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f00fdda3700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00f8154260 0x7f00f81e3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f00fdda3700 1 -- 172.21.15.117:0/1390244724 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f0009a70 con 0x7f00f80c1470 2023-07-19T20:44:50.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.271+0000 7f00fe5a4700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00f8154260 0x7f00f81e3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:50.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.272+0000 7f00fdda3700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00f80c1470 0x7f00f814fd20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f00e80011e0 tx=0x7f00e800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:50.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.272+0000 7f00ee7fc700 1 -- 172.21.15.117:0/1390244724 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8004c80 con 0x7f00f80c1470 2023-07-19T20:44:50.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.272+0000 7f00ee7fc700 1 -- 172.21.15.117:0/1390244724 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e8004e00 con 0x7f00f80c1470 2023-07-19T20:44:50.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.272+0000 7f0100007700 1 -- 172.21.15.117:0/1390244724 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f814f400 con 0x7f00f80c1470 2023-07-19T20:44:50.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.272+0000 7f00ee7fc700 1 -- 172.21.15.117:0/1390244724 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8007310 con 0x7f00f80c1470 2023-07-19T20:44:50.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.272+0000 7f0100007700 1 -- 172.21.15.117:0/1390244724 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f8150260 con 0x7f00f80c1470 2023-07-19T20:44:50.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.273+0000 7f0100007700 1 -- 172.21.15.117:0/1390244724 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f8074890 con 0x7f00f80c1470 2023-07-19T20:44:50.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.273+0000 7f00ee7fc700 1 -- 172.21.15.117:0/1390244724 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f00e8007470 con 0x7f00f80c1470 2023-07-19T20:44:50.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.273+0000 7f00ee7fc700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f00dc06a660 0x7f00dc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.274+0000 7f00ee7fc700 1 -- 172.21.15.117:0/1390244724 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00e8088840 con 0x7f00f80c1470 2023-07-19T20:44:50.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.274+0000 7f00fd5a2700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f00dc06a660 0x7f00dc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.274+0000 7f00fd5a2700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f00dc06a660 0x7f00dc06cb10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f00f8149520 tx=0x7f00f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:50.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.278+0000 7f00ee7fc700 1 -- 172.21.15.117:0/1390244724 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f00e8053c40 con 0x7f00f80c1470 2023-07-19T20:44:50.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.466+0000 7f0100007700 1 -- 172.21.15.117:0/1390244724 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00f80bece0 con 0x7f00f80c1470 2023-07-19T20:44:50.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.467+0000 7f00ee7fc700 1 -- 172.21.15.117:0/1390244724 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17897 (secure 0 0 0) 0x7f00e8057260 con 0x7f00f80c1470 2023-07-19T20:44:50.462 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:50.462 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:39.549566+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:50.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.469+0000 7f0100007700 1 -- 172.21.15.117:0/1390244724 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f00dc06a660 msgr2=0x7f00dc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.469+0000 7f0100007700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f00dc06a660 0x7f00dc06cb10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f00f8149520 tx=0x7f00f4009040 comp rx=0 tx=0).stop 2023-07-19T20:44:50.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.469+0000 7f0100007700 1 -- 172.21.15.117:0/1390244724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00f80c1470 msgr2=0x7f00f814fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.469+0000 7f0100007700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00f80c1470 0x7f00f814fd20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f00e80011e0 tx=0x7f00e800cae0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.469+0000 7f0100007700 1 -- 172.21.15.117:0/1390244724 shutdown_connections 2023-07-19T20:44:50.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.469+0000 7f0100007700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f00dc06a660 0x7f00dc06cb10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.469+0000 7f0100007700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00f8154260 0x7f00f81e3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.469+0000 7f0100007700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00f80c1470 0x7f00f814fd20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.469+0000 7f0100007700 1 --2- 172.21.15.117:0/1390244724 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00f8149f50 0x7f00f814e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.469+0000 7f0100007700 1 -- 172.21.15.117:0/1390244724 >> 172.21.15.117:0/1390244724 conn(0x7f00f8072920 msgr2=0x7f00f80bf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:50.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.469+0000 7f0100007700 1 -- 172.21.15.117:0/1390244724 shutdown_connections 2023-07-19T20:44:50.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.469+0000 7f0100007700 1 -- 172.21.15.117:0/1390244724 wait complete. 2023-07-19T20:44:50.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-19T20:44:31.325778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-19T20:44:31.728215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-19T20:44:36.280405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-19T20:44:37.509195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-19T20:44:50.478 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-19T20:44:50.607 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.607+0000 7f097eee7700 1 Processor -- start 2023-07-19T20:44:50.608 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.607+0000 7f097eee7700 1 -- start start 2023-07-19T20:44:50.615 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.608+0000 7f097eee7700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0978142b90 0x7f0978072490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.616 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.608+0000 7f097eee7700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09780a05f0 0x7f097814bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.616 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.608+0000 7f097eee7700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0978142f60 con 0x7f09780a0a60 2023-07-19T20:44:50.616 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.608+0000 7f097eee7700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09780bdda0 con 0x7f0978142b90 2023-07-19T20:44:50.617 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.608+0000 7f097eee7700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09780bca10 con 0x7f09780a05f0 2023-07-19T20:44:50.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.608+0000 7f0977fff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09780a05f0 0x7f097814bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.608+0000 7f097cc83700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0978142b90 0x7f0978072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.608+0000 7f097cc83700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0978142b90 0x7f0978072490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:58498/0 (socket says 172.21.15.117:58498) 2023-07-19T20:44:50.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.608+0000 7f097cc83700 1 -- 172.21.15.117:0/1285101350 learned_addr learned my addr 172.21.15.117:0/1285101350 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:50.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.608+0000 7f0977fff700 1 --2- 172.21.15.117:0/1285101350 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09780a05f0 0x7f097814bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:40130/0 (socket says 172.21.15.117:40130) 2023-07-19T20:44:50.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.608+0000 7f097d484700 1 --1- 172.21.15.117:0/1285101350 >> v1:172.21.15.124:6789/0 conn(0x7f09780a0a60 0x7f0978070e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.117:34486/0 (socket says 172.21.15.117:34486) 2023-07-19T20:44:50.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.609+0000 7f097cc83700 1 -- 172.21.15.117:0/1285101350 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09780a05f0 msgr2=0x7f097814bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:50.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.609+0000 7f097cc83700 1 --2- 172.21.15.117:0/1285101350 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09780a05f0 0x7f097814bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.609+0000 7f097cc83700 1 -- 172.21.15.117:0/1285101350 >> v1:172.21.15.124:6789/0 conn(0x7f09780a0a60 legacy=0x7f0978070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.609+0000 7f097cc83700 1 -- 172.21.15.117:0/1285101350 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09780bf620 con 0x7f0978142b90 2023-07-19T20:44:50.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.609+0000 7f0977fff700 1 --2- 172.21.15.117:0/1285101350 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09780a05f0 0x7f097814bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:50.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.609+0000 7f097cc83700 1 --2- 172.21.15.117:0/1285101350 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0978142b90 0x7f0978072490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f096c0098f0 tx=0x7f096c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d97154c7d9284958 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:50.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.609+0000 7f09777fe700 1 -- 172.21.15.117:0/1285101350 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c011830 con 0x7f0978142b90 2023-07-19T20:44:50.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.609+0000 7f09777fe700 1 -- 172.21.15.117:0/1285101350 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c011990 con 0x7f0978142b90 2023-07-19T20:44:50.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.609+0000 7f09777fe700 1 -- 172.21.15.117:0/1285101350 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c011d20 con 0x7f0978142b90 2023-07-19T20:44:50.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.609+0000 7f097eee7700 1 -- 172.21.15.117:0/1285101350 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0978142b90 msgr2=0x7f0978072490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.609+0000 7f097eee7700 1 --2- 172.21.15.117:0/1285101350 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0978142b90 0x7f0978072490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f096c0098f0 tx=0x7f096c009c00 comp rx=0 tx=0).stop 2023-07-19T20:44:50.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.610+0000 7f097eee7700 1 -- 172.21.15.117:0/1285101350 shutdown_connections 2023-07-19T20:44:50.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.610+0000 7f097eee7700 1 --2- 172.21.15.117:0/1285101350 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0978142b90 0x7f0978072490 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.610+0000 7f097eee7700 1 --2- 172.21.15.117:0/1285101350 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09780a05f0 0x7f097814bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.610+0000 7f097eee7700 1 -- 172.21.15.117:0/1285101350 >> 172.21.15.117:0/1285101350 conn(0x7f09780bea10 msgr2=0x7f09780bee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:50.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.610+0000 7f097eee7700 1 -- 172.21.15.117:0/1285101350 shutdown_connections 2023-07-19T20:44:50.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.610+0000 7f097eee7700 1 -- 172.21.15.117:0/1285101350 wait complete. 2023-07-19T20:44:50.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.611+0000 7f097eee7700 1 Processor -- start 2023-07-19T20:44:50.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.611+0000 7f097eee7700 1 -- start start 2023-07-19T20:44:50.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.611+0000 7f097eee7700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09780a05f0 0x7f09780a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.611+0000 7f097eee7700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09780a0a60 0x7f09780a2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.611+0000 7f097eee7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0978142b90 0x7f09780a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.611+0000 7f097eee7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09780a3390 con 0x7f0978142b90 2023-07-19T20:44:50.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.611+0000 7f097eee7700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09780a4200 con 0x7f09780a0a60 2023-07-19T20:44:50.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.611+0000 7f097eee7700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09781dec40 con 0x7f09780a05f0 2023-07-19T20:44:50.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f097d484700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0978142b90 0x7f09780a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f097d484700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0978142b90 0x7f09780a1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44068/0 (socket says 172.21.15.117:44068) 2023-07-19T20:44:50.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f097d484700 1 -- 172.21.15.117:0/91570015 learned_addr learned my addr 172.21.15.117:0/91570015 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:50.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f0977fff700 1 --2- 172.21.15.117:0/91570015 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09780a0a60 0x7f09780a2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f097cc83700 1 --2- 172.21.15.117:0/91570015 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09780a05f0 0x7f09780a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f097d484700 1 -- 172.21.15.117:0/91570015 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09780a05f0 msgr2=0x7f09780a3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f097d484700 1 --2- 172.21.15.117:0/91570015 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09780a05f0 0x7f09780a3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f097d484700 1 -- 172.21.15.117:0/91570015 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09780a0a60 msgr2=0x7f09780a2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f097d484700 1 --2- 172.21.15.117:0/91570015 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09780a0a60 0x7f09780a2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f097d484700 1 -- 172.21.15.117:0/91570015 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09640094a0 con 0x7f0978142b90 2023-07-19T20:44:50.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f097d484700 1 --2- 172.21.15.117:0/91570015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0978142b90 0x7f09780a1ca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f097000cbd0 tx=0x7f097000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:50.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f09757fa700 1 -- 172.21.15.117:0/91570015 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097000abb0 con 0x7f0978142b90 2023-07-19T20:44:50.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f09757fa700 1 -- 172.21.15.117:0/91570015 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097000ad10 con 0x7f0978142b90 2023-07-19T20:44:50.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f097eee7700 1 -- 172.21.15.117:0/91570015 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f096c009550 con 0x7f0978142b90 2023-07-19T20:44:50.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f09757fa700 1 -- 172.21.15.117:0/91570015 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970007270 con 0x7f0978142b90 2023-07-19T20:44:50.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.612+0000 7f097eee7700 1 -- 172.21.15.117:0/91570015 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09781df200 con 0x7f0978142b90 2023-07-19T20:44:50.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.613+0000 7f097eee7700 1 -- 172.21.15.117:0/91570015 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097813f660 con 0x7f0978142b90 2023-07-19T20:44:50.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.614+0000 7f09757fa700 1 -- 172.21.15.117:0/91570015 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f09700073d0 con 0x7f0978142b90 2023-07-19T20:44:50.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.614+0000 7f09757fa700 1 --2- 172.21.15.117:0/91570015 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f095c06a660 0x7f095c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.614+0000 7f09757fa700 1 -- 172.21.15.117:0/91570015 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09700887f0 con 0x7f0978142b90 2023-07-19T20:44:50.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.614+0000 7f097cc83700 1 --2- 172.21.15.117:0/91570015 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f095c06a660 0x7f095c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.614+0000 7f097cc83700 1 --2- 172.21.15.117:0/91570015 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f095c06a660 0x7f095c06cb10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f096c014040 tx=0x7f096c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:50.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.618+0000 7f09757fa700 1 -- 172.21.15.117:0/91570015 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f097004c2c0 con 0x7f0978142b90 2023-07-19T20:44:50.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.806+0000 7f097eee7700 1 -- 172.21.15.117:0/91570015 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f097806e300 con 0x7f0978142b90 2023-07-19T20:44:50.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.806+0000 7f09757fa700 1 -- 172.21.15.117:0/91570015 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f09700170a0 con 0x7f0978142b90 2023-07-19T20:44:50.802 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 8 2023-07-19T20:44:50.804 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.808+0000 7f097eee7700 1 -- 172.21.15.117:0/91570015 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f095c06a660 msgr2=0x7f095c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.804 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.808+0000 7f097eee7700 1 --2- 172.21.15.117:0/91570015 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f095c06a660 0x7f095c06cb10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f096c014040 tx=0x7f096c008030 comp rx=0 tx=0).stop 2023-07-19T20:44:50.805 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.808+0000 7f097eee7700 1 -- 172.21.15.117:0/91570015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0978142b90 msgr2=0x7f09780a1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.805 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.808+0000 7f097eee7700 1 --2- 172.21.15.117:0/91570015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0978142b90 0x7f09780a1ca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f097000cbd0 tx=0x7f097000cf90 comp rx=0 tx=0).stop 2023-07-19T20:44:50.805 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.808+0000 7f097eee7700 1 -- 172.21.15.117:0/91570015 shutdown_connections 2023-07-19T20:44:50.806 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.808+0000 7f097eee7700 1 --2- 172.21.15.117:0/91570015 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f095c06a660 0x7f095c06cb10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.806 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.808+0000 7f097eee7700 1 --2- 172.21.15.117:0/91570015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0978142b90 0x7f09780a1ca0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.806 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.808+0000 7f097eee7700 1 --2- 172.21.15.117:0/91570015 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09780a05f0 0x7f09780a3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.808+0000 7f097eee7700 1 --2- 172.21.15.117:0/91570015 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09780a0a60 0x7f09780a2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.808+0000 7f097eee7700 1 -- 172.21.15.117:0/91570015 >> 172.21.15.117:0/91570015 conn(0x7f09780bea10 msgr2=0x7f09781411b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.808+0000 7f097eee7700 1 -- 172.21.15.117:0/91570015 shutdown_connections 2023-07-19T20:44:50.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.808+0000 7f097eee7700 1 -- 172.21.15.117:0/91570015 wait complete. 2023-07-19T20:44:50.815 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-19T20:44:50.938 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.944+0000 7f84943c7700 1 Processor -- start 2023-07-19T20:44:50.939 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.944+0000 7f84943c7700 1 -- start start 2023-07-19T20:44:50.941 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f84943c7700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f848c144b40 0x7f848c06b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.941 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f84943c7700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f848c0b9680 0x7f848c14a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f84943c7700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f848c14af20 0x7f848c14de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f84943c7700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c14b3c0 con 0x7f848c0b9680 2023-07-19T20:44:50.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f84943c7700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c09e6b0 con 0x7f848c14af20 2023-07-19T20:44:50.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f84943c7700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c09e360 con 0x7f848c144b40 2023-07-19T20:44:50.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f8491962700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f848c0b9680 0x7f848c14a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f8491962700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f848c0b9680 0x7f848c14a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44072/0 (socket says 172.21.15.117:44072) 2023-07-19T20:44:50.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f8491962700 1 -- 172.21.15.117:0/3367589234 learned_addr learned my addr 172.21.15.117:0/3367589234 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:50.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f8492964700 1 --2- 172.21.15.117:0/3367589234 >> v2:172.21.15.124:3300/0 conn(0x7f848c14af20 0x7f848c14de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f8492163700 1 --2- 172.21.15.117:0/3367589234 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f848c144b40 0x7f848c06b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f8491962700 1 -- 172.21.15.117:0/3367589234 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f848c144b40 msgr2=0x7f848c06b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:50.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f8491962700 1 --2- 172.21.15.117:0/3367589234 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f848c144b40 0x7f848c06b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f8491962700 1 -- 172.21.15.117:0/3367589234 >> v2:172.21.15.124:3300/0 conn(0x7f848c14af20 msgr2=0x7f848c14de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:50.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f8491962700 1 --2- 172.21.15.117:0/3367589234 >> v2:172.21.15.124:3300/0 conn(0x7f848c14af20 0x7f848c14de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f8491962700 1 -- 172.21.15.117:0/3367589234 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c09fa50 con 0x7f848c0b9680 2023-07-19T20:44:50.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f8492964700 1 --2- 172.21.15.117:0/3367589234 >> v2:172.21.15.124:3300/0 conn(0x7f848c14af20 0x7f848c14de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:50.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.945+0000 7f8492163700 1 --2- 172.21.15.117:0/3367589234 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f848c144b40 0x7f848c06b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:50.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.946+0000 7f8491962700 1 --2- 172.21.15.117:0/3367589234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848c0b9680 0x7f848c14a9e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f848c066bc0 tx=0x7f847c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8915a06b31597816 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:50.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.946+0000 7f8491161700 1 -- 172.21.15.117:0/3367589234 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847c00b860 con 0x7f848c0b9680 2023-07-19T20:44:50.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.946+0000 7f8491161700 1 -- 172.21.15.117:0/3367589234 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847c00b9c0 con 0x7f848c0b9680 2023-07-19T20:44:50.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.946+0000 7f8491161700 1 -- 172.21.15.117:0/3367589234 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847c00bd50 con 0x7f848c0b9680 2023-07-19T20:44:50.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.946+0000 7f84943c7700 1 -- 172.21.15.117:0/3367589234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848c0b9680 msgr2=0x7f848c14a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.946+0000 7f84943c7700 1 --2- 172.21.15.117:0/3367589234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848c0b9680 0x7f848c14a9e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f848c066bc0 tx=0x7f847c009c00 comp rx=0 tx=0).stop 2023-07-19T20:44:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.946+0000 7f84943c7700 1 -- 172.21.15.117:0/3367589234 shutdown_connections 2023-07-19T20:44:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.946+0000 7f84943c7700 1 --2- 172.21.15.117:0/3367589234 >> v2:172.21.15.124:3300/0 conn(0x7f848c14af20 0x7f848c14de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.946+0000 7f84943c7700 1 --2- 172.21.15.117:0/3367589234 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f848c144b40 0x7f848c06b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.946+0000 7f84943c7700 1 --2- 172.21.15.117:0/3367589234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848c0b9680 0x7f848c14a9e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.946+0000 7f84943c7700 1 -- 172.21.15.117:0/3367589234 >> 172.21.15.117:0/3367589234 conn(0x7f848c0bdc50 msgr2=0x7f848c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.946+0000 7f84943c7700 1 -- 172.21.15.117:0/3367589234 shutdown_connections 2023-07-19T20:44:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.946+0000 7f84943c7700 1 -- 172.21.15.117:0/3367589234 wait complete. 2023-07-19T20:44:50.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.948+0000 7f84943c7700 1 Processor -- start 2023-07-19T20:44:50.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.948+0000 7f84943c7700 1 -- start start 2023-07-19T20:44:50.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.948+0000 7f84943c7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848c0b9680 0x7f848c070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.948+0000 7f84943c7700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f848c144b40 0x7f848c0a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f84943c7700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f848c14af20 0x7f848c1d7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f84943c7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c0a2980 con 0x7f848c0b9680 2023-07-19T20:44:50.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f84943c7700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c0a2770 con 0x7f848c144b40 2023-07-19T20:44:50.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f84943c7700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c070aa0 con 0x7f848c14af20 2023-07-19T20:44:50.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f8492163700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848c0b9680 0x7f848c070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f8492163700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848c0b9680 0x7f848c070ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44074/0 (socket says 172.21.15.117:44074) 2023-07-19T20:44:50.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f8492163700 1 -- 172.21.15.117:0/2479643229 learned_addr learned my addr 172.21.15.117:0/2479643229 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:50.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f8492964700 1 --2- 172.21.15.117:0/2479643229 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f848c14af20 0x7f848c1d7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f8491962700 1 --2- 172.21.15.117:0/2479643229 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f848c144b40 0x7f848c0a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f8492163700 1 -- 172.21.15.117:0/2479643229 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f848c14af20 msgr2=0x7f848c1d7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.951 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f8492163700 1 --2- 172.21.15.117:0/2479643229 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f848c14af20 0x7f848c1d7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.951 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f8492163700 1 -- 172.21.15.117:0/2479643229 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f848c144b40 msgr2=0x7f848c0a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:50.951 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f8492163700 1 --2- 172.21.15.117:0/2479643229 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f848c144b40 0x7f848c0a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:50.951 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f8492163700 1 -- 172.21.15.117:0/2479643229 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847c009550 con 0x7f848c0b9680 2023-07-19T20:44:50.951 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f8492163700 1 --2- 172.21.15.117:0/2479643229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848c0b9680 0x7f848c070ec0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f848800c750 tx=0x7f848800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:50.951 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f8482ffd700 1 -- 172.21.15.117:0/2479643229 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488011800 con 0x7f848c0b9680 2023-07-19T20:44:50.951 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f8482ffd700 1 -- 172.21.15.117:0/2479643229 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8488011960 con 0x7f848c0b9680 2023-07-19T20:44:50.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f84943c7700 1 -- 172.21.15.117:0/2479643229 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848c1e33e0 con 0x7f848c0b9680 2023-07-19T20:44:50.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f8482ffd700 1 -- 172.21.15.117:0/2479643229 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488011cd0 con 0x7f848c0b9680 2023-07-19T20:44:50.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.949+0000 7f84943c7700 1 -- 172.21.15.117:0/2479643229 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848c0707c0 con 0x7f848c0b9680 2023-07-19T20:44:50.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.950+0000 7f84943c7700 1 -- 172.21.15.117:0/2479643229 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848c09ee40 con 0x7f848c0b9680 2023-07-19T20:44:50.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.951+0000 7f8482ffd700 1 -- 172.21.15.117:0/2479643229 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f8488021350 con 0x7f848c0b9680 2023-07-19T20:44:50.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.951+0000 7f8482ffd700 1 --2- 172.21.15.117:0/2479643229 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f847006a660 0x7f847006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:50.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.951+0000 7f8491962700 1 --2- 172.21.15.117:0/2479643229 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f847006a660 0x7f847006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:50.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.951+0000 7f8482ffd700 1 -- 172.21.15.117:0/2479643229 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84880889f0 con 0x7f848c0b9680 2023-07-19T20:44:50.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.951+0000 7f8491962700 1 --2- 172.21.15.117:0/2479643229 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f847006a660 0x7f847006cb10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f848c066bc0 tx=0x7f847c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:50.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:50.955+0000 7f8482ffd700 1 -- 172.21.15.117:0/2479643229 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f8488057910 con 0x7f848c0b9680 2023-07-19T20:44:51.133 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.138+0000 7f84943c7700 1 -- 172.21.15.117:0/2479643229 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f848c1e35d0 con 0x7f848c0b9680 2023-07-19T20:44:51.133 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.138+0000 7f8482ffd700 1 -- 172.21.15.117:0/2479643229 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84880574a0 con 0x7f848c0b9680 2023-07-19T20:44:51.134 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2023-07-19T20:44:51.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.140+0000 7f84943c7700 1 -- 172.21.15.117:0/2479643229 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f847006a660 msgr2=0x7f847006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.140+0000 7f84943c7700 1 --2- 172.21.15.117:0/2479643229 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f847006a660 0x7f847006cb10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f848c066bc0 tx=0x7f847c008030 comp rx=0 tx=0).stop 2023-07-19T20:44:51.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.140+0000 7f84943c7700 1 -- 172.21.15.117:0/2479643229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848c0b9680 msgr2=0x7f848c070ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.140+0000 7f84943c7700 1 --2- 172.21.15.117:0/2479643229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848c0b9680 0x7f848c070ec0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f848800c750 tx=0x7f848800cb10 comp rx=0 tx=0).stop 2023-07-19T20:44:51.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.141+0000 7f84943c7700 1 -- 172.21.15.117:0/2479643229 shutdown_connections 2023-07-19T20:44:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.141+0000 7f84943c7700 1 --2- 172.21.15.117:0/2479643229 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f847006a660 0x7f847006cb10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.141+0000 7f84943c7700 1 --2- 172.21.15.117:0/2479643229 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f848c14af20 0x7f848c1d7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.141+0000 7f84943c7700 1 --2- 172.21.15.117:0/2479643229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848c0b9680 0x7f848c070ec0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.141+0000 7f84943c7700 1 --2- 172.21.15.117:0/2479643229 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f848c144b40 0x7f848c0a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.141+0000 7f84943c7700 1 -- 172.21.15.117:0/2479643229 >> 172.21.15.117:0/2479643229 conn(0x7f848c0bdc50 msgr2=0x7f848c0b76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.141+0000 7f84943c7700 1 -- 172.21.15.117:0/2479643229 shutdown_connections 2023-07-19T20:44:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.141+0000 7f84943c7700 1 -- 172.21.15.117:0/2479643229 wait complete. 2023-07-19T20:44:51.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-19T20:44:51.273 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.278+0000 7fbcb321c700 1 Processor -- start 2023-07-19T20:44:51.273 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.278+0000 7fbcb321c700 1 -- start start 2023-07-19T20:44:51.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.279+0000 7fbcb321c700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbcac06a930 0x7fbcac1562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.279+0000 7fbcb321c700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcac0b8490 con 0x7fbcac06a560 2023-07-19T20:44:51.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.279+0000 7fbcb321c700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcac0b9ab0 con 0x7fbcac0a2b60 2023-07-19T20:44:51.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.279+0000 7fbcb321c700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0bcda0 con 0x7fbcac06a930 2023-07-19T20:44:51.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.279+0000 7fbcb0fb8700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fbcac06a560 0x7fbcac0a0970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41388/0 (socket says 172.21.15.117:41388) 2023-07-19T20:44:51.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.279+0000 7fbcb0fb8700 1 -- 172.21.15.117:0/3885478113 learned_addr learned my addr 172.21.15.117:0/3885478113 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:51.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.279+0000 7fbcb17b9700 1 --2- 172.21.15.117:0/3885478113 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbcac06a930 0x7fbcac1562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.279+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718386105 0 0) 0x7fbcac0b8490 con 0x7fbcac06a560 2023-07-19T20:44:51.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc9c0035b0 con 0x7fbcac06a560 2023-07-19T20:44:51.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457836544 0 0) 0x7fbcac0b9ab0 con 0x7fbcac0a2b60 2023-07-19T20:44:51.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcac0b8490 con 0x7fbcac0a2b60 2023-07-19T20:44:51.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2128970114 0 0) 0x7fbc9c0035b0 con 0x7fbcac06a560 2023-07-19T20:44:51.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbcac06a930 msgr2=0x7fbcac1562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:51.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 --2- 172.21.15.117:0/3885478113 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbcac06a930 0x7fbcac1562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 >> v1:172.21.15.124:6789/0 conn(0x7fbcac0a2b60 legacy=0x7fbcac152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac0b9560 con 0x7fbcac06a560 2023-07-19T20:44:51.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7fbca0001670 con 0x7fbcac06a560 2023-07-19T20:44:51.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 >> v1:172.21.15.117:6789/0 conn(0x7fbcac06a560 legacy=0x7fbcac0a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 --2- 172.21.15.117:0/3885478113 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc9c003c30 0x7fbc9c004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 --2- 172.21.15.117:0/3885478113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc9c004850 0x7fbc9c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 --2- 172.21.15.117:0/3885478113 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbcac06a930 0x7fbc9c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0bcda0 con 0x7fbc9c004850 2023-07-19T20:44:51.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c00baf0 con 0x7fbc9c003c30 2023-07-19T20:44:51.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c00bcb0 con 0x7fbcac06a930 2023-07-19T20:44:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcabfff700 1 --2- 172.21.15.117:0/3885478113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc9c004850 0x7fbc9c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcb0fb8700 1 --2- 172.21.15.117:0/3885478113 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc9c003c30 0x7fbc9c004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcb17b9700 1 --2- 172.21.15.117:0/3885478113 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbcac06a930 0x7fbc9c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcabfff700 1 -- 172.21.15.117:0/3885478113 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbcac06a930 msgr2=0x7fbc9c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcabfff700 1 --2- 172.21.15.117:0/3885478113 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbcac06a930 0x7fbc9c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcabfff700 1 -- 172.21.15.117:0/3885478113 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc9c003c30 msgr2=0x7fbc9c004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcabfff700 1 --2- 172.21.15.117:0/3885478113 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc9c003c30 0x7fbc9c004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcabfff700 1 -- 172.21.15.117:0/3885478113 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c0035b0 con 0x7fbc9c004850 2023-07-19T20:44:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcabfff700 1 --2- 172.21.15.117:0/3885478113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc9c004850 0x7fbc9c004cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbc98001980 tx=0x7fbc9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6416817472f377f server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.280+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98001470 con 0x7fbc9c004850 2023-07-19T20:44:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.281+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc980052d0 con 0x7fbc9c004850 2023-07-19T20:44:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.281+0000 7fbcab7fe700 1 -- 172.21.15.117:0/3885478113 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98003680 con 0x7fbc9c004850 2023-07-19T20:44:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.281+0000 7fbcb321c700 1 -- 172.21.15.117:0/3885478113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc9c004850 msgr2=0x7fbc9c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.281+0000 7fbcb321c700 1 --2- 172.21.15.117:0/3885478113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc9c004850 0x7fbc9c004cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbc98001980 tx=0x7fbc9c005880 comp rx=0 tx=0).stop 2023-07-19T20:44:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.281+0000 7fbcb17b9700 1 -- 172.21.15.117:0/3885478113 reap_dead start 2023-07-19T20:44:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.281+0000 7fbcb321c700 1 -- 172.21.15.117:0/3885478113 shutdown_connections 2023-07-19T20:44:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.281+0000 7fbcb321c700 1 -- 172.21.15.117:0/3885478113 >> 172.21.15.117:0/3885478113 conn(0x7fbcac09f570 msgr2=0x7fbcac09f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.281+0000 7fbcb321c700 1 -- 172.21.15.117:0/3885478113 shutdown_connections 2023-07-19T20:44:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.281+0000 7fbcb321c700 1 -- 172.21.15.117:0/3885478113 wait complete. 2023-07-19T20:44:51.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.282+0000 7fbcb321c700 1 Processor -- start 2023-07-19T20:44:51.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.282+0000 7fbcb321c700 1 -- start start 2023-07-19T20:44:51.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcb321c700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc9c004850 0x7fbcac1cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcb321c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcac1d3bf0 0x7fbcac1d42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcb321c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbcac06d020 0x7fbcac1cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcb321c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac1cd9e0 con 0x7fbcac1d3bf0 2023-07-19T20:44:51.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcb321c700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac1d3760 con 0x7fbcac06d020 2023-07-19T20:44:51.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcb321c700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac06e940 con 0x7fbc9c004850 2023-07-19T20:44:51.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcabfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcac1d3bf0 0x7fbcac1d42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcabfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcac1d3bf0 0x7fbcac1d42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44086/0 (socket says 172.21.15.117:44086) 2023-07-19T20:44:51.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcabfff700 1 -- 172.21.15.117:0/2455553448 learned_addr learned my addr 172.21.15.117:0/2455553448 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:51.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcb17b9700 1 --2- 172.21.15.117:0/2455553448 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbcac06d020 0x7fbcac1cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcb0fb8700 1 --2- 172.21.15.117:0/2455553448 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc9c004850 0x7fbcac1cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcabfff700 1 -- 172.21.15.117:0/2455553448 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc9c004850 msgr2=0x7fbcac1cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcabfff700 1 --2- 172.21.15.117:0/2455553448 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc9c004850 0x7fbcac1cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcabfff700 1 -- 172.21.15.117:0/2455553448 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbcac06d020 msgr2=0x7fbcac1cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcabfff700 1 --2- 172.21.15.117:0/2455553448 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbcac06d020 0x7fbcac1cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.283+0000 7fbcabfff700 1 -- 172.21.15.117:0/2455553448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac1d4800 con 0x7fbcac1d3bf0 2023-07-19T20:44:51.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.284+0000 7fbcabfff700 1 --2- 172.21.15.117:0/2455553448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcac1d3bf0 0x7fbcac1d42c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbc98006a90 tx=0x7fbc98001310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:51.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.284+0000 7fbca97fa700 1 -- 172.21.15.117:0/2455553448 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98001110 con 0x7fbcac1d3bf0 2023-07-19T20:44:51.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.284+0000 7fbca97fa700 1 -- 172.21.15.117:0/2455553448 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc98001410 con 0x7fbcac1d3bf0 2023-07-19T20:44:51.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.284+0000 7fbcb321c700 1 -- 172.21.15.117:0/2455553448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac06e660 con 0x7fbcac1d3bf0 2023-07-19T20:44:51.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.284+0000 7fbca97fa700 1 -- 172.21.15.117:0/2455553448 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98007280 con 0x7fbcac1d3bf0 2023-07-19T20:44:51.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.284+0000 7fbcb321c700 1 -- 172.21.15.117:0/2455553448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac1cbeb0 con 0x7fbcac1d3bf0 2023-07-19T20:44:51.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.285+0000 7fbcb321c700 1 -- 172.21.15.117:0/2455553448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcac1d3910 con 0x7fbcac1d3bf0 2023-07-19T20:44:51.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.285+0000 7fbca97fa700 1 -- 172.21.15.117:0/2455553448 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fbc980073e0 con 0x7fbcac1d3bf0 2023-07-19T20:44:51.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.286+0000 7fbca97fa700 1 --2- 172.21.15.117:0/2455553448 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fbc9006a660 0x7fbc9006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.286+0000 7fbcb0fb8700 1 --2- 172.21.15.117:0/2455553448 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fbc9006a660 0x7fbc9006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.286+0000 7fbca97fa700 1 -- 172.21.15.117:0/2455553448 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc98089a80 con 0x7fbcac1d3bf0 2023-07-19T20:44:51.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.286+0000 7fbcb0fb8700 1 --2- 172.21.15.117:0/2455553448 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fbc9006a660 0x7fbc9006cb10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbca0007c50 tx=0x7fbca0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:51.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.290+0000 7fbca97fa700 1 -- 172.21.15.117:0/2455553448 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fbcac1d3910 con 0x7fbcac1d3bf0 2023-07-19T20:44:51.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.471+0000 7fbcb321c700 1 -- 172.21.15.117:0/2455553448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbcac1d3910 con 0x7fbcac1d3bf0 2023-07-19T20:44:51.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.472+0000 7fbca97fa700 1 -- 172.21.15.117:0/2455553448 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbcac1d3910 con 0x7fbcac1d3bf0 2023-07-19T20:44:51.467 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2023-07-19T20:44:51.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.474+0000 7fbcb321c700 1 -- 172.21.15.117:0/2455553448 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fbc9006a660 msgr2=0x7fbc9006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.474+0000 7fbcb321c700 1 --2- 172.21.15.117:0/2455553448 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fbc9006a660 0x7fbc9006cb10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbca0007c50 tx=0x7fbca0009040 comp rx=0 tx=0).stop 2023-07-19T20:44:51.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.474+0000 7fbcb321c700 1 -- 172.21.15.117:0/2455553448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcac1d3bf0 msgr2=0x7fbcac1d42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.474+0000 7fbcb321c700 1 --2- 172.21.15.117:0/2455553448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcac1d3bf0 0x7fbcac1d42c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbc98006a90 tx=0x7fbc98001310 comp rx=0 tx=0).stop 2023-07-19T20:44:51.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.474+0000 7fbcb321c700 1 -- 172.21.15.117:0/2455553448 shutdown_connections 2023-07-19T20:44:51.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.474+0000 7fbcb321c700 1 --2- 172.21.15.117:0/2455553448 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fbc9006a660 0x7fbc9006cb10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.474+0000 7fbcb321c700 1 --2- 172.21.15.117:0/2455553448 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbcac06d020 0x7fbcac1cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.474+0000 7fbcb321c700 1 --2- 172.21.15.117:0/2455553448 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc9c004850 0x7fbcac1cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.474+0000 7fbcb321c700 1 --2- 172.21.15.117:0/2455553448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcac1d3bf0 0x7fbcac1d42c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.472 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.474+0000 7fbcb321c700 1 -- 172.21.15.117:0/2455553448 >> 172.21.15.117:0/2455553448 conn(0x7fbcac09f570 msgr2=0x7fbcac0ba2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:51.472 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.474+0000 7fbcb321c700 1 -- 172.21.15.117:0/2455553448 shutdown_connections 2023-07-19T20:44:51.472 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.474+0000 7fbcb321c700 1 -- 172.21.15.117:0/2455553448 wait complete. 2023-07-19T20:44:51.482 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-19T20:44:51.611 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.612+0000 7f29dc05f700 1 Processor -- start 2023-07-19T20:44:51.612 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.612+0000 7f29dc05f700 1 -- start start 2023-07-19T20:44:51.612 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29dc05f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29d4144d70 0x7f29d414e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.612 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29dc05f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f29d414e970 0x7f29d414a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.612 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29dc05f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29d414aea0 0x7f29d414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.612 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29dc05f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d40b86b0 con 0x7f29d4144d70 2023-07-19T20:44:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29dc05f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d4145140 con 0x7f29d414e970 2023-07-19T20:44:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29dc05f700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d414dfe0 con 0x7f29d414aea0 2023-07-19T20:44:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29d9dfb700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29d4144d70 0x7f29d414e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29d9dfb700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29d4144d70 0x7f29d414e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44102/0 (socket says 172.21.15.117:44102) 2023-07-19T20:44:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29d9dfb700 1 -- 172.21.15.117:0/496513407 learned_addr learned my addr 172.21.15.117:0/496513407 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29d95fa700 1 --2- 172.21.15.117:0/496513407 >> v2:172.21.15.124:3300/0 conn(0x7f29d414e970 0x7f29d414a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29da5fc700 1 --2- 172.21.15.117:0/496513407 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29d414aea0 0x7f29d414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29d9dfb700 1 -- 172.21.15.117:0/496513407 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29d414aea0 msgr2=0x7f29d414b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29d9dfb700 1 --2- 172.21.15.117:0/496513407 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29d414aea0 0x7f29d414b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29d9dfb700 1 -- 172.21.15.117:0/496513407 >> v2:172.21.15.124:3300/0 conn(0x7f29d414e970 msgr2=0x7f29d414a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29d9dfb700 1 --2- 172.21.15.117:0/496513407 >> v2:172.21.15.124:3300/0 conn(0x7f29d414e970 0x7f29d414a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29d9dfb700 1 -- 172.21.15.117:0/496513407 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40b7090 con 0x7f29d4144d70 2023-07-19T20:44:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29d9dfb700 1 --2- 172.21.15.117:0/496513407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29d4144d70 0x7f29d414e430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29d40bdf10 tx=0x7f29d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43eb3828ffe60e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29d8df9700 1 -- 172.21.15.117:0/496513407 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d000b870 con 0x7f29d4144d70 2023-07-19T20:44:51.615 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29d8df9700 1 -- 172.21.15.117:0/496513407 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d000b9d0 con 0x7f29d4144d70 2023-07-19T20:44:51.615 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.613+0000 7f29d8df9700 1 -- 172.21.15.117:0/496513407 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d000bd60 con 0x7f29d4144d70 2023-07-19T20:44:51.615 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.614+0000 7f29dc05f700 1 -- 172.21.15.117:0/496513407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29d4144d70 msgr2=0x7f29d414e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.615 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.614+0000 7f29dc05f700 1 --2- 172.21.15.117:0/496513407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29d4144d70 0x7f29d414e430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29d40bdf10 tx=0x7f29d0009bd0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.615 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.614+0000 7f29dc05f700 1 -- 172.21.15.117:0/496513407 shutdown_connections 2023-07-19T20:44:51.616 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.614+0000 7f29dc05f700 1 --2- 172.21.15.117:0/496513407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29d4144d70 0x7f29d414e430 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.616 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.614+0000 7f29dc05f700 1 --2- 172.21.15.117:0/496513407 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29d414aea0 0x7f29d414b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.616 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.614+0000 7f29dc05f700 1 --2- 172.21.15.117:0/496513407 >> v2:172.21.15.124:3300/0 conn(0x7f29d414e970 0x7f29d414a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.616 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.614+0000 7f29dc05f700 1 -- 172.21.15.117:0/496513407 >> 172.21.15.117:0/496513407 conn(0x7f29d4071c90 msgr2=0x7f29d4072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:51.616 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.614+0000 7f29dc05f700 1 -- 172.21.15.117:0/496513407 shutdown_connections 2023-07-19T20:44:51.616 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.614+0000 7f29dc05f700 1 -- 172.21.15.117:0/496513407 wait complete. 2023-07-19T20:44:51.616 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.615+0000 7f29dc05f700 1 Processor -- start 2023-07-19T20:44:51.617 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.615+0000 7f29dc05f700 1 -- start start 2023-07-19T20:44:51.617 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29dc05f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29d4144d70 0x7f29d41d4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.617 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29dc05f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29d414aea0 0x7f29d40c0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.617 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29dc05f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29d414e970 0x7f29d41e3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.617 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29dc05f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d41d6fb0 con 0x7f29d414e970 2023-07-19T20:44:51.617 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29dc05f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d41d4740 con 0x7f29d4144d70 2023-07-19T20:44:51.617 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29dc05f700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d41d6dd0 con 0x7f29d414aea0 2023-07-19T20:44:51.618 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29da5fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29d414e970 0x7f29d41e3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.618 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29da5fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29d414e970 0x7f29d41e3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44108/0 (socket says 172.21.15.117:44108) 2023-07-19T20:44:51.618 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29da5fc700 1 -- 172.21.15.117:0/150196654 learned_addr learned my addr 172.21.15.117:0/150196654 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29d9dfb700 1 --2- 172.21.15.117:0/150196654 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29d4144d70 0x7f29d41d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29d95fa700 1 --2- 172.21.15.117:0/150196654 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29d414aea0 0x7f29d40c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29da5fc700 1 -- 172.21.15.117:0/150196654 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29d414aea0 msgr2=0x7f29d40c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29da5fc700 1 --2- 172.21.15.117:0/150196654 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29d414aea0 0x7f29d40c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29da5fc700 1 -- 172.21.15.117:0/150196654 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29d4144d70 msgr2=0x7f29d41d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29da5fc700 1 --2- 172.21.15.117:0/150196654 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29d4144d70 0x7f29d41d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29da5fc700 1 -- 172.21.15.117:0/150196654 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d0009550 con 0x7f29d414e970 2023-07-19T20:44:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29da5fc700 1 --2- 172.21.15.117:0/150196654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29d414e970 0x7f29d41e3710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f29cc007e40 tx=0x7f29cc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29ca7fc700 1 -- 172.21.15.117:0/150196654 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc00ed30 con 0x7f29d414e970 2023-07-19T20:44:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29ca7fc700 1 -- 172.21.15.117:0/150196654 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc014420 con 0x7f29d414e970 2023-07-19T20:44:51.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29ca7fc700 1 -- 172.21.15.117:0/150196654 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0147d0 con 0x7f29d414e970 2023-07-19T20:44:51.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29dc05f700 1 -- 172.21.15.117:0/150196654 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d413daa0 con 0x7f29d414e970 2023-07-19T20:44:51.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.616+0000 7f29dc05f700 1 -- 172.21.15.117:0/150196654 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d40bff70 con 0x7f29d414e970 2023-07-19T20:44:51.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.617+0000 7f29dc05f700 1 -- 172.21.15.117:0/150196654 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d4067940 con 0x7f29d414e970 2023-07-19T20:44:51.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.618+0000 7f29ca7fc700 1 -- 172.21.15.117:0/150196654 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f29cc014930 con 0x7f29d414e970 2023-07-19T20:44:51.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.618+0000 7f29ca7fc700 1 --2- 172.21.15.117:0/150196654 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f29b806a660 0x7f29b806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.618+0000 7f29ca7fc700 1 -- 172.21.15.117:0/150196654 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29cc089140 con 0x7f29d414e970 2023-07-19T20:44:51.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.618+0000 7f29d9dfb700 1 --2- 172.21.15.117:0/150196654 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f29b806a660 0x7f29b806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.618+0000 7f29d9dfb700 1 --2- 172.21.15.117:0/150196654 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f29b806a660 0x7f29b806cb10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f29d0000c00 tx=0x7f29d0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:51.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.622+0000 7f29ca7fc700 1 -- 172.21.15.117:0/150196654 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f29cc054540 con 0x7f29d414e970 2023-07-19T20:44:51.807 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.811+0000 7f29dc05f700 1 -- 172.21.15.117:0/150196654 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29d40c0100 con 0x7f29d414e970 2023-07-19T20:44:51.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.812+0000 7f29ca7fc700 1 -- 172.21.15.117:0/150196654 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29d40c0100 con 0x7f29d414e970 2023-07-19T20:44:51.808 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 64 2023-07-19T20:44:51.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.814+0000 7f29dc05f700 1 -- 172.21.15.117:0/150196654 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f29b806a660 msgr2=0x7f29b806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.814+0000 7f29dc05f700 1 --2- 172.21.15.117:0/150196654 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f29b806a660 0x7f29b806cb10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f29d0000c00 tx=0x7f29d0008030 comp rx=0 tx=0).stop 2023-07-19T20:44:51.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.814+0000 7f29dc05f700 1 -- 172.21.15.117:0/150196654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29d414e970 msgr2=0x7f29d41e3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.814+0000 7f29dc05f700 1 --2- 172.21.15.117:0/150196654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29d414e970 0x7f29d41e3710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f29cc007e40 tx=0x7f29cc00e3c0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.814+0000 7f29dc05f700 1 -- 172.21.15.117:0/150196654 shutdown_connections 2023-07-19T20:44:51.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.814+0000 7f29dc05f700 1 --2- 172.21.15.117:0/150196654 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f29b806a660 0x7f29b806cb10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.814+0000 7f29dc05f700 1 --2- 172.21.15.117:0/150196654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29d414e970 0x7f29d41e3710 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.814+0000 7f29dc05f700 1 --2- 172.21.15.117:0/150196654 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29d4144d70 0x7f29d41d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.814+0000 7f29dc05f700 1 --2- 172.21.15.117:0/150196654 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29d414aea0 0x7f29d40c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.814+0000 7f29dc05f700 1 -- 172.21.15.117:0/150196654 >> 172.21.15.117:0/150196654 conn(0x7f29d4071c90 msgr2=0x7f29d4141a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:51.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.814+0000 7f29dc05f700 1 -- 172.21.15.117:0/150196654 shutdown_connections 2023-07-19T20:44:51.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.814+0000 7f29dc05f700 1 -- 172.21.15.117:0/150196654 wait complete. 2023-07-19T20:44:51.822 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-19T20:44:51.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.948+0000 7f5fb9a84700 1 Processor -- start 2023-07-19T20:44:51.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.948+0000 7f5fb9a84700 1 -- start start 2023-07-19T20:44:51.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.949+0000 7f5fb9a84700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5fb40bacb0 0x7f5fb40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.949+0000 7f5fb9a84700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb40729d0 con 0x7f5fb4071be0 2023-07-19T20:44:51.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.949+0000 7f5fb9a84700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb40717c0 con 0x7f5fb40b8da0 2023-07-19T20:44:51.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.949+0000 7f5fb9a84700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb40715e0 con 0x7f5fb40bacb0 2023-07-19T20:44:51.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.949+0000 7f5fb37fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5fb40bacb0 0x7f5fb40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.949+0000 7f5fb2ffd700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f5fb4071be0 0x7f5fb41446a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41390/0 (socket says 172.21.15.117:41390) 2023-07-19T20:44:51.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.949+0000 7f5fb2ffd700 1 -- 172.21.15.117:0/1552887489 learned_addr learned my addr 172.21.15.117:0/1552887489 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:51.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.949+0000 7f5fb37fe700 1 -- 172.21.15.117:0/1552887489 >> v1:172.21.15.124:6789/0 conn(0x7f5fb40b8da0 legacy=0x7f5fb40b91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:51.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.949+0000 7f5fb37fe700 1 -- 172.21.15.117:0/1552887489 >> v1:172.21.15.117:6789/0 conn(0x7f5fb4071be0 legacy=0x7f5fb41446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.949+0000 7f5fb37fe700 1 -- 172.21.15.117:0/1552887489 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb4072130 con 0x7f5fb40bacb0 2023-07-19T20:44:51.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.949+0000 7f5fb37fe700 1 --2- 172.21.15.117:0/1552887489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fb40bacb0 0x7f5fb40702f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009840 tx=0x7f5fa8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28223f192030b4b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:51.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.949+0000 7f5fb27fc700 1 -- 172.21.15.117:0/1552887489 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8004230 con 0x7f5fb40bacb0 2023-07-19T20:44:51.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.949+0000 7f5fb27fc700 1 -- 172.21.15.117:0/1552887489 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa8004390 con 0x7f5fb40bacb0 2023-07-19T20:44:51.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.949+0000 7f5fb27fc700 1 -- 172.21.15.117:0/1552887489 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa80036a0 con 0x7f5fb40bacb0 2023-07-19T20:44:51.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.950+0000 7f5fb9a84700 1 -- 172.21.15.117:0/1552887489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fb40bacb0 msgr2=0x7f5fb40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.950+0000 7f5fb9a84700 1 --2- 172.21.15.117:0/1552887489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fb40bacb0 0x7f5fb40702f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009840 tx=0x7f5fa8009b50 comp rx=0 tx=0).stop 2023-07-19T20:44:51.951 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.950+0000 7f5fb9a84700 1 -- 172.21.15.117:0/1552887489 shutdown_connections 2023-07-19T20:44:51.951 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.950+0000 7f5fb9a84700 1 --2- 172.21.15.117:0/1552887489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fb40bacb0 0x7f5fb40702f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.951 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.950+0000 7f5fb9a84700 1 -- 172.21.15.117:0/1552887489 >> 172.21.15.117:0/1552887489 conn(0x7f5fb40be4b0 msgr2=0x7f5fb40ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:51.951 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.950+0000 7f5fb9a84700 1 -- 172.21.15.117:0/1552887489 shutdown_connections 2023-07-19T20:44:51.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.950+0000 7f5fb9a84700 1 -- 172.21.15.117:0/1552887489 wait complete. 2023-07-19T20:44:51.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.951+0000 7f5fb9a84700 1 Processor -- start 2023-07-19T20:44:51.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.951+0000 7f5fb9a84700 1 -- start start 2023-07-19T20:44:51.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb9a84700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fb4071be0 0x7f5fb40bcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb9a84700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fb40b8da0 0x7f5fb41e34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb9a84700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fb40bacb0 0x7f5fb413c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb9a84700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb40bd0f0 con 0x7f5fb40b8da0 2023-07-19T20:44:51.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb9a84700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb40b5df0 con 0x7f5fb4071be0 2023-07-19T20:44:51.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb9a84700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb413b8c0 con 0x7f5fb40bacb0 2023-07-19T20:44:51.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fb40b8da0 0x7f5fb41e34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fb40b8da0 0x7f5fb41e34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44134/0 (socket says 172.21.15.117:44134) 2023-07-19T20:44:51.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb2ffd700 1 -- 172.21.15.117:0/2559081429 learned_addr learned my addr 172.21.15.117:0/2559081429 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:51.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb37fe700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fb4071be0 0x7f5fb40bcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb3fff700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fb40bacb0 0x7f5fb413c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb2ffd700 1 -- 172.21.15.117:0/2559081429 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fb40bacb0 msgr2=0x7f5fb413c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb2ffd700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fb40bacb0 0x7f5fb413c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb2ffd700 1 -- 172.21.15.117:0/2559081429 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fb4071be0 msgr2=0x7f5fb40bcbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:51.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb2ffd700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fb4071be0 0x7f5fb40bcbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:51.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb2ffd700 1 -- 172.21.15.117:0/2559081429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa80094a0 con 0x7f5fb40b8da0 2023-07-19T20:44:51.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb3fff700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fb40bacb0 0x7f5fb413c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:51.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb37fe700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fb4071be0 0x7f5fb40bcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:51.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb2ffd700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fb40b8da0 0x7f5fb41e34d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400c500 tx=0x7f5fa400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:51.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5f9bfff700 1 -- 172.21.15.117:0/2559081429 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4005d70 con 0x7f5fb40b8da0 2023-07-19T20:44:51.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5f9bfff700 1 -- 172.21.15.117:0/2559081429 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa40070d0 con 0x7f5fb40b8da0 2023-07-19T20:44:51.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.952+0000 7f5fb9a84700 1 -- 172.21.15.117:0/2559081429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb41e3a10 con 0x7f5fb40b8da0 2023-07-19T20:44:51.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.953+0000 7f5f9bfff700 1 -- 172.21.15.117:0/2559081429 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4007460 con 0x7f5fb40b8da0 2023-07-19T20:44:51.956 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.953+0000 7f5fb9a84700 1 -- 172.21.15.117:0/2559081429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb413cf00 con 0x7f5fb40b8da0 2023-07-19T20:44:51.956 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.953+0000 7f5fb9a84700 1 -- 172.21.15.117:0/2559081429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb413ba30 con 0x7f5fb40b8da0 2023-07-19T20:44:51.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.954+0000 7f5f9bfff700 1 -- 172.21.15.117:0/2559081429 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f5fa40075c0 con 0x7f5fb40b8da0 2023-07-19T20:44:51.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.954+0000 7f5f9bfff700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f5fa006a660 0x7f5fa006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:51.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.954+0000 7f5f9bfff700 1 -- 172.21.15.117:0/2559081429 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fa4087ee0 con 0x7f5fb40b8da0 2023-07-19T20:44:51.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.954+0000 7f5fb37fe700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f5fa006a660 0x7f5fa006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:51.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.955+0000 7f5fb37fe700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f5fa006a660 0x7f5fa006cb10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80090b0 tx=0x7f5fa8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:51.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:51.959+0000 7f5f9bfff700 1 -- 172.21.15.117:0/2559081429 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f5fa4053370 con 0x7f5fb40b8da0 2023-07-19T20:44:52.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.184+0000 7f5fb9a84700 1 -- 172.21.15.117:0/2559081429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fb4067940 con 0x7f5fb40b8da0 2023-07-19T20:44:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.184+0000 7f5f9bfff700 1 -- 172.21.15.117:0/2559081429 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3892 (secure 0 0 0) 0x7f5fa4017020 con 0x7f5fb40b8da0 2023-07-19T20:44:52.180 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:52.180 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6833/1121968339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":1121968339},{"type":"v1","addr":"172.21.15.124:6833","nonce":1121968339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3740070710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3740070710},{"type":"v1","addr":"172.21.15.117:6835","nonce":3740070710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-19T20:44:38.547955+0000","modified":"2023-07-19T20:44:41.558655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/479216080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":479216080},{"type":"v1","addr":"172.21.15.117:6837","nonce":479216080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-19T20:44:52.181 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.186+0000 7f5fb9a84700 1 -- 172.21.15.117:0/2559081429 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f5fa006a660 msgr2=0x7f5fa006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:52.181 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.186+0000 7f5fb9a84700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f5fa006a660 0x7f5fa006cb10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80090b0 tx=0x7f5fa8008030 comp rx=0 tx=0).stop 2023-07-19T20:44:52.181 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.186+0000 7f5fb9a84700 1 -- 172.21.15.117:0/2559081429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fb40b8da0 msgr2=0x7f5fb41e34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:52.181 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.186+0000 7f5fb9a84700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fb40b8da0 0x7f5fb41e34d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400c500 tx=0x7f5fa400c8c0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.186+0000 7f5fb9a84700 1 -- 172.21.15.117:0/2559081429 shutdown_connections 2023-07-19T20:44:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.186+0000 7f5fb9a84700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f5fa006a660 0x7f5fa006cb10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.186+0000 7f5fb9a84700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fb40bacb0 0x7f5fb413c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.186+0000 7f5fb9a84700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fb4071be0 0x7f5fb40bcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.186+0000 7f5fb9a84700 1 --2- 172.21.15.117:0/2559081429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fb40b8da0 0x7f5fb41e34d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.186+0000 7f5fb9a84700 1 -- 172.21.15.117:0/2559081429 >> 172.21.15.117:0/2559081429 conn(0x7f5fb40be4b0 msgr2=0x7f5fb4141ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.186+0000 7f5fb9a84700 1 -- 172.21.15.117:0/2559081429 shutdown_connections 2023-07-19T20:44:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.186+0000 7f5fb9a84700 1 -- 172.21.15.117:0/2559081429 wait complete. 2023-07-19T20:44:52.183 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 8 2023-07-19T20:44:52.193 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:52.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.319+0000 7f0a0dbd0700 1 Processor -- start 2023-07-19T20:44:52.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.319+0000 7f0a0dbd0700 1 -- start start 2023-07-19T20:44:52.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.320+0000 7f0a0dbd0700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0a080bd8e0 0x7f0a080bc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:52.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.320+0000 7f0a0dbd0700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0a080b99d0 0x7f0a080b9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:52.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.320+0000 7f0a0dbd0700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a080ba640 con 0x7f0a0814b760 2023-07-19T20:44:52.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.320+0000 7f0a0dbd0700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0814b2d0 con 0x7f0a080b99d0 2023-07-19T20:44:52.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.320+0000 7f0a0dbd0700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a080b9620 con 0x7f0a080bd8e0 2023-07-19T20:44:52.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.320+0000 7f0a077fe700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0a080bd8e0 0x7f0a080bc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:52.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.320+0000 7f0a077fe700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0a080bd8e0 0x7f0a080bc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:33900/0 (socket says 172.21.15.117:33900) 2023-07-19T20:44:52.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.320+0000 7f0a077fe700 1 -- 172.21.15.117:0/125588876 learned_addr learned my addr 172.21.15.117:0/125588876 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:52.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.320+0000 7f0a07fff700 1 --2- 172.21.15.117:0/125588876 >> v2:172.21.15.124:3300/0 conn(0x7f0a080b99d0 0x7f0a080b9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:52.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.320+0000 7f0a077fe700 1 -- 172.21.15.117:0/125588876 >> v2:172.21.15.124:3300/0 conn(0x7f0a080b99d0 msgr2=0x7f0a080b9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:52.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.320+0000 7f0a077fe700 1 --2- 172.21.15.117:0/125588876 >> v2:172.21.15.124:3300/0 conn(0x7f0a080b99d0 0x7f0a080b9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.320+0000 7f0a077fe700 1 -- 172.21.15.117:0/125588876 >> v1:172.21.15.124:6789/0 conn(0x7f0a0814b760 legacy=0x7f0a080bb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:52.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.320+0000 7f0a077fe700 1 -- 172.21.15.117:0/125588876 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a080bbab0 con 0x7f0a080bd8e0 2023-07-19T20:44:52.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.320+0000 7f0a07fff700 1 --2- 172.21.15.117:0/125588876 >> v2:172.21.15.124:3300/0 conn(0x7f0a080b99d0 0x7f0a080b9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:52.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.321+0000 7f0a077fe700 1 --2- 172.21.15.117:0/125588876 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0a080bd8e0 0x7f0a080bc770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f09f80098f0 tx=0x7f09f8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5370b378ca96b9d server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:52.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.321+0000 7f0a06ffd700 1 -- 172.21.15.117:0/125588876 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8011830 con 0x7f0a080bd8e0 2023-07-19T20:44:52.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.321+0000 7f0a06ffd700 1 -- 172.21.15.117:0/125588876 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f8011990 con 0x7f0a080bd8e0 2023-07-19T20:44:52.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.321+0000 7f0a06ffd700 1 -- 172.21.15.117:0/125588876 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8011d20 con 0x7f0a080bd8e0 2023-07-19T20:44:52.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.321+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/125588876 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0a080bd8e0 msgr2=0x7f0a080bc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:52.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.321+0000 7f0a0dbd0700 1 --2- 172.21.15.117:0/125588876 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0a080bd8e0 0x7f0a080bc770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f09f80098f0 tx=0x7f09f8009c00 comp rx=0 tx=0).stop 2023-07-19T20:44:52.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.321+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/125588876 shutdown_connections 2023-07-19T20:44:52.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.321+0000 7f0a0dbd0700 1 --2- 172.21.15.117:0/125588876 >> v2:172.21.15.124:3300/0 conn(0x7f0a080b99d0 0x7f0a080b9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.321+0000 7f0a0dbd0700 1 --2- 172.21.15.117:0/125588876 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0a080bd8e0 0x7f0a080bc770 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.321+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/125588876 >> 172.21.15.117:0/125588876 conn(0x7f0a080a0580 msgr2=0x7f0a080a0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:52.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.321+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/125588876 shutdown_connections 2023-07-19T20:44:52.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.321+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/125588876 wait complete. 2023-07-19T20:44:52.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.322+0000 7f0a0dbd0700 1 Processor -- start 2023-07-19T20:44:52.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.323+0000 7f0a0dbd0700 1 -- start start 2023-07-19T20:44:52.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.323+0000 7f0a0dbd0700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0a080b99d0 0x7f0a081d5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:52.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.323+0000 7f0a0dbd0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a080bd8e0 0x7f0a081d7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:52.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.323+0000 7f0a0dbd0700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0a0814b760 0x7f0a081492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:52.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.323+0000 7f0a0dbd0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a081d7f80 con 0x7f0a080bd8e0 2023-07-19T20:44:52.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.323+0000 7f0a0dbd0700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a080b6990 con 0x7f0a080b99d0 2023-07-19T20:44:52.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.323+0000 7f0a0dbd0700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a081d6e20 con 0x7f0a0814b760 2023-07-19T20:44:52.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.323+0000 7f09feffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a080bd8e0 0x7f0a081d7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:52.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.323+0000 7f09feffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a080bd8e0 0x7f0a081d7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47598/0 (socket says 172.21.15.117:47598) 2023-07-19T20:44:52.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.323+0000 7f09feffd700 1 -- 172.21.15.117:0/967838691 learned_addr learned my addr 172.21.15.117:0/967838691 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:52.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.323+0000 7f0a077fe700 1 --2- 172.21.15.117:0/967838691 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0a080b99d0 0x7f0a081d5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:52.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.323+0000 7f0a07fff700 1 --2- 172.21.15.117:0/967838691 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0a0814b760 0x7f0a081492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:52.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.324+0000 7f09feffd700 1 -- 172.21.15.117:0/967838691 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0a0814b760 msgr2=0x7f0a081492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:52.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.324+0000 7f09feffd700 1 --2- 172.21.15.117:0/967838691 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0a0814b760 0x7f0a081492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.324+0000 7f09feffd700 1 -- 172.21.15.117:0/967838691 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0a080b99d0 msgr2=0x7f0a081d5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:52.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.324+0000 7f09feffd700 1 --2- 172.21.15.117:0/967838691 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0a080b99d0 0x7f0a081d5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.324+0000 7f09feffd700 1 -- 172.21.15.117:0/967838691 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a00009a70 con 0x7f0a080bd8e0 2023-07-19T20:44:52.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.324+0000 7f09feffd700 1 --2- 172.21.15.117:0/967838691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a080bd8e0 0x7f0a081d7750 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f09f000c450 tx=0x7f09f000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:52.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.324+0000 7f0a04ff9700 1 -- 172.21.15.117:0/967838691 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f00052d0 con 0x7f0a080bd8e0 2023-07-19T20:44:52.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.324+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/967838691 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f8009550 con 0x7f0a080bd8e0 2023-07-19T20:44:52.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.324+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/967838691 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a081e3bd0 con 0x7f0a080bd8e0 2023-07-19T20:44:52.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.324+0000 7f0a04ff9700 1 -- 172.21.15.117:0/967838691 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f000ce10 con 0x7f0a080bd8e0 2023-07-19T20:44:52.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.324+0000 7f0a04ff9700 1 -- 172.21.15.117:0/967838691 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f0003680 con 0x7f0a080bd8e0 2023-07-19T20:44:52.327 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.325+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/967838691 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ec0052e0 con 0x7f0a080bd8e0 2023-07-19T20:44:52.327 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.325+0000 7f0a04ff9700 1 -- 172.21.15.117:0/967838691 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f09f00037e0 con 0x7f0a080bd8e0 2023-07-19T20:44:52.327 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.326+0000 7f0a04ff9700 1 --2- 172.21.15.117:0/967838691 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f09e806a660 0x7f09e806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:52.327 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.326+0000 7f0a04ff9700 1 -- 172.21.15.117:0/967838691 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09f0087a40 con 0x7f0a080bd8e0 2023-07-19T20:44:52.327 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.326+0000 7f0a077fe700 1 --2- 172.21.15.117:0/967838691 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f09e806a660 0x7f09e806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:52.327 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.326+0000 7f0a077fe700 1 --2- 172.21.15.117:0/967838691 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f09e806a660 0x7f09e806cb10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f09f8009c40 tx=0x7f09f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:52.328 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.330+0000 7f0a04ff9700 1 -- 172.21.15.117:0/967838691 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f09f004c2c0 con 0x7f0a080bd8e0 2023-07-19T20:44:52.511 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.517+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/967838691 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09ec005860 con 0x7f0a080bd8e0 2023-07-19T20:44:52.512 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.518+0000 7f0a04ff9700 1 -- 172.21.15.117:0/967838691 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17897 (secure 0 0 0) 0x7f09f0089e60 con 0x7f0a080bd8e0 2023-07-19T20:44:52.513 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:52.513 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:39.549566+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:52.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.520+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/967838691 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f09e806a660 msgr2=0x7f09e806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:52.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.520+0000 7f0a0dbd0700 1 --2- 172.21.15.117:0/967838691 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f09e806a660 0x7f09e806cb10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f09f8009c40 tx=0x7f09f8008030 comp rx=0 tx=0).stop 2023-07-19T20:44:52.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.520+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/967838691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a080bd8e0 msgr2=0x7f0a081d7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:52.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.520+0000 7f0a0dbd0700 1 --2- 172.21.15.117:0/967838691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a080bd8e0 0x7f0a081d7750 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f09f000c450 tx=0x7f09f000c760 comp rx=0 tx=0).stop 2023-07-19T20:44:52.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.520+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/967838691 shutdown_connections 2023-07-19T20:44:52.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.520+0000 7f0a0dbd0700 1 --2- 172.21.15.117:0/967838691 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f09e806a660 0x7f09e806cb10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.520+0000 7f0a0dbd0700 1 --2- 172.21.15.117:0/967838691 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0a0814b760 0x7f0a081492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.520+0000 7f0a0dbd0700 1 --2- 172.21.15.117:0/967838691 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0a080b99d0 0x7f0a081d5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.516 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.520+0000 7f0a0dbd0700 1 --2- 172.21.15.117:0/967838691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a080bd8e0 0x7f0a081d7750 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.516 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.520+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/967838691 >> 172.21.15.117:0/967838691 conn(0x7f0a080a0580 msgr2=0x7f0a080a28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:52.516 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.520+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/967838691 shutdown_connections 2023-07-19T20:44:52.516 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.520+0000 7f0a0dbd0700 1 -- 172.21.15.117:0/967838691 wait complete. 2023-07-19T20:44:52.527 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-19T20:44:52.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.654+0000 7fe14e47a700 1 Processor -- start 2023-07-19T20:44:52.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.654+0000 7fe14e47a700 1 -- start start 2023-07-19T20:44:52.651 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.655+0000 7fe14e47a700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1480b95e0 0x7fe14806b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:52.651 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.655+0000 7fe14e47a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe14814ad30 0x7fe1481520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:52.651 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.655+0000 7fe14e47a700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe148141f60 con 0x7fe1480b6dc0 2023-07-19T20:44:52.651 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.655+0000 7fe14e47a700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1480719f0 con 0x7fe14814ad30 2023-07-19T20:44:52.652 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.655+0000 7fe14e47a700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe148070a50 con 0x7fe1480b95e0 2023-07-19T20:44:52.652 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.655+0000 7fe147fff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe1480b6dc0 0x7fe1480b8dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41712/0 (socket says 172.21.15.117:41712) 2023-07-19T20:44:52.652 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.655+0000 7fe147fff700 1 -- 172.21.15.117:0/4095927928 learned_addr learned my addr 172.21.15.117:0/4095927928 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:52.652 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.655+0000 7fe14ca17700 1 --2- 172.21.15.117:0/4095927928 >> v2:172.21.15.124:3300/0 conn(0x7fe14814ad30 0x7fe1481520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:52.652 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.655+0000 7fe1477fe700 1 --2- 172.21.15.117:0/4095927928 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1480b95e0 0x7fe14806b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:52.652 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.655+0000 7fe146ffd700 1 -- 172.21.15.117:0/4095927928 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327631209 0 0) 0x7fe148141f60 con 0x7fe1480b6dc0 2023-07-19T20:44:52.652 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.655+0000 7fe146ffd700 1 -- 172.21.15.117:0/4095927928 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1300035b0 con 0x7fe1480b6dc0 2023-07-19T20:44:52.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.656+0000 7fe14ca17700 1 -- 172.21.15.117:0/4095927928 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1480b95e0 msgr2=0x7fe14806b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:52.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.656+0000 7fe14ca17700 1 --2- 172.21.15.117:0/4095927928 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1480b95e0 0x7fe14806b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.656+0000 7fe146ffd700 1 -- 172.21.15.117:0/4095927928 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 408022743 0 0) 0x7fe1300035b0 con 0x7fe1480b6dc0 2023-07-19T20:44:52.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.656+0000 7fe14ca17700 1 -- 172.21.15.117:0/4095927928 >> v1:172.21.15.117:6789/0 conn(0x7fe1480b6dc0 legacy=0x7fe1480b8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:52.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.656+0000 7fe14ca17700 1 -- 172.21.15.117:0/4095927928 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe148070cf0 con 0x7fe14814ad30 2023-07-19T20:44:52.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.656+0000 7fe1477fe700 1 --2- 172.21.15.117:0/4095927928 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1480b95e0 0x7fe14806b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:52.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.656+0000 7fe14ca17700 1 --2- 172.21.15.117:0/4095927928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe14814ad30 0x7fe1481520a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe140009d90 tx=0x7fe14000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=611b0ee9ea7577d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:52.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.656+0000 7fe146ffd700 1 -- 172.21.15.117:0/4095927928 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14000e070 con 0x7fe14814ad30 2023-07-19T20:44:52.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.656+0000 7fe146ffd700 1 -- 172.21.15.117:0/4095927928 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe140003a20 con 0x7fe14814ad30 2023-07-19T20:44:52.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.656+0000 7fe146ffd700 1 -- 172.21.15.117:0/4095927928 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138001670 con 0x7fe14814ad30 2023-07-19T20:44:52.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.656+0000 7fe14e47a700 1 -- 172.21.15.117:0/4095927928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe14814ad30 msgr2=0x7fe1481520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:52.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.656+0000 7fe14e47a700 1 --2- 172.21.15.117:0/4095927928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe14814ad30 0x7fe1481520a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe140009d90 tx=0x7fe14000b330 comp rx=0 tx=0).stop 2023-07-19T20:44:52.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.657+0000 7fe14e47a700 1 -- 172.21.15.117:0/4095927928 shutdown_connections 2023-07-19T20:44:52.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.657+0000 7fe14e47a700 1 --2- 172.21.15.117:0/4095927928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe14814ad30 0x7fe1481520a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.657+0000 7fe14e47a700 1 --2- 172.21.15.117:0/4095927928 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1480b95e0 0x7fe14806b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.655 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.657+0000 7fe14e47a700 1 -- 172.21.15.117:0/4095927928 >> 172.21.15.117:0/4095927928 conn(0x7fe1480bdc00 msgr2=0x7fe1480b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:52.655 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.657+0000 7fe14e47a700 1 -- 172.21.15.117:0/4095927928 shutdown_connections 2023-07-19T20:44:52.655 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.657+0000 7fe14e47a700 1 -- 172.21.15.117:0/4095927928 wait complete. 2023-07-19T20:44:52.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.658+0000 7fe14e47a700 1 Processor -- start 2023-07-19T20:44:52.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.658+0000 7fe14e47a700 1 -- start start 2023-07-19T20:44:52.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.658+0000 7fe14e47a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1480b6dc0 0x7fe148148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:52.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.658+0000 7fe14e47a700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1480b95e0 0x7fe148145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:52.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.658+0000 7fe14e47a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe14814ad30 0x7fe14813dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:52.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.658+0000 7fe14e47a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1481db8e0 con 0x7fe1480b6dc0 2023-07-19T20:44:52.661 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.658+0000 7fe14e47a700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1481dc890 con 0x7fe14814ad30 2023-07-19T20:44:52.661 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.658+0000 7fe14e47a700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1481dc400 con 0x7fe1480b95e0 2023-07-19T20:44:52.661 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe147fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1480b6dc0 0x7fe148148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:52.662 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe147fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1480b6dc0 0x7fe148148190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47614/0 (socket says 172.21.15.117:47614) 2023-07-19T20:44:52.662 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe147fff700 1 -- 172.21.15.117:0/1458640226 learned_addr learned my addr 172.21.15.117:0/1458640226 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:52.662 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe14ca17700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe14814ad30 0x7fe14813dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:52.662 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe1477fe700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1480b95e0 0x7fe148145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:52.662 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe147fff700 1 -- 172.21.15.117:0/1458640226 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1480b95e0 msgr2=0x7fe148145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:52.663 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe147fff700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1480b95e0 0x7fe148145570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.663 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe147fff700 1 -- 172.21.15.117:0/1458640226 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe14814ad30 msgr2=0x7fe14813dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:52.663 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe147fff700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe14814ad30 0x7fe14813dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.663 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe147fff700 1 -- 172.21.15.117:0/1458640226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c0094a0 con 0x7fe1480b6dc0 2023-07-19T20:44:52.663 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe14ca17700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe14814ad30 0x7fe14813dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:52.663 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe147fff700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1480b6dc0 0x7fe148148190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe13800c750 tx=0x7fe13800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:52.663 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe144ff9700 1 -- 172.21.15.117:0/1458640226 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138004c80 con 0x7fe1480b6dc0 2023-07-19T20:44:52.663 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe144ff9700 1 -- 172.21.15.117:0/1458640226 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe138004de0 con 0x7fe1480b6dc0 2023-07-19T20:44:52.664 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe14e47a700 1 -- 172.21.15.117:0/1458640226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe140009a70 con 0x7fe1480b6dc0 2023-07-19T20:44:52.664 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe144ff9700 1 -- 172.21.15.117:0/1458640226 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1380072f0 con 0x7fe1480b6dc0 2023-07-19T20:44:52.664 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.659+0000 7fe14e47a700 1 -- 172.21.15.117:0/1458640226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1481dc090 con 0x7fe1480b6dc0 2023-07-19T20:44:52.664 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.660+0000 7fe14e47a700 1 -- 172.21.15.117:0/1458640226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1481dc6e0 con 0x7fe1480b6dc0 2023-07-19T20:44:52.664 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.660+0000 7fe144ff9700 1 -- 172.21.15.117:0/1458640226 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fe138007450 con 0x7fe1480b6dc0 2023-07-19T20:44:52.665 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.661+0000 7fe144ff9700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe13406a660 0x7fe13406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:52.665 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.661+0000 7fe144ff9700 1 -- 172.21.15.117:0/1458640226 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe138088810 con 0x7fe1480b6dc0 2023-07-19T20:44:52.665 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.661+0000 7fe1477fe700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe13406a660 0x7fe13406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:52.665 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.661+0000 7fe1477fe700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe13406a660 0x7fe13406cb10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe148146a90 tx=0x7fe13c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:52.666 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.665+0000 7fe144ff9700 1 -- 172.21.15.117:0/1458640226 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fe138053ca0 con 0x7fe1480b6dc0 2023-07-19T20:44:52.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.897+0000 7fe14e47a700 1 -- 172.21.15.117:0/1458640226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe148067940 con 0x7fe1480b6dc0 2023-07-19T20:44:52.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.898+0000 7fe144ff9700 1 -- 172.21.15.117:0/1458640226 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3892 (secure 0 0 0) 0x7fe138007700 con 0x7fe1480b6dc0 2023-07-19T20:44:52.893 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:52.893 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6833/1121968339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":1121968339},{"type":"v1","addr":"172.21.15.124:6833","nonce":1121968339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3740070710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3740070710},{"type":"v1","addr":"172.21.15.117:6835","nonce":3740070710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-19T20:44:38.547955+0000","modified":"2023-07-19T20:44:41.558655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/479216080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":479216080},{"type":"v1","addr":"172.21.15.117:6837","nonce":479216080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-19T20:44:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.900+0000 7fe14e47a700 1 -- 172.21.15.117:0/1458640226 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe13406a660 msgr2=0x7fe13406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.900+0000 7fe14e47a700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe13406a660 0x7fe13406cb10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe148146a90 tx=0x7fe13c008040 comp rx=0 tx=0).stop 2023-07-19T20:44:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.900+0000 7fe14e47a700 1 -- 172.21.15.117:0/1458640226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1480b6dc0 msgr2=0x7fe148148190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:52.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.900+0000 7fe14e47a700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1480b6dc0 0x7fe148148190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe13800c750 tx=0x7fe13800cb10 comp rx=0 tx=0).stop 2023-07-19T20:44:52.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.900+0000 7fe14e47a700 1 -- 172.21.15.117:0/1458640226 shutdown_connections 2023-07-19T20:44:52.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.900+0000 7fe14e47a700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe13406a660 0x7fe13406cb10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.897 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.900+0000 7fe14e47a700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe14814ad30 0x7fe14813dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.898 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.900+0000 7fe14e47a700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1480b6dc0 0x7fe148148190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.898 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.900+0000 7fe14e47a700 1 --2- 172.21.15.117:0/1458640226 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1480b95e0 0x7fe148145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:52.898 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.900+0000 7fe14e47a700 1 -- 172.21.15.117:0/1458640226 >> 172.21.15.117:0/1458640226 conn(0x7fe1480bdc00 msgr2=0x7fe1480b99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:52.898 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.900+0000 7fe14e47a700 1 -- 172.21.15.117:0/1458640226 shutdown_connections 2023-07-19T20:44:52.899 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:52.900+0000 7fe14e47a700 1 -- 172.21.15.117:0/1458640226 wait complete. 2023-07-19T20:44:52.899 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 8 2023-07-19T20:44:53.209 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-19T20:44:38.547955+0000', 'modified': '2023-07-19T20:44:41.558655+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6837/479216080', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6836', 'nonce': 479216080}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 479216080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-19T20:44:53.209 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-19T20:44:53.210 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-19T20:44:53.332 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.337+0000 7f65f5845700 1 Processor -- start 2023-07-19T20:44:53.332 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.337+0000 7f65f5845700 1 -- start start 2023-07-19T20:44:53.334 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.338+0000 7f65f5845700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65f00b94b0 0x7f65f00702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.334 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.338+0000 7f65f5845700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f00729d0 con 0x7f65f00bacb0 2023-07-19T20:44:53.334 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.338+0000 7f65f5845700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f00717c0 con 0x7f65f0071be0 2023-07-19T20:44:53.334 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.338+0000 7f65f5845700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f00715e0 con 0x7f65f00b94b0 2023-07-19T20:44:53.334 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.338+0000 7f65ef7fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65f00b94b0 0x7f65f00702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.334 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.338+0000 7f65eeffd700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f65f00bacb0 0x7f65f01446a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41718/0 (socket says 172.21.15.117:41718) 2023-07-19T20:44:53.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.338+0000 7f65eeffd700 1 -- 172.21.15.117:0/570303683 learned_addr learned my addr 172.21.15.117:0/570303683 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:53.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.339+0000 7f65ef7fe700 1 -- 172.21.15.117:0/570303683 >> v1:172.21.15.124:6789/0 conn(0x7f65f0071be0 legacy=0x7f65f00b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.339+0000 7f65ef7fe700 1 -- 172.21.15.117:0/570303683 >> v1:172.21.15.117:6789/0 conn(0x7f65f00bacb0 legacy=0x7f65f01446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.339+0000 7f65ef7fe700 1 -- 172.21.15.117:0/570303683 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f0072130 con 0x7f65f00b94b0 2023-07-19T20:44:53.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.339+0000 7f65ef7fe700 1 --2- 172.21.15.117:0/570303683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f00b94b0 0x7f65f00702f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009d90 tx=0x7f65e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef48a635584c2eb server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:53.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.339+0000 7f65edffb700 1 -- 172.21.15.117:0/570303683 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e800e070 con 0x7f65f00b94b0 2023-07-19T20:44:53.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.339+0000 7f65edffb700 1 -- 172.21.15.117:0/570303683 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e800bbd0 con 0x7f65f00b94b0 2023-07-19T20:44:53.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.339+0000 7f65edffb700 1 -- 172.21.15.117:0/570303683 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8012430 con 0x7f65f00b94b0 2023-07-19T20:44:53.336 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.339+0000 7f65f5845700 1 -- 172.21.15.117:0/570303683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f00b94b0 msgr2=0x7f65f00702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.336 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.339+0000 7f65f5845700 1 --2- 172.21.15.117:0/570303683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f00b94b0 0x7f65f00702f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009d90 tx=0x7f65e800b330 comp rx=0 tx=0).stop 2023-07-19T20:44:53.336 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.339+0000 7f65f5845700 1 -- 172.21.15.117:0/570303683 shutdown_connections 2023-07-19T20:44:53.336 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.339+0000 7f65f5845700 1 --2- 172.21.15.117:0/570303683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f00b94b0 0x7f65f00702f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.336 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.339+0000 7f65f5845700 1 -- 172.21.15.117:0/570303683 >> 172.21.15.117:0/570303683 conn(0x7f65f00be4b0 msgr2=0x7f65f00ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:53.336 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.339+0000 7f65f5845700 1 -- 172.21.15.117:0/570303683 shutdown_connections 2023-07-19T20:44:53.336 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.339+0000 7f65f5845700 1 -- 172.21.15.117:0/570303683 wait complete. 2023-07-19T20:44:53.338 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.340+0000 7f65f5845700 1 Processor -- start 2023-07-19T20:44:53.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.341+0000 7f65f5845700 1 -- start start 2023-07-19T20:44:53.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.341+0000 7f65f5845700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65f0071be0 0x7f65f01459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.341+0000 7f65f5845700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f00b94b0 0x7f65f01d7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.341+0000 7f65f5845700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65f00bacb0 0x7f65f013de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.341+0000 7f65f5845700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f01d7fc0 con 0x7f65f00b94b0 2023-07-19T20:44:53.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.341+0000 7f65f5845700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00bcef0 con 0x7f65f0071be0 2023-07-19T20:44:53.340 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.341+0000 7f65f5845700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00bd4b0 con 0x7f65f00bacb0 2023-07-19T20:44:53.340 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.341+0000 7f65ee7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f00b94b0 0x7f65f01d7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.340 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.341+0000 7f65ee7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f00b94b0 0x7f65f01d7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47638/0 (socket says 172.21.15.117:47638) 2023-07-19T20:44:53.340 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.341+0000 7f65ee7fc700 1 -- 172.21.15.117:0/603148584 learned_addr learned my addr 172.21.15.117:0/603148584 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:53.340 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.341+0000 7f65eeffd700 1 --2- 172.21.15.117:0/603148584 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65f0071be0 0x7f65f01459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.340 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.341+0000 7f65ef7fe700 1 --2- 172.21.15.117:0/603148584 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65f00bacb0 0x7f65f013de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.340 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.342+0000 7f65ee7fc700 1 -- 172.21.15.117:0/603148584 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65f00bacb0 msgr2=0x7f65f013de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.341 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.342+0000 7f65ee7fc700 1 --2- 172.21.15.117:0/603148584 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65f00bacb0 0x7f65f013de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.341 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.342+0000 7f65ee7fc700 1 -- 172.21.15.117:0/603148584 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65f0071be0 msgr2=0x7f65f01459a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.341 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.342+0000 7f65ee7fc700 1 --2- 172.21.15.117:0/603148584 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65f0071be0 0x7f65f01459a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.341 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.342+0000 7f65ee7fc700 1 -- 172.21.15.117:0/603148584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e8009a70 con 0x7f65f00b94b0 2023-07-19T20:44:53.341 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.342+0000 7f65ee7fc700 1 --2- 172.21.15.117:0/603148584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f00b94b0 0x7f65f01d7a80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c4b0 tx=0x7f65e000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:53.341 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.342+0000 7f65d7fff700 1 -- 172.21.15.117:0/603148584 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00052d0 con 0x7f65f00b94b0 2023-07-19T20:44:53.341 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.342+0000 7f65d7fff700 1 -- 172.21.15.117:0/603148584 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e0005430 con 0x7f65f00b94b0 2023-07-19T20:44:53.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.342+0000 7f65f5845700 1 -- 172.21.15.117:0/603148584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f01d0ac0 con 0x7f65f00b94b0 2023-07-19T20:44:53.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.342+0000 7f65d7fff700 1 -- 172.21.15.117:0/603148584 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00038c0 con 0x7f65f00b94b0 2023-07-19T20:44:53.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.342+0000 7f65f5845700 1 -- 172.21.15.117:0/603148584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f0146040 con 0x7f65f00b94b0 2023-07-19T20:44:53.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.343+0000 7f65d7fff700 1 -- 172.21.15.117:0/603148584 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f65e0003a20 con 0x7f65f00b94b0 2023-07-19T20:44:53.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.344+0000 7f65d7fff700 1 --2- 172.21.15.117:0/603148584 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f65dc06a660 0x7f65dc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.344+0000 7f65d7fff700 1 -- 172.21.15.117:0/603148584 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f65e0087dd0 con 0x7f65f00b94b0 2023-07-19T20:44:53.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.344+0000 7f65eeffd700 1 --2- 172.21.15.117:0/603148584 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f65dc06a660 0x7f65dc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.342 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.344+0000 7f65eeffd700 1 --2- 172.21.15.117:0/603148584 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f65dc06a660 0x7f65dc06cb10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f65e4005910 tx=0x7f65e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:53.347 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.346+0000 7f66019e9b80 1 Processor -- start 2023-07-19T20:44:53.347 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.346+0000 7f66019e9b80 1 -- start start 2023-07-19T20:44:53.347 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.346+0000 7f66019e9b80 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f6210 0x55e1808f2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.347 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.346+0000 7f66019e9b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e1808f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.346+0000 7f66019e9b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e180923c10 0x55e180924080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.346+0000 7f66019e9b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1808621e0 con 0x55e1808f65e0 2023-07-19T20:44:53.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.346+0000 7f66019e9b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1807e0fd0 con 0x55e180923c10 2023-07-19T20:44:53.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.346+0000 7f66019e9b80 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e18084feb0 con 0x55e1808f6210 2023-07-19T20:44:53.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.347+0000 7f65ee7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e1808f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.347+0000 7f65ee7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e1808f2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47642/0 (socket says 172.21.15.117:47642) 2023-07-19T20:44:53.348 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.347+0000 7f65ee7fc700 1 -- 172.21.15.117:0/2814199829 learned_addr learned my addr 172.21.15.117:0/2814199829 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:53.349 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.347+0000 7f65eeffd700 1 --2- 172.21.15.117:0/2814199829 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f6210 0x55e1808f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.349 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.347+0000 7f65ee7fc700 1 -- 172.21.15.117:0/2814199829 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f6210 msgr2=0x55e1808f2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:53.349 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.347+0000 7f65ef7fe700 1 --2- 172.21.15.117:0/2814199829 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e180923c10 0x55e180924080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.349 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.347+0000 7f65ee7fc700 1 --2- 172.21.15.117:0/2814199829 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f6210 0x55e1808f2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.349 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.347+0000 7f65ee7fc700 1 -- 172.21.15.117:0/2814199829 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e180923c10 msgr2=0x55e180924080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:53.349 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.347+0000 7f65ee7fc700 1 --2- 172.21.15.117:0/2814199829 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e180923c10 0x55e180924080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.349 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.347+0000 7f65ee7fc700 1 -- 172.21.15.117:0/2814199829 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e18063d790 con 0x55e1808f65e0 2023-07-19T20:44:53.349 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.347+0000 7f65ee7fc700 1 --2- 172.21.15.117:0/2814199829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e1808f2b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f65e00861c0 tx=0x7f65e0056aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ff59aa1cb43d1b server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:53.350 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.347+0000 7f65d57fa700 1 -- 172.21.15.117:0/2814199829 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e006e070 con 0x55e1808f65e0 2023-07-19T20:44:53.350 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.347+0000 7f65d57fa700 1 -- 172.21.15.117:0/2814199829 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e005f1e0 con 0x55e1808f65e0 2023-07-19T20:44:53.350 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.347+0000 7f65d57fa700 1 -- 172.21.15.117:0/2814199829 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e005ed50 con 0x55e1808f65e0 2023-07-19T20:44:53.350 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.348+0000 7f66019e9b80 1 -- 172.21.15.117:0/2814199829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 msgr2=0x55e1808f2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.350 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.348+0000 7f66019e9b80 1 --2- 172.21.15.117:0/2814199829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e1808f2b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f65e00861c0 tx=0x7f65e0056aa0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.350 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.348+0000 7f66019e9b80 1 -- 172.21.15.117:0/2814199829 shutdown_connections 2023-07-19T20:44:53.350 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.348+0000 7f66019e9b80 1 --2- 172.21.15.117:0/2814199829 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e180923c10 0x55e180924080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.350 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.348+0000 7f66019e9b80 1 --2- 172.21.15.117:0/2814199829 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f6210 0x55e1808f2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.351 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.348+0000 7f66019e9b80 1 --2- 172.21.15.117:0/2814199829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e1808f2b50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.351 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.348+0000 7f66019e9b80 1 -- 172.21.15.117:0/2814199829 >> 172.21.15.117:0/2814199829 conn(0x55e1808ed1b0 msgr2=0x55e1808f7130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:53.351 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.348+0000 7f66019e9b80 1 -- 172.21.15.117:0/2814199829 shutdown_connections 2023-07-19T20:44:53.351 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.348+0000 7f66019e9b80 1 -- 172.21.15.117:0/2814199829 wait complete. 2023-07-19T20:44:53.351 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.348+0000 7f66019e9b80 1 -- start start 2023-07-19T20:44:53.351 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.348+0000 7f66019e9b80 1 Processor -- start 2023-07-19T20:44:53.351 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f66019e9b80 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f6210 0x55e180926550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.351 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f66019e9b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e180920f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.352 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f66019e9b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e180923c10 0x55e18093da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.352 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f66019e9b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e180849220 con 0x55e1808f65e0 2023-07-19T20:44:53.352 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f66019e9b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1807e5770 con 0x55e180923c10 2023-07-19T20:44:53.352 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f66019e9b80 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1808086f0 con 0x55e1808f6210 2023-07-19T20:44:53.352 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f66019e9b80 10 client.0 _ll_register_callbacks cb 0x55e1807e74e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-19T20:44:53.352 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f65ee7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e180920f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.352 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f65ee7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e180920f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47658/0 (socket says 172.21.15.117:47658) 2023-07-19T20:44:53.353 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f65ee7fc700 1 -- 172.21.15.117:0/2579329444 learned_addr learned my addr 172.21.15.117:0/2579329444 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:53.353 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f65ef7fe700 1 --2- 172.21.15.117:0/2579329444 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e180923c10 0x55e18093da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.353 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f65eeffd700 1 --2- 172.21.15.117:0/2579329444 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f6210 0x55e180926550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.353 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f65ee7fc700 1 -- 172.21.15.117:0/2579329444 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f6210 msgr2=0x55e180926550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:53.353 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f65ee7fc700 1 --2- 172.21.15.117:0/2579329444 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f6210 0x55e180926550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.353 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f65ee7fc700 1 -- 172.21.15.117:0/2579329444 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e180923c10 msgr2=0x55e18093da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:53.353 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f65ee7fc700 1 --2- 172.21.15.117:0/2579329444 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e180923c10 0x55e18093da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.353 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f65ee7fc700 1 -- 172.21.15.117:0/2579329444 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f0146040 con 0x55e1808f65e0 2023-07-19T20:44:53.354 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.349+0000 7f65ee7fc700 1 --2- 172.21.15.117:0/2579329444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e180920f30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f65e0053390 tx=0x7f65e0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0bc970b97f2630 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:53.354 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f65ce7fc700 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2023-07-19T20:44:53.354 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f65ce7fc700 1 -- 172.21.15.117:0/2579329444 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e006e040 con 0x55e1808f65e0 2023-07-19T20:44:53.354 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f65ce7fc700 1 -- 172.21.15.117:0/2579329444 <== mon.0 v2:172.21.15.117:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f65e00552f0 con 0x55e1808f65e0 2023-07-19T20:44:53.354 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f66019e9b80 1 -- 172.21.15.117:0/2579329444 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1807a3b00 con 0x55e1808f65e0 2023-07-19T20:44:53.354 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f65ce7fc700 1 -- 172.21.15.117:0/2579329444 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65e0052c80 con 0x55e1808f65e0 2023-07-19T20:44:53.354 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f66019e9b80 10 client.4602 fetch_fsmap learned FSMap version 8 2023-07-19T20:44:53.354 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f66019e9b80 1 -- 172.21.15.117:0/2579329444 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e18072a0a0 con 0x55e1808f65e0 2023-07-19T20:44:53.355 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f65ce7fc700 1 -- 172.21.15.117:0/2579329444 <== mon.0 v2:172.21.15.117:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e1807a3b00 con 0x55e1808f65e0 2023-07-19T20:44:53.355 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f65ce7fc700 1 -- 172.21.15.117:0/2579329444 <== mon.0 v2:172.21.15.117:3300/0 5 ==== fsmap(e 8) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f65e0052de0 con 0x55e1808f65e0 2023-07-19T20:44:53.355 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f66019e9b80 10 client.4602 fetch_fsmap finished waiting for FSMap version 8 2023-07-19T20:44:53.355 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f66019e9b80 10 client.4602 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-19T20:44:53.355 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f66019e9b80 20 client.4602 populate_metadata read hostname 'smithi117' 2023-07-19T20:44:53.355 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f66019e9b80 1 --2- 172.21.15.117:0/2579329444 >> [v2:172.21.15.117:6836/479216080,v1:172.21.15.117:6837/479216080] conn(0x55e18093e480 0x55e180915120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.355 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f66019e9b80 4 client.4602 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-19T20:44:53.356 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f66019e9b80 1 -- 172.21.15.117:0/2579329444 --> [v2:172.21.15.117:6836/479216080,v1:172.21.15.117:6837/479216080] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e180842400 con 0x55e18093e480 2023-07-19T20:44:53.356 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f65eeffd700 1 --2- 172.21.15.117:0/2579329444 >> [v2:172.21.15.117:6836/479216080,v1:172.21.15.117:6837/479216080] conn(0x55e18093e480 0x55e180915120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.356 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f65ce7fc700 10 client.4602 ms_handle_connect on v2:172.21.15.117:6836/479216080 2023-07-19T20:44:53.356 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.350+0000 7f65eeffd700 1 --2- 172.21.15.117:0/2579329444 >> [v2:172.21.15.117:6836/479216080,v1:172.21.15.117:6837/479216080] conn(0x55e18093e480 0x55e180915120 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98f7d97a8bf0f55c server_cookie=fcc02c90665ea8aa in_seq=0 out_seq=0 2023-07-19T20:44:53.356 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f65ce7fc700 1 -- 172.21.15.117:0/2579329444 <== mds.0 v2:172.21.15.117:6836/479216080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x55e180842400 con 0x55e18093e480 2023-07-19T20:44:53.356 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f65ce7fc700 10 client.4602 handle_command_reply: tid=0 2023-07-19T20:44:53.356 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f66019e9b80 1 client.4602 shutdown 2023-07-19T20:44:53.356 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f66019e9b80 1 -- 172.21.15.117:0/2579329444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 msgr2=0x55e180920f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.357 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f66019e9b80 1 --2- 172.21.15.117:0/2579329444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e180920f30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f65e0053390 tx=0x7f65e0007f90 comp rx=0 tx=0).stop 2023-07-19T20:44:53.357 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f66019e9b80 1 -- 172.21.15.117:0/2579329444 shutdown_connections 2023-07-19T20:44:53.357 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f66019e9b80 1 --2- 172.21.15.117:0/2579329444 >> [v2:172.21.15.117:6836/479216080,v1:172.21.15.117:6837/479216080] conn(0x55e18093e480 0x55e180915120 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.357 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f66019e9b80 1 --2- 172.21.15.117:0/2579329444 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e180923c10 0x55e18093da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.357 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f65ce7fc700 0 client.4602 ms_handle_reset on v2:172.21.15.117:6836/479216080 2023-07-19T20:44:53.357 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f66019e9b80 1 --2- 172.21.15.117:0/2579329444 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f6210 0x55e180926550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.357 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f66019e9b80 1 --2- 172.21.15.117:0/2579329444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e180920f30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.358 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f66019e9b80 1 -- 172.21.15.117:0/2579329444 >> 172.21.15.117:0/2579329444 conn(0x55e1808ed1b0 msgr2=0x55e1808f2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:53.358 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f66019e9b80 1 -- 172.21.15.117:0/2579329444 shutdown_connections 2023-07-19T20:44:53.358 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f66019e9b80 1 -- 172.21.15.117:0/2579329444 wait complete. 2023-07-19T20:44:53.358 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.351+0000 7f66019e9b80 20 client.4602 trim_cache size 0 max 16384 2023-07-19T20:44:53.362 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.368+0000 7f66019e9b80 1 Processor -- start 2023-07-19T20:44:53.363 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.368+0000 7f66019e9b80 1 -- start start 2023-07-19T20:44:53.364 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f66019e9b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e1808f6210 0x55e18093d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.365 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f66019e9b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e1809241f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.365 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f66019e9b80 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e180923c10 0x55e180924730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.365 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f66019e9b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e18063e390 con 0x55e1808f65e0 2023-07-19T20:44:53.365 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f66019e9b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1808f38e0 con 0x55e1808f6210 2023-07-19T20:44:53.365 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f66019e9b80 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1807a3b00 con 0x55e180923c10 2023-07-19T20:44:53.365 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f65ee7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e1809241f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.366 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f65ee7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e1809241f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47662/0 (socket says 172.21.15.117:47662) 2023-07-19T20:44:53.366 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f65ee7fc700 1 -- 172.21.15.117:0/674180904 learned_addr learned my addr 172.21.15.117:0/674180904 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:53.366 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f65eeffd700 1 --2- 172.21.15.117:0/674180904 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e1808f6210 0x55e18093d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.366 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f65ef7fe700 1 --2- 172.21.15.117:0/674180904 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e180923c10 0x55e180924730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.366 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f65ee7fc700 1 -- 172.21.15.117:0/674180904 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e180923c10 msgr2=0x55e180924730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:53.366 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f65ee7fc700 1 --2- 172.21.15.117:0/674180904 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e180923c10 0x55e180924730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.366 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f65ee7fc700 1 -- 172.21.15.117:0/674180904 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e1808f6210 msgr2=0x55e18093d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:53.366 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f65ee7fc700 1 --2- 172.21.15.117:0/674180904 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e1808f6210 0x55e18093d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f65ee7fc700 1 -- 172.21.15.117:0/674180904 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e180810010 con 0x55e1808f65e0 2023-07-19T20:44:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f65ee7fc700 1 --2- 172.21.15.117:0/674180904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e1809241f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65e000a040 tx=0x7f65e0062000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ec30e0cb4d0e54 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.369+0000 7f65d5ffb700 1 -- 172.21.15.117:0/674180904 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e006e040 con 0x55e1808f65e0 2023-07-19T20:44:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.370+0000 7f65d5ffb700 1 -- 172.21.15.117:0/674180904 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e00552f0 con 0x55e1808f65e0 2023-07-19T20:44:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.370+0000 7f65d5ffb700 1 -- 172.21.15.117:0/674180904 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00860e0 con 0x55e1808f65e0 2023-07-19T20:44:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.370+0000 7f66019e9b80 1 -- 172.21.15.117:0/674180904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 msgr2=0x55e1809241f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.370+0000 7f66019e9b80 1 --2- 172.21.15.117:0/674180904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e1809241f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65e000a040 tx=0x7f65e0062000 comp rx=0 tx=0).stop 2023-07-19T20:44:53.368 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.370+0000 7f66019e9b80 1 -- 172.21.15.117:0/674180904 shutdown_connections 2023-07-19T20:44:53.368 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.370+0000 7f66019e9b80 1 --2- 172.21.15.117:0/674180904 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e180923c10 0x55e180924730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.368 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.370+0000 7f66019e9b80 1 --2- 172.21.15.117:0/674180904 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e1808f6210 0x55e18093d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.368 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.370+0000 7f66019e9b80 1 --2- 172.21.15.117:0/674180904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1808f65e0 0x55e1809241f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.368 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.370+0000 7f66019e9b80 1 -- 172.21.15.117:0/674180904 >> 172.21.15.117:0/674180904 conn(0x55e1808ed1b0 msgr2=0x55e180944880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:53.368 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.370+0000 7f66019e9b80 1 -- 172.21.15.117:0/674180904 shutdown_connections 2023-07-19T20:44:53.368 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.370+0000 7f66019e9b80 1 -- 172.21.15.117:0/674180904 wait complete. 2023-07-19T20:44:53.371 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.371+0000 7f66019e9b80 1 -- start start 2023-07-19T20:44:53.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.371+0000 7f66019e9b80 1 Processor -- start 2023-07-19T20:44:53.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.371+0000 7f66019e9b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e1808f6210 0x55e1808f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.371+0000 7f66019e9b80 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f65e0 0x55e1808f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.371+0000 7f66019e9b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e180923c10 0x55e180923fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.371+0000 7f66019e9b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e180925470 con 0x55e180923c10 2023-07-19T20:44:53.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.371+0000 7f66019e9b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e180925680 con 0x55e1808f6210 2023-07-19T20:44:53.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.371+0000 7f66019e9b80 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e180923300 con 0x55e1808f65e0 2023-07-19T20:44:53.372 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.371+0000 7f66019e9b80 10 client.0 _ll_register_callbacks cb 0x55e1807e74e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-19T20:44:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ef7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e180923c10 0x55e180923fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ef7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e180923c10 0x55e180923fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47664/0 (socket says 172.21.15.117:47664) 2023-07-19T20:44:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ef7fe700 1 -- 172.21.15.117:0/1448658954 learned_addr learned my addr 172.21.15.117:0/1448658954 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65eeffd700 1 --2- 172.21.15.117:0/1448658954 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e1808f6210 0x55e1808f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ee7fc700 1 --2- 172.21.15.117:0/1448658954 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f65e0 0x55e1808f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ef7fe700 1 -- 172.21.15.117:0/1448658954 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f65e0 msgr2=0x55e1808f13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ef7fe700 1 --2- 172.21.15.117:0/1448658954 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f65e0 0x55e1808f13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.374 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ef7fe700 1 -- 172.21.15.117:0/1448658954 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e1808f6210 msgr2=0x55e1808f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:53.374 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ef7fe700 1 --2- 172.21.15.117:0/1448658954 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e1808f6210 0x55e1808f2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.374 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ef7fe700 1 -- 172.21.15.117:0/1448658954 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e18072a0a0 con 0x55e180923c10 2023-07-19T20:44:53.374 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ef7fe700 1 --2- 172.21.15.117:0/1448658954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e180923c10 0x55e180923fe0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f65f00bb450 tx=0x7f65e8004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ec1d47873f7c2a server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:53.374 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ce7fc700 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2023-07-19T20:44:53.374 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ce7fc700 1 -- 172.21.15.117:0/1448658954 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8012de0 con 0x55e180923c10 2023-07-19T20:44:53.374 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ce7fc700 1 -- 172.21.15.117:0/1448658954 <== mon.0 v2:172.21.15.117:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f65e8021040 con 0x55e180923c10 2023-07-19T20:44:53.374 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f66019e9b80 1 -- 172.21.15.117:0/1448658954 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65e005f1e0 con 0x55e180923c10 2023-07-19T20:44:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ce7fc700 1 -- 172.21.15.117:0/1448658954 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65e8004040 con 0x55e180923c10 2023-07-19T20:44:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f66019e9b80 10 client.4608 fetch_fsmap learned FSMap version 8 2023-07-19T20:44:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f66019e9b80 1 -- 172.21.15.117:0/1448658954 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e18069e1d0 con 0x55e180923c10 2023-07-19T20:44:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ce7fc700 1 -- 172.21.15.117:0/1448658954 <== mon.0 v2:172.21.15.117:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e005f1e0 con 0x55e180923c10 2023-07-19T20:44:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f65ce7fc700 1 -- 172.21.15.117:0/1448658954 <== mon.0 v2:172.21.15.117:3300/0 5 ==== fsmap(e 8) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f65e8025050 con 0x55e180923c10 2023-07-19T20:44:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f66019e9b80 10 client.4608 fetch_fsmap finished waiting for FSMap version 8 2023-07-19T20:44:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f66019e9b80 10 client.4608 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-19T20:44:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f66019e9b80 20 client.4608 populate_metadata read hostname 'smithi117' 2023-07-19T20:44:53.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f66019e9b80 1 --2- 172.21.15.117:0/1448658954 >> [v2:172.21.15.117:6836/479216080,v1:172.21.15.117:6837/479216080] conn(0x55e1809248b0 0x55e18098c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f66019e9b80 4 client.4608 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2023-07-19T20:44:53.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.372+0000 7f66019e9b80 1 -- 172.21.15.117:0/1448658954 --> [v2:172.21.15.117:6836/479216080,v1:172.21.15.117:6837/479216080] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e180698ef0 con 0x55e1809248b0 2023-07-19T20:44:53.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f65eeffd700 1 --2- 172.21.15.117:0/1448658954 >> [v2:172.21.15.117:6836/479216080,v1:172.21.15.117:6837/479216080] conn(0x55e1809248b0 0x55e18098c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f65ce7fc700 10 client.4608 ms_handle_connect on v2:172.21.15.117:6836/479216080 2023-07-19T20:44:53.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f65eeffd700 1 --2- 172.21.15.117:0/1448658954 >> [v2:172.21.15.117:6836/479216080,v1:172.21.15.117:6837/479216080] conn(0x55e1809248b0 0x55e18098c340 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13499f163fb0d571 server_cookie=3b0f64a4f2f44693 in_seq=0 out_seq=0 2023-07-19T20:44:53.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f65ce7fc700 1 -- 172.21.15.117:0/1448658954 <== mds.0 v2:172.21.15.117:6836/479216080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55e180698ef0 con 0x55e1809248b0 2023-07-19T20:44:53.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f65ce7fc700 10 client.4608 handle_command_reply: tid=0 2023-07-19T20:44:53.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f66019e9b80 1 client.4608 shutdown 2023-07-19T20:44:53.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f66019e9b80 1 -- 172.21.15.117:0/1448658954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e180923c10 msgr2=0x55e180923fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f66019e9b80 1 --2- 172.21.15.117:0/1448658954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e180923c10 0x55e180923fe0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f65f00bb450 tx=0x7f65e8004b40 comp rx=0 tx=0).stop 2023-07-19T20:44:53.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f66019e9b80 1 -- 172.21.15.117:0/1448658954 shutdown_connections 2023-07-19T20:44:53.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f66019e9b80 1 --2- 172.21.15.117:0/1448658954 >> [v2:172.21.15.117:6836/479216080,v1:172.21.15.117:6837/479216080] conn(0x55e1809248b0 0x55e18098c340 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f66019e9b80 1 --2- 172.21.15.117:0/1448658954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e180923c10 0x55e180923fe0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f66019e9b80 1 --2- 172.21.15.117:0/1448658954 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e1808f6210 0x55e1808f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f65ce7fc700 0 client.4608 ms_handle_reset on v2:172.21.15.117:6836/479216080 2023-07-19T20:44:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f66019e9b80 1 --2- 172.21.15.117:0/1448658954 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x55e1808f65e0 0x55e1808f13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f66019e9b80 1 -- 172.21.15.117:0/1448658954 >> 172.21.15.117:0/1448658954 conn(0x55e1808ed1b0 msgr2=0x55e1808f7130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f66019e9b80 1 -- 172.21.15.117:0/1448658954 shutdown_connections 2023-07-19T20:44:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f66019e9b80 1 -- 172.21.15.117:0/1448658954 wait complete. 2023-07-19T20:44:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.373+0000 7f66019e9b80 20 client.4608 trim_cache size 0 max 16384 2023-07-19T20:44:53.379 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-07-19T20:44:53.379 INFO:teuthology.orchestra.run.smithi117.stdout: "cluster_fsid": "46db5732-4a4f-4d1e-835b-9507e9513c02", 2023-07-19T20:44:53.379 INFO:teuthology.orchestra.run.smithi117.stdout: "whoami": 0, 2023-07-19T20:44:53.379 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4288, 2023-07-19T20:44:53.379 INFO:teuthology.orchestra.run.smithi117.stdout: "want_state": "up:active", 2023-07-19T20:44:53.379 INFO:teuthology.orchestra.run.smithi117.stdout: "state": "up:active", 2023-07-19T20:44:53.380 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs", 2023-07-19T20:44:53.380 INFO:teuthology.orchestra.run.smithi117.stdout: "rank_uptime": 14.824980245000001, 2023-07-19T20:44:53.380 INFO:teuthology.orchestra.run.smithi117.stdout: "mdsmap_epoch": 8, 2023-07-19T20:44:53.380 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_epoch": 22, 2023-07-19T20:44:53.380 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_epoch_barrier": 22, 2023-07-19T20:44:53.380 INFO:teuthology.orchestra.run.smithi117.stdout: "uptime": 20.132362729 2023-07-19T20:44:53.380 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-07-19T20:44:53.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.374+0000 7f65f5845700 1 -- 172.21.15.117:0/603148584 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f65dc06a660 msgr2=0x7f65dc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.374+0000 7f65f5845700 1 --2- 172.21.15.117:0/603148584 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f65dc06a660 0x7f65dc06cb10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f65e4005910 tx=0x7f65e4009040 comp rx=0 tx=0).stop 2023-07-19T20:44:53.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.374+0000 7f65f5845700 1 -- 172.21.15.117:0/603148584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f00b94b0 msgr2=0x7f65f01d7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.374+0000 7f65f5845700 1 --2- 172.21.15.117:0/603148584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f00b94b0 0x7f65f01d7a80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c4b0 tx=0x7f65e000c7c0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.374+0000 7f65f5845700 1 -- 172.21.15.117:0/603148584 shutdown_connections 2023-07-19T20:44:53.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.374+0000 7f65f5845700 1 --2- 172.21.15.117:0/603148584 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f65dc06a660 0x7f65dc06cb10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.374+0000 7f65f5845700 1 --2- 172.21.15.117:0/603148584 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65f00bacb0 0x7f65f013de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.374+0000 7f65f5845700 1 --2- 172.21.15.117:0/603148584 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65f0071be0 0x7f65f01459a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.374+0000 7f65f5845700 1 --2- 172.21.15.117:0/603148584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f00b94b0 0x7f65f01d7a80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.374+0000 7f65f5845700 1 -- 172.21.15.117:0/603148584 >> 172.21.15.117:0/603148584 conn(0x7f65f00be4b0 msgr2=0x7f65f0144470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:53.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.374+0000 7f65f5845700 1 -- 172.21.15.117:0/603148584 shutdown_connections 2023-07-19T20:44:53.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.374+0000 7f65f5845700 1 -- 172.21.15.117:0/603148584 wait complete. 2023-07-19T20:44:53.384 INFO:teuthology.run_tasks:Running task kclient... 2023-07-19T20:44:53.409 INFO:tasks.kclient:Mounting kernel clients... 2023-07-19T20:44:53.409 INFO:tasks.kclient:config is {'client.0': {}} 2023-07-19T20:44:53.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:53.410 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-07-19T20:44:53.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:53.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2023-07-19T20:44:53.538 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2023-07-19T20:44:53.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-19T20:44:53.541 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-07-19T20:44:53.541 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-19T20:44:53.541 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-19T20:44:53.542 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-19T20:44:53.665 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.668+0000 7fbc7fd4e700 1 Processor -- start 2023-07-19T20:44:53.666 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.669+0000 7fbc7fd4e700 1 -- start start 2023-07-19T20:44:53.666 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.669+0000 7fbc7fd4e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc780b6dc0 0x7fbc780b8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.666 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.669+0000 7fbc7fd4e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbc780b95e0 0x7fbc7806b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.666 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7fd4e700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc78141f60 con 0x7fbc7814ad30 2023-07-19T20:44:53.666 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7fd4e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc780719f0 con 0x7fbc780b6dc0 2023-07-19T20:44:53.668 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7fd4e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc78070a50 con 0x7fbc780b95e0 2023-07-19T20:44:53.669 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7daea700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc780b6dc0 0x7fbc780b8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.669 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7daea700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc780b6dc0 0x7fbc780b8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47674/0 (socket says 172.21.15.117:47674) 2023-07-19T20:44:53.669 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7daea700 1 -- 172.21.15.117:0/2568122195 learned_addr learned my addr 172.21.15.117:0/2568122195 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:53.669 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7d2e9700 1 --2- 172.21.15.117:0/2568122195 >> v2:172.21.15.124:3300/0 conn(0x7fbc780b95e0 0x7fbc7806b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.670 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7daea700 1 -- 172.21.15.117:0/2568122195 >> v2:172.21.15.124:3300/0 conn(0x7fbc780b95e0 msgr2=0x7fbc7806b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:53.670 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7daea700 1 --2- 172.21.15.117:0/2568122195 >> v2:172.21.15.124:3300/0 conn(0x7fbc780b95e0 0x7fbc7806b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.670 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7daea700 1 -- 172.21.15.117:0/2568122195 >> v1:172.21.15.124:6789/0 conn(0x7fbc7814ad30 legacy=0x7fbc78147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.670 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7daea700 1 -- 172.21.15.117:0/2568122195 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc780b9300 con 0x7fbc780b6dc0 2023-07-19T20:44:53.670 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7daea700 1 --2- 172.21.15.117:0/2568122195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc780b6dc0 0x7fbc780b8dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc780b7600 tx=0x7fbc74009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0912d553462675 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:53.670 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7cae8700 1 -- 172.21.15.117:0/2568122195 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400b870 con 0x7fbc780b6dc0 2023-07-19T20:44:53.671 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7cae8700 1 -- 172.21.15.117:0/2568122195 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7400b9d0 con 0x7fbc780b6dc0 2023-07-19T20:44:53.671 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.670+0000 7fbc7cae8700 1 -- 172.21.15.117:0/2568122195 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400bd60 con 0x7fbc780b6dc0 2023-07-19T20:44:53.671 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.671+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/2568122195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc780b6dc0 msgr2=0x7fbc780b8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.671 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.671+0000 7fbc7fd4e700 1 --2- 172.21.15.117:0/2568122195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc780b6dc0 0x7fbc780b8dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc780b7600 tx=0x7fbc74009bd0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.671 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.671+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/2568122195 shutdown_connections 2023-07-19T20:44:53.671 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.671+0000 7fbc7fd4e700 1 --2- 172.21.15.117:0/2568122195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc780b6dc0 0x7fbc780b8dc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.672 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.671+0000 7fbc7fd4e700 1 --2- 172.21.15.117:0/2568122195 >> v2:172.21.15.124:3300/0 conn(0x7fbc780b95e0 0x7fbc7806b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.672 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.671+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/2568122195 >> 172.21.15.117:0/2568122195 conn(0x7fbc780bdc00 msgr2=0x7fbc780b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:53.672 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.671+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/2568122195 shutdown_connections 2023-07-19T20:44:53.672 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.671+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/2568122195 wait complete. 2023-07-19T20:44:53.675 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.672+0000 7fbc7fd4e700 1 Processor -- start 2023-07-19T20:44:53.675 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.672+0000 7fbc7fd4e700 1 -- start start 2023-07-19T20:44:53.676 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7fd4e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc780b6dc0 0x7fbc78144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.676 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7fd4e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc780b95e0 0x7fbc781e02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.676 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7fd4e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7814ad30 0x7fbc7813f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.676 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7fd4e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc78144bd0 con 0x7fbc7814ad30 2023-07-19T20:44:53.676 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7fd4e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc781d2820 con 0x7fbc780b95e0 2023-07-19T20:44:53.677 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7fd4e700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc781400b0 con 0x7fbc780b6dc0 2023-07-19T20:44:53.677 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7e2eb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7814ad30 0x7fbc7813f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.677 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7e2eb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7814ad30 0x7fbc7813f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47686/0 (socket says 172.21.15.117:47686) 2023-07-19T20:44:53.678 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7e2eb700 1 -- 172.21.15.117:0/1072680531 learned_addr learned my addr 172.21.15.117:0/1072680531 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:53.678 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7d2e9700 1 --2- 172.21.15.117:0/1072680531 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc780b95e0 0x7fbc781e02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.678 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7e2eb700 1 -- 172.21.15.117:0/1072680531 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc780b6dc0 msgr2=0x7fbc78144690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.678 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7daea700 1 --2- 172.21.15.117:0/1072680531 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc780b6dc0 0x7fbc78144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.678 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7e2eb700 1 --2- 172.21.15.117:0/1072680531 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc780b6dc0 0x7fbc78144690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.678 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7e2eb700 1 -- 172.21.15.117:0/1072680531 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc780b95e0 msgr2=0x7fbc781e02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.678 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7e2eb700 1 --2- 172.21.15.117:0/1072680531 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc780b95e0 0x7fbc781e02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.679 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.673+0000 7fbc7e2eb700 1 -- 172.21.15.117:0/1072680531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc74009550 con 0x7fbc7814ad30 2023-07-19T20:44:53.679 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.674+0000 7fbc7e2eb700 1 --2- 172.21.15.117:0/1072680531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7814ad30 0x7fbc7813f160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000cb50 tx=0x7fbc7000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:53.679 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.674+0000 7fbc6e7fc700 1 -- 172.21.15.117:0/1072680531 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc70003c00 con 0x7fbc7814ad30 2023-07-19T20:44:53.679 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.674+0000 7fbc6e7fc700 1 -- 172.21.15.117:0/1072680531 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc70003d60 con 0x7fbc7814ad30 2023-07-19T20:44:53.679 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.674+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/1072680531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc781d0e20 con 0x7fbc7814ad30 2023-07-19T20:44:53.679 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.674+0000 7fbc6e7fc700 1 -- 172.21.15.117:0/1072680531 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7000ab70 con 0x7fbc7814ad30 2023-07-19T20:44:53.679 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.674+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/1072680531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc781d11b0 con 0x7fbc7814ad30 2023-07-19T20:44:53.680 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.675+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/1072680531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7813fe70 con 0x7fbc7814ad30 2023-07-19T20:44:53.680 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.675+0000 7fbc6e7fc700 1 -- 172.21.15.117:0/1072680531 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fbc7000acd0 con 0x7fbc7814ad30 2023-07-19T20:44:53.680 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.675+0000 7fbc6e7fc700 1 --2- 172.21.15.117:0/1072680531 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fbc5c06a660 0x7fbc5c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:53.680 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.675+0000 7fbc6e7fc700 1 -- 172.21.15.117:0/1072680531 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc7008aad0 con 0x7fbc7814ad30 2023-07-19T20:44:53.680 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.676+0000 7fbc7daea700 1 --2- 172.21.15.117:0/1072680531 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fbc5c06a660 0x7fbc5c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:53.680 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.676+0000 7fbc7daea700 1 --2- 172.21.15.117:0/1072680531 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fbc5c06a660 0x7fbc5c06cb10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009130 tx=0x7fbc74008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:53.680 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.680+0000 7fbc6e7fc700 1 -- 172.21.15.117:0/1072680531 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fbc7813fe70 con 0x7fbc7814ad30 2023-07-19T20:44:53.906 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.911+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/1072680531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbc7813fe70 con 0x7fbc7814ad30 2023-07-19T20:44:53.906 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.912+0000 7fbc6e7fc700 1 -- 172.21.15.117:0/1072680531 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbc7001f060 con 0x7fbc7814ad30 2023-07-19T20:44:53.907 INFO:teuthology.orchestra.run.smithi117.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-19T20:44:53.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.914+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/1072680531 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fbc5c06a660 msgr2=0x7fbc5c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.914+0000 7fbc7fd4e700 1 --2- 172.21.15.117:0/1072680531 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fbc5c06a660 0x7fbc5c06cb10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009130 tx=0x7fbc74008030 comp rx=0 tx=0).stop 2023-07-19T20:44:53.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.914+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/1072680531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7814ad30 msgr2=0x7fbc7813f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:53.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.914+0000 7fbc7fd4e700 1 --2- 172.21.15.117:0/1072680531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7814ad30 0x7fbc7813f160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000cb50 tx=0x7fbc7000cf10 comp rx=0 tx=0).stop 2023-07-19T20:44:53.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.914+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/1072680531 shutdown_connections 2023-07-19T20:44:53.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.914+0000 7fbc7fd4e700 1 --2- 172.21.15.117:0/1072680531 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fbc5c06a660 0x7fbc5c06cb10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.914+0000 7fbc7fd4e700 1 --2- 172.21.15.117:0/1072680531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc7814ad30 0x7fbc7813f160 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.914+0000 7fbc7fd4e700 1 --2- 172.21.15.117:0/1072680531 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc780b6dc0 0x7fbc78144690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.914+0000 7fbc7fd4e700 1 --2- 172.21.15.117:0/1072680531 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc780b95e0 0x7fbc781e02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:53.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.914+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/1072680531 >> 172.21.15.117:0/1072680531 conn(0x7fbc780bdc00 msgr2=0x7fbc78148c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:53.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.914+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/1072680531 shutdown_connections 2023-07-19T20:44:53.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:53.914+0000 7fbc7fd4e700 1 -- 172.21.15.117:0/1072680531 wait complete. 2023-07-19T20:44:53.920 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-19T20:44:53.921 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-19T20:44:53.921 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-07-19T20:44:53.921 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-19T20:44:53.921 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-19T20:44:53.922 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-19T20:44:53.922 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-19T20:44:53.922 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-19T20:44:53.922 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-19T20:44:53.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:53.923 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-07-19T20:44:53.971 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-19T20:44:53.971 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-19T20:44:53.972 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-07-19T20:44:53.972 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-07-19T20:44:53.972 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-07-19T20:44:53.972 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-07-19T20:44:53.972 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-19T20:44:53.972 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-07-19T20:44:53.973 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-07-19T20:44:53.973 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-19T20:44:53.973 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-07-19T20:44:53.973 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-07-19T20:44:53.973 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-19T20:44:53.973 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-07-19T20:44:53.973 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-19T20:44:53.975 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-07-19T20:44:53.976 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-19T20:44:53.976 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42074sec preferred_lft 42074sec 2023-07-19T20:44:53.976 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-07-19T20:44:53.977 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-07-19T20:44:53.978 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-19T20:44:53.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:53.978 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-07-19T20:44:53.979 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-07-19T20:44:53.979 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add name ceph-brx type bridge 2023-07-19T20:44:53.979 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr flush dev ceph-brx 2023-07-19T20:44:53.979 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set ceph-brx up 2023-07-19T20:44:53.980 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-19T20:44:53.980 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-07-19T20:44:54.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:54.417 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-19T20:44:54.526 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-07-19T20:44:54.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:54.530 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-07-19T20:44:54.601 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-07-19T20:44:54.602 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-19T20:44:54.602 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-19T20:44:54.602 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-19T20:44:54.602 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-19T20:44:54.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:54.603 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-07-19T20:44:54.604 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-07-19T20:44:54.604 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-19T20:44:54.604 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-19T20:44:54.604 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-19T20:44:54.605 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-07-19T20:44:55.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:55.256 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-07-19T20:44:55.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:55.303 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list-id 2023-07-19T20:44:55.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:55.350 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-07-19T20:44:55.350 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-07-19T20:44:55.351 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-19T20:44:55.351 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-19T20:44:55.351 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-07-19T20:44:55.529 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-19T20:44:55.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:55.530 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-07-19T20:44:55.530 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-07-19T20:44:55.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-19T20:44:55.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-19T20:44:55.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-19T20:44:55.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-19T20:44:55.532 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-19T20:44:55.532 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-07-19T20:44:55.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:55.807 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-07-19T20:44:55.808 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-07-19T20:44:55.808 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-07-19T20:44:55.808 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set dev brx.0 master ceph-brx 2023-07-19T20:44:55.809 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-07-19T20:44:55.979 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-19T20:44:55.979 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-19T20:44:56.025 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-19T20:44:56.025 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-19T20:44:56.026 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-19T20:44:56.109 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-19T20:44:56.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:56.110 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-19T20:44:56.255 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-19T20:44:56.255 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-19T20:44:56.255 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-07-19T20:44:56.689 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-19T20:44:56.690 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-19T20:44:56.690 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-07-19T20:44:56.690 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.117:3300,172.21.15.124:3300,172.21.15.124:3301" 2023-07-19T20:44:56.691 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-19T20:44:56.714 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-19T20:44:56.714 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-19T20:44:56.715 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-07-19T20:44:56.715 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.117:3300,172.21.15.124:3300,172.21.15.124:3301" 2023-07-19T20:44:56.715 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-19T20:44:56.715 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.117:6789,172.21.15.124:6789,172.21.15.124:6790" 2023-07-19T20:44:56.715 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.117:6789,172.21.15.124:6789,172.21.15.124:6790:/ 2023-07-19T20:44:56.716 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=46db5732-4a4f-4d1e-835b-9507e9513c02" will pass to kernel 2023-07-19T20:44:56.720 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-19T20:44:56.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:56.721 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-19T20:44:56.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:56.793 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-19T20:44:56.904 INFO:teuthology.orchestra.run.smithi130.stdout:client4617 2023-07-19T20:44:56.905 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:44:56.905 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-19T20:44:56.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:56.951 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-19T20:44:57.097 INFO:teuthology.orchestra.run.smithi130.stdout:client4617 2023-07-19T20:44:57.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:57.098 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-19T20:44:57.208 INFO:teuthology.orchestra.run.smithi130.stdout:client4617 2023-07-19T20:44:57.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:44:57.209 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/46db5732-4a4f-4d1e-835b-9507e9513c02.client4617/status') 2023-07-19T20:44:57.334 INFO:teuthology.orchestra.run.smithi130.stdout:instance: client.4617 (3)172.21.15.130:0/2193504760 2023-07-19T20:44:57.335 INFO:teuthology.orchestra.run.smithi130.stdout:blocklisted: false 2023-07-19T20:44:57.335 INFO:teuthology.orchestra.run.smithi130.stderr:0+1 records in 2023-07-19T20:44:57.335 INFO:teuthology.orchestra.run.smithi130.stderr:0+1 records out 2023-07-19T20:44:57.335 INFO:teuthology.orchestra.run.smithi130.stderr:71 bytes copied, 5.4398e-05 s, 1.3 MB/s 2023-07-19T20:44:57.337 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-19T20:44:57.806 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:57.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.946+0000 7f263f25d700 1 Processor -- start 2023-07-19T20:44:57.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.946+0000 7f263f25d700 1 -- start start 2023-07-19T20:44:57.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f263f25d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26380c1470 0x7f26380b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:57.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f263f25d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f263814a660 0x7f2638155260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:57.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f263f25d700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26380bcd00 con 0x7f26380b9370 2023-07-19T20:44:57.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f263f25d700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26380b8710 con 0x7f263814a660 2023-07-19T20:44:57.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f263f25d700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26380b8bd0 con 0x7f26380c1470 2023-07-19T20:44:57.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f2637fff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f26380b9370 0x7f2638149f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41722/0 (socket says 172.21.15.117:41722) 2023-07-19T20:44:57.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f2637fff700 1 -- 172.21.15.117:0/2533215131 learned_addr learned my addr 172.21.15.117:0/2533215131 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:57.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f263d7fa700 1 --2- 172.21.15.117:0/2533215131 >> v2:172.21.15.124:3300/0 conn(0x7f263814a660 0x7f2638155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:57.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f263cff9700 1 --2- 172.21.15.117:0/2533215131 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26380c1470 0x7f26380b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:57.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f26377fe700 1 -- 172.21.15.117:0/2533215131 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 642342626 0 0) 0x7f26380bcd00 con 0x7f26380b9370 2023-07-19T20:44:57.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f26377fe700 1 -- 172.21.15.117:0/2533215131 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26240035b0 con 0x7f26380b9370 2023-07-19T20:44:57.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f26377fe700 1 -- 172.21.15.117:0/2533215131 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3225763457 0 0) 0x7f26240035b0 con 0x7f26380b9370 2023-07-19T20:44:57.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f26377fe700 1 -- 172.21.15.117:0/2533215131 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26380c1470 msgr2=0x7f26380b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:57.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f26377fe700 1 --2- 172.21.15.117:0/2533215131 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26380c1470 0x7f26380b8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:57.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f26377fe700 1 -- 172.21.15.117:0/2533215131 >> v2:172.21.15.124:3300/0 conn(0x7f263814a660 msgr2=0x7f2638155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:57.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f26377fe700 1 --2- 172.21.15.117:0/2533215131 >> v2:172.21.15.124:3300/0 conn(0x7f263814a660 0x7f2638155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:57.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f26377fe700 1 -- 172.21.15.117:0/2533215131 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26380bab50 con 0x7f26380b9370 2023-07-19T20:44:57.947 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f26377fe700 1 -- 172.21.15.117:0/2533215131 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f2628001670 con 0x7f26380b9370 2023-07-19T20:44:57.947 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f26377fe700 1 -- 172.21.15.117:0/2533215131 >> v1:172.21.15.117:6789/0 conn(0x7f26380b9370 legacy=0x7f2638149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:57.947 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.947+0000 7f26377fe700 1 --2- 172.21.15.117:0/2533215131 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26380c1470 0x7f2624003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:57.947 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f26377fe700 1 --2- 172.21.15.117:0/2533215131 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2624003f80 0x7f2624004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:57.947 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f26377fe700 1 --2- 172.21.15.117:0/2533215131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2624004d90 0x7f2624005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:57.947 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f26377fe700 1 -- 172.21.15.117:0/2533215131 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26380b8710 con 0x7f2624004d90 2023-07-19T20:44:57.947 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f26377fe700 1 -- 172.21.15.117:0/2533215131 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26380b8bd0 con 0x7f2624003f80 2023-07-19T20:44:57.947 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f26377fe700 1 -- 172.21.15.117:0/2533215131 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262400ba40 con 0x7f26380c1470 2023-07-19T20:44:57.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f263cff9700 1 --2- 172.21.15.117:0/2533215131 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26380c1470 0x7f2624003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:57.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f263d7fa700 1 --2- 172.21.15.117:0/2533215131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2624004d90 0x7f2624005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:57.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f2637fff700 1 --2- 172.21.15.117:0/2533215131 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2624003f80 0x7f2624004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:57.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f263d7fa700 1 -- 172.21.15.117:0/2533215131 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26380c1470 msgr2=0x7f2624003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:57.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f263d7fa700 1 --2- 172.21.15.117:0/2533215131 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26380c1470 0x7f2624003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:57.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f263d7fa700 1 -- 172.21.15.117:0/2533215131 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2624003f80 msgr2=0x7f2624004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:57.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f263d7fa700 1 --2- 172.21.15.117:0/2533215131 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2624003f80 0x7f2624004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:57.948 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f263d7fa700 1 -- 172.21.15.117:0/2533215131 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26240035b0 con 0x7f2624004d90 2023-07-19T20:44:57.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f263d7fa700 1 --2- 172.21.15.117:0/2533215131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2624004d90 0x7f2624005200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2630009fc0 tx=0x7f2624005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadf93b82d3b8dd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:57.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f26377fe700 1 -- 172.21.15.117:0/2533215131 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263000ec30 con 0x7f2624004d90 2023-07-19T20:44:57.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f26377fe700 1 -- 172.21.15.117:0/2533215131 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263000f040 con 0x7f2624004d90 2023-07-19T20:44:57.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.948+0000 7f26377fe700 1 -- 172.21.15.117:0/2533215131 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2630014480 con 0x7f2624004d90 2023-07-19T20:44:57.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.949+0000 7f263f25d700 1 -- 172.21.15.117:0/2533215131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2624004d90 msgr2=0x7f2624005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:57.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.949+0000 7f263f25d700 1 --2- 172.21.15.117:0/2533215131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2624004d90 0x7f2624005200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2630009fc0 tx=0x7f2624005880 comp rx=0 tx=0).stop 2023-07-19T20:44:57.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.949+0000 7f263d7fa700 1 -- 172.21.15.117:0/2533215131 reap_dead start 2023-07-19T20:44:57.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.949+0000 7f263f25d700 1 -- 172.21.15.117:0/2533215131 shutdown_connections 2023-07-19T20:44:57.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.949+0000 7f263f25d700 1 -- 172.21.15.117:0/2533215131 >> 172.21.15.117:0/2533215131 conn(0x7f2638072920 msgr2=0x7f26380c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:57.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.949+0000 7f263f25d700 1 -- 172.21.15.117:0/2533215131 shutdown_connections 2023-07-19T20:44:57.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.949+0000 7f263f25d700 1 -- 172.21.15.117:0/2533215131 wait complete. 2023-07-19T20:44:57.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.950+0000 7f263f25d700 1 Processor -- start 2023-07-19T20:44:57.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.950+0000 7f263f25d700 1 -- start start 2023-07-19T20:44:57.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263f25d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2624004d90 0x7f26381d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:57.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263f25d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2638143de0 0x7f26381451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263f25d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2638146230 0x7f26381d5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263f25d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26381d22e0 con 0x7f2624004d90 2023-07-19T20:44:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263f25d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26381456f0 con 0x7f2638143de0 2023-07-19T20:44:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263f25d700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2638145d50 con 0x7f2638146230 2023-07-19T20:44:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263cff9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2624004d90 0x7f26381d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263cff9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2624004d90 0x7f26381d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47708/0 (socket says 172.21.15.117:47708) 2023-07-19T20:44:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263cff9700 1 -- 172.21.15.117:0/3682840778 learned_addr learned my addr 172.21.15.117:0/3682840778 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263d7fa700 1 --2- 172.21.15.117:0/3682840778 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2638146230 0x7f26381d5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:57.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f2637fff700 1 --2- 172.21.15.117:0/3682840778 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2638143de0 0x7f26381451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:57.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263cff9700 1 -- 172.21.15.117:0/3682840778 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2638146230 msgr2=0x7f26381d5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:57.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263cff9700 1 --2- 172.21.15.117:0/3682840778 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2638146230 0x7f26381d5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:57.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263cff9700 1 -- 172.21.15.117:0/3682840778 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2638143de0 msgr2=0x7f26381451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:57.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263cff9700 1 --2- 172.21.15.117:0/3682840778 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2638143de0 0x7f26381451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:57.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263cff9700 1 -- 172.21.15.117:0/3682840778 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26381d3990 con 0x7f2624004d90 2023-07-19T20:44:57.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263cff9700 1 --2- 172.21.15.117:0/3682840778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2624004d90 0x7f26381d1da0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2620011aa0 tx=0x7f2620011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:57.956 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f26357fa700 1 -- 172.21.15.117:0/3682840778 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620011ee0 con 0x7f2624004d90 2023-07-19T20:44:57.956 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f26357fa700 1 -- 172.21.15.117:0/3682840778 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000f8e0 con 0x7f2624004d90 2023-07-19T20:44:57.956 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263f25d700 1 -- 172.21.15.117:0/3682840778 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26381d3c30 con 0x7f2624004d90 2023-07-19T20:44:57.956 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f26357fa700 1 -- 172.21.15.117:0/3682840778 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000fc90 con 0x7f2624004d90 2023-07-19T20:44:57.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263f25d700 1 -- 172.21.15.117:0/3682840778 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26381d49d0 con 0x7f2624004d90 2023-07-19T20:44:57.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.952+0000 7f263f25d700 1 -- 172.21.15.117:0/3682840778 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26381d2a60 con 0x7f2624004d90 2023-07-19T20:44:57.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.953+0000 7f26357fa700 1 -- 172.21.15.117:0/3682840778 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f26200263f0 con 0x7f2624004d90 2023-07-19T20:44:57.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.954+0000 7f26357fa700 1 --2- 172.21.15.117:0/3682840778 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f261806a690 0x7f261806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:57.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.954+0000 7f2637fff700 1 --2- 172.21.15.117:0/3682840778 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f261806a690 0x7f261806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:57.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.954+0000 7f26357fa700 1 -- 172.21.15.117:0/3682840778 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26200894f0 con 0x7f2624004d90 2023-07-19T20:44:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.954+0000 7f2637fff700 1 --2- 172.21.15.117:0/3682840778 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f261806a690 0x7f261806cb40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f26381e1280 tx=0x7f2628007980 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:57.959+0000 7f26357fa700 1 -- 172.21.15.117:0/3682840778 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2620058420 con 0x7f2624004d90 2023-07-19T20:44:58.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.144+0000 7f263f25d700 1 -- 172.21.15.117:0/3682840778 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2638074890 con 0x7f2624004d90 2023-07-19T20:44:58.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.145+0000 7f26357fa700 1 -- 172.21.15.117:0/3682840778 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17897 (secure 0 0 0) 0x7f2620057fb0 con 0x7f2624004d90 2023-07-19T20:44:58.140 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:58.141 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:39.549566+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:58.142 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.147+0000 7f263f25d700 1 -- 172.21.15.117:0/3682840778 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f261806a690 msgr2=0x7f261806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.142 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.147+0000 7f263f25d700 1 --2- 172.21.15.117:0/3682840778 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f261806a690 0x7f261806cb40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f26381e1280 tx=0x7f2628007980 comp rx=0 tx=0).stop 2023-07-19T20:44:58.142 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.147+0000 7f263f25d700 1 -- 172.21.15.117:0/3682840778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2624004d90 msgr2=0x7f26381d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.147+0000 7f263f25d700 1 --2- 172.21.15.117:0/3682840778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2624004d90 0x7f26381d1da0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2620011aa0 tx=0x7f2620011db0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.147+0000 7f263f25d700 1 -- 172.21.15.117:0/3682840778 shutdown_connections 2023-07-19T20:44:58.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.147+0000 7f263f25d700 1 --2- 172.21.15.117:0/3682840778 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f261806a690 0x7f261806cb40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.147+0000 7f263f25d700 1 --2- 172.21.15.117:0/3682840778 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2638146230 0x7f26381d5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.147+0000 7f263f25d700 1 --2- 172.21.15.117:0/3682840778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2624004d90 0x7f26381d1da0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.147+0000 7f263f25d700 1 --2- 172.21.15.117:0/3682840778 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2638143de0 0x7f26381451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.147+0000 7f263f25d700 1 -- 172.21.15.117:0/3682840778 >> 172.21.15.117:0/3682840778 conn(0x7f2638072920 msgr2=0x7f26380bfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:58.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.148+0000 7f263f25d700 1 -- 172.21.15.117:0/3682840778 shutdown_connections 2023-07-19T20:44:58.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.148+0000 7f263f25d700 1 -- 172.21.15.117:0/3682840778 wait complete. 2023-07-19T20:44:58.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-19T20:44:31.325778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-19T20:44:31.728215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-19T20:44:36.280405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-19T20:44:37.509195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-19T20:44:58.155 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-19T20:44:58.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.284+0000 7f3e97566700 1 Processor -- start 2023-07-19T20:44:58.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.284+0000 7f3e97566700 1 -- start start 2023-07-19T20:44:58.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.285+0000 7f3e97566700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3e9006a560 0x7f3e900a0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.285+0000 7f3e97566700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3e900a2b60 0x7f3e900ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.285+0000 7f3e97566700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e900b8490 con 0x7f3e900a0eb0 2023-07-19T20:44:58.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.285+0000 7f3e97566700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e900bcda0 con 0x7f3e9006a560 2023-07-19T20:44:58.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.285+0000 7f3e97566700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900b9ab0 con 0x7f3e900a2b60 2023-07-19T20:44:58.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.285+0000 7f3e95b03700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f3e900a0eb0 0x7f3e900ba830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41732/0 (socket says 172.21.15.117:41732) 2023-07-19T20:44:58.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.285+0000 7f3e95b03700 1 -- 172.21.15.117:0/1234632136 learned_addr learned my addr 172.21.15.117:0/1234632136 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.285+0000 7f3e95302700 1 --2- 172.21.15.117:0/1234632136 >> v2:172.21.15.124:3300/0 conn(0x7f3e9006a560 0x7f3e900a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.285+0000 7f3e94b01700 1 --2- 172.21.15.117:0/1234632136 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3e900a2b60 0x7f3e900ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.285+0000 7f3e87fff700 1 -- 172.21.15.117:0/1234632136 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84884761 0 0) 0x7f3e900b8490 con 0x7f3e900a0eb0 2023-07-19T20:44:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.285+0000 7f3e87fff700 1 -- 172.21.15.117:0/1234632136 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e7c0035b0 con 0x7f3e900a0eb0 2023-07-19T20:44:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 -- 172.21.15.117:0/1234632136 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 791497826 0 0) 0x7f3e7c0035b0 con 0x7f3e900a0eb0 2023-07-19T20:44:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 -- 172.21.15.117:0/1234632136 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3e900a2b60 msgr2=0x7f3e900ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 --2- 172.21.15.117:0/1234632136 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3e900a2b60 0x7f3e900ba2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 -- 172.21.15.117:0/1234632136 >> v2:172.21.15.124:3300/0 conn(0x7f3e9006a560 msgr2=0x7f3e900a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:58.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 --2- 172.21.15.117:0/1234632136 >> v2:172.21.15.124:3300/0 conn(0x7f3e9006a560 0x7f3e900a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 -- 172.21.15.117:0/1234632136 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e900b9560 con 0x7f3e900a0eb0 2023-07-19T20:44:58.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 -- 172.21.15.117:0/1234632136 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f3e880019f0 con 0x7f3e900a0eb0 2023-07-19T20:44:58.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 -- 172.21.15.117:0/1234632136 >> v1:172.21.15.117:6789/0 conn(0x7f3e900a0eb0 legacy=0x7f3e900ba830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 --2- 172.21.15.117:0/1234632136 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c003a70 0x7f3e7c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 --2- 172.21.15.117:0/1234632136 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3e900a2b60 0x7f3e7c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 --2- 172.21.15.117:0/1234632136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e7c004d90 0x7f3e7c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 -- 172.21.15.117:0/1234632136 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900bcda0 con 0x7f3e7c004d90 2023-07-19T20:44:58.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 -- 172.21.15.117:0/1234632136 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900b9ab0 con 0x7f3e7c003a70 2023-07-19T20:44:58.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 -- 172.21.15.117:0/1234632136 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c00ba10 con 0x7f3e900a2b60 2023-07-19T20:44:58.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e95b03700 1 --2- 172.21.15.117:0/1234632136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e7c004d90 0x7f3e7c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e94b01700 1 --2- 172.21.15.117:0/1234632136 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3e900a2b60 0x7f3e7c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e95302700 1 --2- 172.21.15.117:0/1234632136 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c003a70 0x7f3e7c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e95b03700 1 -- 172.21.15.117:0/1234632136 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3e900a2b60 msgr2=0x7f3e7c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:58.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e95b03700 1 --2- 172.21.15.117:0/1234632136 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3e900a2b60 0x7f3e7c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e95b03700 1 -- 172.21.15.117:0/1234632136 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c003a70 msgr2=0x7f3e7c003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:58.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e95b03700 1 --2- 172.21.15.117:0/1234632136 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c003a70 0x7f3e7c003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e95b03700 1 -- 172.21.15.117:0/1234632136 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c0035b0 con 0x7f3e7c004d90 2023-07-19T20:44:58.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e95b03700 1 --2- 172.21.15.117:0/1234632136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e7c004d90 0x7f3e7c005200 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3e900a12b0 tx=0x7f3e7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16a2d749df642c server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:58.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 -- 172.21.15.117:0/1234632136 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e880072d0 con 0x7f3e7c004d90 2023-07-19T20:44:58.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 -- 172.21.15.117:0/1234632136 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e88007430 con 0x7f3e7c004d90 2023-07-19T20:44:58.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.286+0000 7f3e87fff700 1 -- 172.21.15.117:0/1234632136 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e880077e0 con 0x7f3e7c004d90 2023-07-19T20:44:58.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.287+0000 7f3e97566700 1 -- 172.21.15.117:0/1234632136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e7c004d90 msgr2=0x7f3e7c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.287+0000 7f3e97566700 1 --2- 172.21.15.117:0/1234632136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e7c004d90 0x7f3e7c005200 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3e900a12b0 tx=0x7f3e7c005880 comp rx=0 tx=0).stop 2023-07-19T20:44:58.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.287+0000 7f3e95b03700 1 -- 172.21.15.117:0/1234632136 reap_dead start 2023-07-19T20:44:58.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.287+0000 7f3e97566700 1 -- 172.21.15.117:0/1234632136 shutdown_connections 2023-07-19T20:44:58.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.287+0000 7f3e97566700 1 -- 172.21.15.117:0/1234632136 >> 172.21.15.117:0/1234632136 conn(0x7f3e9009f570 msgr2=0x7f3e9009f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:58.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.287+0000 7f3e97566700 1 -- 172.21.15.117:0/1234632136 shutdown_connections 2023-07-19T20:44:58.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.287+0000 7f3e97566700 1 -- 172.21.15.117:0/1234632136 wait complete. 2023-07-19T20:44:58.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.288+0000 7f3e97566700 1 Processor -- start 2023-07-19T20:44:58.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.288+0000 7f3e97566700 1 -- start start 2023-07-19T20:44:58.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e97566700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3e901cc4c0 0x7f3e9006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e97566700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e9006e410 0x7f3e901c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e97566700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e901ca160 0x7f3e901d4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e97566700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9006cee0 con 0x7f3e901ca160 2023-07-19T20:44:58.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e97566700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e901cd200 con 0x7f3e9006e410 2023-07-19T20:44:58.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e97566700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9006e880 con 0x7f3e901cc4c0 2023-07-19T20:44:58.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e95b03700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e901ca160 0x7f3e901d4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e95b03700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e901ca160 0x7f3e901d4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47722/0 (socket says 172.21.15.117:47722) 2023-07-19T20:44:58.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e95b03700 1 -- 172.21.15.117:0/770020777 learned_addr learned my addr 172.21.15.117:0/770020777 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:58.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e95302700 1 --2- 172.21.15.117:0/770020777 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3e901cc4c0 0x7f3e9006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e94b01700 1 --2- 172.21.15.117:0/770020777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e9006e410 0x7f3e901c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e95b03700 1 -- 172.21.15.117:0/770020777 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3e901cc4c0 msgr2=0x7f3e9006ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e95b03700 1 --2- 172.21.15.117:0/770020777 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3e901cc4c0 0x7f3e9006ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e95b03700 1 -- 172.21.15.117:0/770020777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e9006e410 msgr2=0x7f3e901c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.292 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e95b03700 1 --2- 172.21.15.117:0/770020777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e9006e410 0x7f3e901c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.292 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e95b03700 1 -- 172.21.15.117:0/770020777 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e901d33f0 con 0x7f3e901ca160 2023-07-19T20:44:58.292 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e95b03700 1 --2- 172.21.15.117:0/770020777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e901ca160 0x7f3e901d4410 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3e900bbf90 tx=0x7f3e900723e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:58.292 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e85ffb700 1 -- 172.21.15.117:0/770020777 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88012600 con 0x7f3e901ca160 2023-07-19T20:44:58.292 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e85ffb700 1 -- 172.21.15.117:0/770020777 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e88012760 con 0x7f3e901ca160 2023-07-19T20:44:58.292 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e97566700 1 -- 172.21.15.117:0/770020777 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e901d36d0 con 0x7f3e901ca160 2023-07-19T20:44:58.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.289+0000 7f3e85ffb700 1 -- 172.21.15.117:0/770020777 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88012ad0 con 0x7f3e901ca160 2023-07-19T20:44:58.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.290+0000 7f3e97566700 1 -- 172.21.15.117:0/770020777 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9006c730 con 0x7f3e901ca160 2023-07-19T20:44:58.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.291+0000 7f3e97566700 1 -- 172.21.15.117:0/770020777 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9006dcf0 con 0x7f3e901ca160 2023-07-19T20:44:58.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.291+0000 7f3e85ffb700 1 -- 172.21.15.117:0/770020777 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f3e8801a070 con 0x7f3e901ca160 2023-07-19T20:44:58.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.291+0000 7f3e85ffb700 1 --2- 172.21.15.117:0/770020777 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3e7406a660 0x7f3e7406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.291+0000 7f3e85ffb700 1 -- 172.21.15.117:0/770020777 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e8808a2f0 con 0x7f3e901ca160 2023-07-19T20:44:58.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.291+0000 7f3e95302700 1 --2- 172.21.15.117:0/770020777 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3e7406a660 0x7f3e7406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.292+0000 7f3e95302700 1 --2- 172.21.15.117:0/770020777 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3e7406a660 0x7f3e7406cb10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009c60 tx=0x7f3e80009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:58.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.296+0000 7f3e85ffb700 1 -- 172.21.15.117:0/770020777 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3e88055840 con 0x7f3e901ca160 2023-07-19T20:44:58.474 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.479+0000 7f3e97566700 1 -- 172.21.15.117:0/770020777 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3e901d3bf0 con 0x7f3e901ca160 2023-07-19T20:44:58.474 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.480+0000 7f3e85ffb700 1 -- 172.21.15.117:0/770020777 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3e901d3bf0 con 0x7f3e901ca160 2023-07-19T20:44:58.475 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 8 2023-07-19T20:44:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.482+0000 7f3e97566700 1 -- 172.21.15.117:0/770020777 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3e7406a660 msgr2=0x7f3e7406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.482+0000 7f3e97566700 1 --2- 172.21.15.117:0/770020777 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3e7406a660 0x7f3e7406cb10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009c60 tx=0x7f3e80009210 comp rx=0 tx=0).stop 2023-07-19T20:44:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.482+0000 7f3e97566700 1 -- 172.21.15.117:0/770020777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e901ca160 msgr2=0x7f3e901d4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.482+0000 7f3e97566700 1 --2- 172.21.15.117:0/770020777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e901ca160 0x7f3e901d4410 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3e900bbf90 tx=0x7f3e900723e0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.482+0000 7f3e97566700 1 -- 172.21.15.117:0/770020777 shutdown_connections 2023-07-19T20:44:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.482+0000 7f3e97566700 1 --2- 172.21.15.117:0/770020777 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3e7406a660 0x7f3e7406cb10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.482+0000 7f3e97566700 1 --2- 172.21.15.117:0/770020777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e901ca160 0x7f3e901d4410 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.482+0000 7f3e97566700 1 --2- 172.21.15.117:0/770020777 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3e901cc4c0 0x7f3e9006ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.482+0000 7f3e97566700 1 --2- 172.21.15.117:0/770020777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e9006e410 0x7f3e901c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.482+0000 7f3e97566700 1 -- 172.21.15.117:0/770020777 >> 172.21.15.117:0/770020777 conn(0x7f3e9009f570 msgr2=0x7f3e9009ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.482+0000 7f3e97566700 1 -- 172.21.15.117:0/770020777 shutdown_connections 2023-07-19T20:44:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.482+0000 7f3e97566700 1 -- 172.21.15.117:0/770020777 wait complete. 2023-07-19T20:44:58.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-19T20:44:58.617 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.622+0000 7fdf6d3e9700 1 Processor -- start 2023-07-19T20:44:58.618 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.622+0000 7fdf6d3e9700 1 -- start start 2023-07-19T20:44:58.618 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf6d3e9700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdf680baa60 0x7fdf680b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.618 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf6d3e9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680bca00 0x7fdf680bd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.618 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf6d3e9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf680bd540 con 0x7fdf6814ddd0 2023-07-19T20:44:58.618 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf6d3e9700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf680bdf10 con 0x7fdf680baa60 2023-07-19T20:44:58.619 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf6d3e9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf680b8d70 con 0x7fdf680bca00 2023-07-19T20:44:58.619 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf66ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdf680baa60 0x7fdf680b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.619 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf66ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdf680baa60 0x7fdf680b7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47726/0 (socket says 172.21.15.117:47726) 2023-07-19T20:44:58.619 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf677fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fdf6814ddd0 0x7fdf68144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41748/0 (socket says 172.21.15.117:41748) 2023-07-19T20:44:58.619 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf66ffd700 1 -- 172.21.15.117:0/414761273 learned_addr learned my addr 172.21.15.117:0/414761273 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:58.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf66ffd700 1 -- 172.21.15.117:0/414761273 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680bca00 msgr2=0x7fdf680bd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:58.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf667fc700 1 --2- 172.21.15.117:0/414761273 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680bca00 0x7fdf680bd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf66ffd700 1 --2- 172.21.15.117:0/414761273 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680bca00 0x7fdf680bd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf66ffd700 1 -- 172.21.15.117:0/414761273 >> v1:172.21.15.117:6789/0 conn(0x7fdf6814ddd0 legacy=0x7fdf68144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf66ffd700 1 -- 172.21.15.117:0/414761273 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf68144ea0 con 0x7fdf680baa60 2023-07-19T20:44:58.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf65ffb700 1 -- 172.21.15.117:0/414761273 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525127682 0 0) 0x7fdf680bd540 con 0x7fdf6814ddd0 2023-07-19T20:44:58.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf667fc700 1 --2- 172.21.15.117:0/414761273 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680bca00 0x7fdf680bd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:58.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.623+0000 7fdf66ffd700 1 --2- 172.21.15.117:0/414761273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf680baa60 0x7fdf680b7f30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdf60009e50 tx=0x7fdf6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78edbc809c598e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:58.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.624+0000 7fdf65ffb700 1 -- 172.21.15.117:0/414761273 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000e070 con 0x7fdf680baa60 2023-07-19T20:44:58.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.624+0000 7fdf65ffb700 1 -- 172.21.15.117:0/414761273 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6000b9c0 con 0x7fdf680baa60 2023-07-19T20:44:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.624+0000 7fdf65ffb700 1 -- 172.21.15.117:0/414761273 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000bd70 con 0x7fdf680baa60 2023-07-19T20:44:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.624+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/414761273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf680baa60 msgr2=0x7fdf680b7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.624+0000 7fdf6d3e9700 1 --2- 172.21.15.117:0/414761273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf680baa60 0x7fdf680b7f30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdf60009e50 tx=0x7fdf6000b330 comp rx=0 tx=0).stop 2023-07-19T20:44:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.624+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/414761273 shutdown_connections 2023-07-19T20:44:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.624+0000 7fdf6d3e9700 1 --2- 172.21.15.117:0/414761273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf680baa60 0x7fdf680b7f30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.624+0000 7fdf6d3e9700 1 --2- 172.21.15.117:0/414761273 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680bca00 0x7fdf680bd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.624+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/414761273 >> 172.21.15.117:0/414761273 conn(0x7fdf68071c90 msgr2=0x7fdf68072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.624+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/414761273 shutdown_connections 2023-07-19T20:44:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.624+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/414761273 wait complete. 2023-07-19T20:44:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.625+0000 7fdf6d3e9700 1 Processor -- start 2023-07-19T20:44:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.625+0000 7fdf6d3e9700 1 -- start start 2023-07-19T20:44:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf6d3e9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680baa60 0x7fdf681e1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf6d3e9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf680bca00 0x7fdf681d42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf6d3e9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf6814ddd0 0x7fdf680b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf6d3e9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf680b6f70 con 0x7fdf680bca00 2023-07-19T20:44:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf6d3e9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf68142320 con 0x7fdf6814ddd0 2023-07-19T20:44:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf6d3e9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf681e4830 con 0x7fdf680baa60 2023-07-19T20:44:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf667fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf680bca00 0x7fdf681d42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf667fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf680bca00 0x7fdf681d42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47742/0 (socket says 172.21.15.117:47742) 2023-07-19T20:44:58.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf667fc700 1 -- 172.21.15.117:0/1638817602 learned_addr learned my addr 172.21.15.117:0/1638817602 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:58.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf677fe700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf6814ddd0 0x7fdf680b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf66ffd700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680baa60 0x7fdf681e1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf667fc700 1 -- 172.21.15.117:0/1638817602 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680baa60 msgr2=0x7fdf681e1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf667fc700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680baa60 0x7fdf681e1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf667fc700 1 -- 172.21.15.117:0/1638817602 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf6814ddd0 msgr2=0x7fdf680b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf667fc700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf6814ddd0 0x7fdf680b6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf667fc700 1 -- 172.21.15.117:0/1638817602 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf60009b30 con 0x7fdf680bca00 2023-07-19T20:44:58.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.626+0000 7fdf677fe700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf6814ddd0 0x7fdf680b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:44:58.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.627+0000 7fdf667fc700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf680bca00 0x7fdf681d42a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000c750 tx=0x7fdf5000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:58.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.627+0000 7fdf5f7fe700 1 -- 172.21.15.117:0/1638817602 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf50011800 con 0x7fdf680bca00 2023-07-19T20:44:58.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.627+0000 7fdf5f7fe700 1 -- 172.21.15.117:0/1638817602 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf50011960 con 0x7fdf680bca00 2023-07-19T20:44:58.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.627+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/1638817602 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf681e0580 con 0x7fdf680bca00 2023-07-19T20:44:58.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.627+0000 7fdf5f7fe700 1 -- 172.21.15.117:0/1638817602 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf50011cd0 con 0x7fdf680bca00 2023-07-19T20:44:58.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.627+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/1638817602 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf681e0b40 con 0x7fdf680bca00 2023-07-19T20:44:58.632 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.628+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/1638817602 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf680b9800 con 0x7fdf680bca00 2023-07-19T20:44:58.632 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.628+0000 7fdf5f7fe700 1 -- 172.21.15.117:0/1638817602 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fdf50021350 con 0x7fdf680bca00 2023-07-19T20:44:58.632 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.628+0000 7fdf5f7fe700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdf4806a660 0x7fdf4806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.632 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.629+0000 7fdf5f7fe700 1 -- 172.21.15.117:0/1638817602 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf50088a40 con 0x7fdf680bca00 2023-07-19T20:44:58.632 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.629+0000 7fdf66ffd700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdf4806a660 0x7fdf4806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.632 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.629+0000 7fdf66ffd700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdf4806a660 0x7fdf4806cb10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf60000f80 tx=0x7fdf60009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:58.633 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.633+0000 7fdf5f7fe700 1 -- 172.21.15.117:0/1638817602 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fdf5008ae60 con 0x7fdf680bca00 2023-07-19T20:44:58.812 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.817+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/1638817602 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf68074890 con 0x7fdf680bca00 2023-07-19T20:44:58.812 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.818+0000 7fdf5f7fe700 1 -- 172.21.15.117:0/1638817602 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf500578d0 con 0x7fdf680bca00 2023-07-19T20:44:58.813 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2023-07-19T20:44:58.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.819+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/1638817602 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdf4806a660 msgr2=0x7fdf4806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.819+0000 7fdf6d3e9700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdf4806a660 0x7fdf4806cb10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf60000f80 tx=0x7fdf60009000 comp rx=0 tx=0).stop 2023-07-19T20:44:58.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.819+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/1638817602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf680bca00 msgr2=0x7fdf681d42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.819+0000 7fdf6d3e9700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf680bca00 0x7fdf681d42a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000c750 tx=0x7fdf5000cb10 comp rx=0 tx=0).stop 2023-07-19T20:44:58.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.819+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/1638817602 shutdown_connections 2023-07-19T20:44:58.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.819+0000 7fdf6d3e9700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdf4806a660 0x7fdf4806cb10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.819+0000 7fdf6d3e9700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf6814ddd0 0x7fdf680b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.819+0000 7fdf6d3e9700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680baa60 0x7fdf681e1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.819+0000 7fdf6d3e9700 1 --2- 172.21.15.117:0/1638817602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf680bca00 0x7fdf681d42a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.820+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/1638817602 >> 172.21.15.117:0/1638817602 conn(0x7fdf68071c90 msgr2=0x7fdf6814e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:58.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.820+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/1638817602 shutdown_connections 2023-07-19T20:44:58.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.820+0000 7fdf6d3e9700 1 -- 172.21.15.117:0/1638817602 wait complete. 2023-07-19T20:44:58.826 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-19T20:44:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.956+0000 7fd619301700 1 Processor -- start 2023-07-19T20:44:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.956+0000 7fd619301700 1 -- start start 2023-07-19T20:44:58.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.957+0000 7fd619301700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd614144dd0 0x7fd614072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.957+0000 7fd619301700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd6140bd700 0x7fd61406de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.957+0000 7fd619301700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61406d990 con 0x7fd6140be640 2023-07-19T20:44:58.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.957+0000 7fd619301700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd614071a90 con 0x7fd6140bd700 2023-07-19T20:44:58.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.957+0000 7fd619301700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140bdbe0 con 0x7fd614144dd0 2023-07-19T20:44:58.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.957+0000 7fd6137fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd6140bd700 0x7fd61406de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.955 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.957+0000 7fd6127fc700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd6140be640 0x7fd614071380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41756/0 (socket says 172.21.15.117:41756) 2023-07-19T20:44:58.956 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.957+0000 7fd6137fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd6140bd700 0x7fd61406de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47758/0 (socket says 172.21.15.117:47758) 2023-07-19T20:44:58.956 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.957+0000 7fd6127fc700 1 -- 172.21.15.117:0/1389060377 learned_addr learned my addr 172.21.15.117:0/1389060377 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:58.956 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.957+0000 7fd612ffd700 1 --2- 172.21.15.117:0/1389060377 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd614144dd0 0x7fd614072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.956 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd611ffb700 1 -- 172.21.15.117:0/1389060377 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955489685 0 0) 0x7fd61406d990 con 0x7fd6140be640 2023-07-19T20:44:58.956 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd611ffb700 1 -- 172.21.15.117:0/1389060377 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5fc0035b0 con 0x7fd6140be640 2023-07-19T20:44:58.956 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd6137fe700 1 -- 172.21.15.117:0/1389060377 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd614144dd0 msgr2=0x7fd614072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:58.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd6137fe700 1 --2- 172.21.15.117:0/1389060377 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd614144dd0 0x7fd614072260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd6137fe700 1 -- 172.21.15.117:0/1389060377 >> v1:172.21.15.117:6789/0 conn(0x7fd6140be640 legacy=0x7fd614071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd6137fe700 1 -- 172.21.15.117:0/1389060377 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6140bdec0 con 0x7fd6140bd700 2023-07-19T20:44:58.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd6137fe700 1 --2- 172.21.15.117:0/1389060377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6140bd700 0x7fd61406de20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009d90 tx=0x7fd60c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ead090cc9e87e server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:58.957 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd611ffb700 1 -- 172.21.15.117:0/1389060377 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c00e070 con 0x7fd6140bd700 2023-07-19T20:44:58.958 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd611ffb700 1 -- 172.21.15.117:0/1389060377 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c00bb20 con 0x7fd6140bd700 2023-07-19T20:44:58.958 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd611ffb700 1 -- 172.21.15.117:0/1389060377 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c012430 con 0x7fd6140bd700 2023-07-19T20:44:58.958 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd619301700 1 -- 172.21.15.117:0/1389060377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6140bd700 msgr2=0x7fd61406de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.958 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd619301700 1 --2- 172.21.15.117:0/1389060377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6140bd700 0x7fd61406de20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009d90 tx=0x7fd60c00b330 comp rx=0 tx=0).stop 2023-07-19T20:44:58.959 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd619301700 1 -- 172.21.15.117:0/1389060377 shutdown_connections 2023-07-19T20:44:58.959 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd619301700 1 --2- 172.21.15.117:0/1389060377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6140bd700 0x7fd61406de20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.959 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd619301700 1 --2- 172.21.15.117:0/1389060377 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd614144dd0 0x7fd614072260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.959 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd619301700 1 -- 172.21.15.117:0/1389060377 >> 172.21.15.117:0/1389060377 conn(0x7fd6140bea10 msgr2=0x7fd6140bee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:58.959 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd619301700 1 -- 172.21.15.117:0/1389060377 shutdown_connections 2023-07-19T20:44:58.959 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.958+0000 7fd619301700 1 -- 172.21.15.117:0/1389060377 wait complete. 2023-07-19T20:44:58.959 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.960+0000 7fd619301700 1 Processor -- start 2023-07-19T20:44:58.960 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.960+0000 7fd619301700 1 -- start start 2023-07-19T20:44:58.960 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.960+0000 7fd619301700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6140bd700 0x7fd6140a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.960 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.960+0000 7fd619301700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6140be640 0x7fd6141e34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.960 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.960+0000 7fd619301700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd614144dd0 0x7fd61413ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.960 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.960+0000 7fd619301700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140a0760 con 0x7fd6140bd700 2023-07-19T20:44:58.960 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.960+0000 7fd619301700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140a2f30 con 0x7fd6140be640 2023-07-19T20:44:58.960 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.960+0000 7fd619301700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140b9290 con 0x7fd614144dd0 2023-07-19T20:44:58.961 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.960+0000 7fd612ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6140bd700 0x7fd6140a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.961 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.960+0000 7fd612ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6140bd700 0x7fd6140a0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47774/0 (socket says 172.21.15.117:47774) 2023-07-19T20:44:58.961 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.960+0000 7fd612ffd700 1 -- 172.21.15.117:0/980096200 learned_addr learned my addr 172.21.15.117:0/980096200 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:58.961 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.960+0000 7fd6127fc700 1 --2- 172.21.15.117:0/980096200 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6140be640 0x7fd6141e34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.961 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.960+0000 7fd6137fe700 1 --2- 172.21.15.117:0/980096200 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd614144dd0 0x7fd61413ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.961 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.961+0000 7fd612ffd700 1 -- 172.21.15.117:0/980096200 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd614144dd0 msgr2=0x7fd61413ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.961 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.961+0000 7fd612ffd700 1 --2- 172.21.15.117:0/980096200 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd614144dd0 0x7fd61413ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.962 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.961+0000 7fd612ffd700 1 -- 172.21.15.117:0/980096200 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6140be640 msgr2=0x7fd6141e34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:58.962 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.961+0000 7fd612ffd700 1 --2- 172.21.15.117:0/980096200 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6140be640 0x7fd6141e34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:58.962 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.961+0000 7fd612ffd700 1 -- 172.21.15.117:0/980096200 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c009a70 con 0x7fd6140bd700 2023-07-19T20:44:58.962 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.961+0000 7fd612ffd700 1 --2- 172.21.15.117:0/980096200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6140bd700 0x7fd6140a0220 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd60800e8a0 tx=0x7fd60800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:58.962 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.961+0000 7fd5fb7fe700 1 -- 172.21.15.117:0/980096200 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd608009590 con 0x7fd6140bd700 2023-07-19T20:44:58.962 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.961+0000 7fd5fb7fe700 1 -- 172.21.15.117:0/980096200 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd608013680 con 0x7fd6140bd700 2023-07-19T20:44:58.963 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.961+0000 7fd619301700 1 -- 172.21.15.117:0/980096200 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6140a4a10 con 0x7fd6140bd700 2023-07-19T20:44:58.963 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.961+0000 7fd5fb7fe700 1 -- 172.21.15.117:0/980096200 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6080139f0 con 0x7fd6140bd700 2023-07-19T20:44:58.963 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.961+0000 7fd619301700 1 -- 172.21.15.117:0/980096200 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6140a4190 con 0x7fd6140bd700 2023-07-19T20:44:58.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.962+0000 7fd619301700 1 -- 172.21.15.117:0/980096200 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6140a47f0 con 0x7fd6140bd700 2023-07-19T20:44:58.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.962+0000 7fd5fb7fe700 1 -- 172.21.15.117:0/980096200 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fd608013b50 con 0x7fd6140bd700 2023-07-19T20:44:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.963+0000 7fd5fb7fe700 1 --2- 172.21.15.117:0/980096200 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd60006a660 0x7fd60006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.963+0000 7fd5fb7fe700 1 -- 172.21.15.117:0/980096200 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6080888c0 con 0x7fd6140bd700 2023-07-19T20:44:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.963+0000 7fd6127fc700 1 --2- 172.21.15.117:0/980096200 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd60006a660 0x7fd60006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.963+0000 7fd6127fc700 1 --2- 172.21.15.117:0/980096200 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd60006a660 0x7fd60006cb10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd61406bee0 tx=0x7fd604007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:58.967+0000 7fd5fb7fe700 1 -- 172.21.15.117:0/980096200 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fd608057750 con 0x7fd6140bd700 2023-07-19T20:44:59.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.151+0000 7fd619301700 1 -- 172.21.15.117:0/980096200 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd61409e090 con 0x7fd6140bd700 2023-07-19T20:44:59.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.151+0000 7fd5fb7fe700 1 -- 172.21.15.117:0/980096200 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6080572e0 con 0x7fd6140bd700 2023-07-19T20:44:59.145 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2023-07-19T20:44:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.153+0000 7fd619301700 1 -- 172.21.15.117:0/980096200 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd60006a660 msgr2=0x7fd60006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.153+0000 7fd619301700 1 --2- 172.21.15.117:0/980096200 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd60006a660 0x7fd60006cb10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd61406bee0 tx=0x7fd604007dc0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.153+0000 7fd619301700 1 -- 172.21.15.117:0/980096200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6140bd700 msgr2=0x7fd6140a0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.153+0000 7fd619301700 1 --2- 172.21.15.117:0/980096200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6140bd700 0x7fd6140a0220 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd60800e8a0 tx=0x7fd60800ebb0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.154+0000 7fd619301700 1 -- 172.21.15.117:0/980096200 shutdown_connections 2023-07-19T20:44:59.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.154+0000 7fd619301700 1 --2- 172.21.15.117:0/980096200 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd60006a660 0x7fd60006cb10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.154+0000 7fd619301700 1 --2- 172.21.15.117:0/980096200 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd614144dd0 0x7fd61413ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.154+0000 7fd619301700 1 --2- 172.21.15.117:0/980096200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6140bd700 0x7fd6140a0220 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.154+0000 7fd619301700 1 --2- 172.21.15.117:0/980096200 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6140be640 0x7fd6141e34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.154+0000 7fd619301700 1 -- 172.21.15.117:0/980096200 >> 172.21.15.117:0/980096200 conn(0x7fd6140bea10 msgr2=0x7fd6140b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:59.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.154+0000 7fd619301700 1 -- 172.21.15.117:0/980096200 shutdown_connections 2023-07-19T20:44:59.149 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.154+0000 7fd619301700 1 -- 172.21.15.117:0/980096200 wait complete. 2023-07-19T20:44:59.159 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-19T20:44:59.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.290+0000 7f625154b700 1 Processor -- start 2023-07-19T20:44:59.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.290+0000 7f625154b700 1 -- start start 2023-07-19T20:44:59.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.290+0000 7f625154b700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f624c0bca00 0x7f624c0b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.290+0000 7f625154b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624c0bd540 con 0x7f624c14ddd0 2023-07-19T20:44:59.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.290+0000 7f625154b700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624c0b8d70 con 0x7f624c0baa60 2023-07-19T20:44:59.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.290+0000 7f625154b700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c144ea0 con 0x7f624c0bca00 2023-07-19T20:44:59.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.290+0000 7f624b7fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f624c14ddd0 0x7f624c155160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41762/0 (socket says 172.21.15.117:41762) 2023-07-19T20:44:59.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.290+0000 7f624b7fe700 1 -- 172.21.15.117:0/1658945365 learned_addr learned my addr 172.21.15.117:0/1658945365 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:44:59.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f624a7fc700 1 --2- 172.21.15.117:0/1658945365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f624c0bca00 0x7f624c0b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 -- 172.21.15.117:0/1658945365 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825946695 0 0) 0x7f624c0bd540 con 0x7f624c14ddd0 2023-07-19T20:44:59.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 -- 172.21.15.117:0/1658945365 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62340035b0 con 0x7f624c14ddd0 2023-07-19T20:44:59.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 -- 172.21.15.117:0/1658945365 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2027394262 0 0) 0x7f62340035b0 con 0x7f624c14ddd0 2023-07-19T20:44:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 -- 172.21.15.117:0/1658945365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f624c0bca00 msgr2=0x7f624c0b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 --2- 172.21.15.117:0/1658945365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f624c0bca00 0x7f624c0b7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 -- 172.21.15.117:0/1658945365 >> v1:172.21.15.124:6789/0 conn(0x7f624c0baa60 legacy=0x7f624c144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 -- 172.21.15.117:0/1658945365 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c0b8fe0 con 0x7f624c14ddd0 2023-07-19T20:44:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 -- 172.21.15.117:0/1658945365 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f62440019f0 con 0x7f624c14ddd0 2023-07-19T20:44:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 -- 172.21.15.117:0/1658945365 >> v1:172.21.15.117:6789/0 conn(0x7f624c14ddd0 legacy=0x7f624c155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 --2- 172.21.15.117:0/1658945365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6234003aa0 0x7f6234003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 --2- 172.21.15.117:0/1658945365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f624c0bca00 0x7f6234004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 --2- 172.21.15.117:0/1658945365 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6234004d90 0x7f6234005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 -- 172.21.15.117:0/1658945365 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c144ea0 con 0x7f6234003aa0 2023-07-19T20:44:59.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 -- 172.21.15.117:0/1658945365 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623400bac0 con 0x7f6234004d90 2023-07-19T20:44:59.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f6249ffb700 1 -- 172.21.15.117:0/1658945365 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623400bc50 con 0x7f624c0bca00 2023-07-19T20:44:59.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f624affd700 1 --2- 172.21.15.117:0/1658945365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6234003aa0 0x7f6234003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.289 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f624a7fc700 1 --2- 172.21.15.117:0/1658945365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f624c0bca00 0x7f6234004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f624b7fe700 1 --2- 172.21.15.117:0/1658945365 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6234004d90 0x7f6234005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f624affd700 1 -- 172.21.15.117:0/1658945365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f624c0bca00 msgr2=0x7f6234004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:59.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f624affd700 1 --2- 172.21.15.117:0/1658945365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f624c0bca00 0x7f6234004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f624affd700 1 -- 172.21.15.117:0/1658945365 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6234004d90 msgr2=0x7f6234005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:59.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f624affd700 1 --2- 172.21.15.117:0/1658945365 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6234004d90 0x7f6234005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.291+0000 7f624affd700 1 -- 172.21.15.117:0/1658945365 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62340035b0 con 0x7f6234003aa0 2023-07-19T20:44:59.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.292+0000 7f624affd700 1 --2- 172.21.15.117:0/1658945365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6234003aa0 0x7f6234003e70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f623c0018d0 tx=0x7f6234005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744836dc10f42f1d server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.292+0000 7f6249ffb700 1 -- 172.21.15.117:0/1658945365 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00c690 con 0x7f6234003aa0 2023-07-19T20:44:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.292+0000 7f6249ffb700 1 -- 172.21.15.117:0/1658945365 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c00c810 con 0x7f6234003aa0 2023-07-19T20:44:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.292+0000 7f6249ffb700 1 -- 172.21.15.117:0/1658945365 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00cbc0 con 0x7f6234003aa0 2023-07-19T20:44:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.292+0000 7f625154b700 1 -- 172.21.15.117:0/1658945365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6234003aa0 msgr2=0x7f6234003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.292+0000 7f625154b700 1 --2- 172.21.15.117:0/1658945365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6234003aa0 0x7f6234003e70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f623c0018d0 tx=0x7f6234005880 comp rx=0 tx=0).stop 2023-07-19T20:44:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.292+0000 7f624b7fe700 1 -- 172.21.15.117:0/1658945365 reap_dead start 2023-07-19T20:44:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.292+0000 7f625154b700 1 -- 172.21.15.117:0/1658945365 shutdown_connections 2023-07-19T20:44:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.292+0000 7f625154b700 1 -- 172.21.15.117:0/1658945365 >> 172.21.15.117:0/1658945365 conn(0x7f624c071c90 msgr2=0x7f624c072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:59.292 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.292+0000 7f625154b700 1 -- 172.21.15.117:0/1658945365 shutdown_connections 2023-07-19T20:44:59.292 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.292+0000 7f625154b700 1 -- 172.21.15.117:0/1658945365 wait complete. 2023-07-19T20:44:59.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.293+0000 7f625154b700 1 Processor -- start 2023-07-19T20:44:59.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.294+0000 7f625154b700 1 -- start start 2023-07-19T20:44:59.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.294+0000 7f625154b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6234003aa0 0x7f624c0bea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.294+0000 7f625154b700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f624c145ef0 0x7f624c146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.294+0000 7f625154b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f624c0c0730 0x7f624c0c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.295 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.294+0000 7f625154b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0bf620 con 0x7f6234003aa0 2023-07-19T20:44:59.295 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.294+0000 7f625154b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0c19f0 con 0x7f624c0c0730 2023-07-19T20:44:59.295 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.294+0000 7f625154b700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0c10f0 con 0x7f624c145ef0 2023-07-19T20:44:59.295 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.294+0000 7f624affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6234003aa0 0x7f624c0bea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.295 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.294+0000 7f624affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6234003aa0 0x7f624c0bea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47784/0 (socket says 172.21.15.117:47784) 2023-07-19T20:44:59.295 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.294+0000 7f624affd700 1 -- 172.21.15.117:0/3154071045 learned_addr learned my addr 172.21.15.117:0/3154071045 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:59.295 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.294+0000 7f624b7fe700 1 --2- 172.21.15.117:0/3154071045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f624c0c0730 0x7f624c0c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.294+0000 7f624a7fc700 1 --2- 172.21.15.117:0/3154071045 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f624c145ef0 0x7f624c146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.295+0000 7f624affd700 1 -- 172.21.15.117:0/3154071045 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f624c145ef0 msgr2=0x7f624c146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.295+0000 7f624affd700 1 --2- 172.21.15.117:0/3154071045 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f624c145ef0 0x7f624c146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.295+0000 7f624affd700 1 -- 172.21.15.117:0/3154071045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f624c0c0730 msgr2=0x7f624c0c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.295+0000 7f624affd700 1 --2- 172.21.15.117:0/3154071045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f624c0c0730 0x7f624c0c0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.295+0000 7f624affd700 1 -- 172.21.15.117:0/3154071045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c145a60 con 0x7f6234003aa0 2023-07-19T20:44:59.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.295+0000 7f624affd700 1 --2- 172.21.15.117:0/3154071045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6234003aa0 0x7f624c0bea30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f62340047a0 tx=0x7f623c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.295+0000 7f62337fe700 1 -- 172.21.15.117:0/3154071045 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00cb80 con 0x7f6234003aa0 2023-07-19T20:44:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.295+0000 7f62337fe700 1 -- 172.21.15.117:0/3154071045 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c021070 con 0x7f6234003aa0 2023-07-19T20:44:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.295+0000 7f62337fe700 1 -- 172.21.15.117:0/3154071045 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00cee0 con 0x7f6234003aa0 2023-07-19T20:44:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.295+0000 7f625154b700 1 -- 172.21.15.117:0/3154071045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c0bef70 con 0x7f6234003aa0 2023-07-19T20:44:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.295+0000 7f625154b700 1 -- 172.21.15.117:0/3154071045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c145410 con 0x7f6234003aa0 2023-07-19T20:44:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.296+0000 7f625154b700 1 -- 172.21.15.117:0/3154071045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c0b9800 con 0x7f6234003aa0 2023-07-19T20:44:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.297+0000 7f62337fe700 1 -- 172.21.15.117:0/3154071045 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f623c023030 con 0x7f6234003aa0 2023-07-19T20:44:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.297+0000 7f62337fe700 1 --2- 172.21.15.117:0/3154071045 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f623806a660 0x7f623806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.297+0000 7f62337fe700 1 -- 172.21.15.117:0/3154071045 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f623c089c00 con 0x7f6234003aa0 2023-07-19T20:44:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.297+0000 7f624a7fc700 1 --2- 172.21.15.117:0/3154071045 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f623806a660 0x7f623806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.297+0000 7f624a7fc700 1 --2- 172.21.15.117:0/3154071045 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f623806a660 0x7f623806cb10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6240009b80 tx=0x7f6240009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.301+0000 7f62337fe700 1 -- 172.21.15.117:0/3154071045 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f623c090080 con 0x7f6234003aa0 2023-07-19T20:44:59.480 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.484+0000 7f625154b700 1 -- 172.21.15.117:0/3154071045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f624c06cba0 con 0x7f6234003aa0 2023-07-19T20:44:59.480 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.485+0000 7f62337fe700 1 -- 172.21.15.117:0/3154071045 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f623c055090 con 0x7f6234003aa0 2023-07-19T20:44:59.481 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 64 2023-07-19T20:44:59.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.487+0000 7f625154b700 1 -- 172.21.15.117:0/3154071045 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f623806a660 msgr2=0x7f623806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.487+0000 7f625154b700 1 --2- 172.21.15.117:0/3154071045 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f623806a660 0x7f623806cb10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6240009b80 tx=0x7f6240009210 comp rx=0 tx=0).stop 2023-07-19T20:44:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.487+0000 7f625154b700 1 -- 172.21.15.117:0/3154071045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6234003aa0 msgr2=0x7f624c0bea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.487+0000 7f625154b700 1 --2- 172.21.15.117:0/3154071045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6234003aa0 0x7f624c0bea30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f62340047a0 tx=0x7f623c001230 comp rx=0 tx=0).stop 2023-07-19T20:44:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.487+0000 7f625154b700 1 -- 172.21.15.117:0/3154071045 shutdown_connections 2023-07-19T20:44:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.487+0000 7f625154b700 1 --2- 172.21.15.117:0/3154071045 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f623806a660 0x7f623806cb10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.487+0000 7f625154b700 1 --2- 172.21.15.117:0/3154071045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f624c0c0730 0x7f624c0c0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.487+0000 7f625154b700 1 --2- 172.21.15.117:0/3154071045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6234003aa0 0x7f624c0bea30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.487+0000 7f625154b700 1 --2- 172.21.15.117:0/3154071045 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f624c145ef0 0x7f624c146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.487+0000 7f625154b700 1 -- 172.21.15.117:0/3154071045 >> 172.21.15.117:0/3154071045 conn(0x7f624c071c90 msgr2=0x7f624c0a67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.487+0000 7f625154b700 1 -- 172.21.15.117:0/3154071045 shutdown_connections 2023-07-19T20:44:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.487+0000 7f625154b700 1 -- 172.21.15.117:0/3154071045 wait complete. 2023-07-19T20:44:59.496 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:44:59.618 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.625+0000 7f3986d71700 1 Processor -- start 2023-07-19T20:44:59.619 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.625+0000 7f3986d71700 1 -- start start 2023-07-19T20:44:59.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f3986d71700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f398006baf0 0x7f3980070110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f3986d71700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f398006f560 0x7f39801518c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f3986d71700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39800b8a70 con 0x7f39801447e0 2023-07-19T20:44:59.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f3986d71700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3980070db0 con 0x7f398006baf0 2023-07-19T20:44:59.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f3986d71700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398006b6a0 con 0x7f398006f560 2023-07-19T20:44:59.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f397ffff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f398006baf0 0x7f3980070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f397ffff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f398006baf0 0x7f3980070110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47798/0 (socket says 172.21.15.117:47798) 2023-07-19T20:44:59.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f397ffff700 1 -- 172.21.15.117:0/3766447049 learned_addr learned my addr 172.21.15.117:0/3766447049 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:59.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f398530e700 1 --2- 172.21.15.117:0/3766447049 >> v2:172.21.15.124:3300/0 conn(0x7f398006f560 0x7f39801518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f397ffff700 1 -- 172.21.15.117:0/3766447049 >> v2:172.21.15.124:3300/0 conn(0x7f398006f560 msgr2=0x7f39801518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:59.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f397ffff700 1 --2- 172.21.15.117:0/3766447049 >> v2:172.21.15.124:3300/0 conn(0x7f398006f560 0x7f39801518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f397ffff700 1 -- 172.21.15.117:0/3766447049 >> v1:172.21.15.124:6789/0 conn(0x7f39801447e0 legacy=0x7f39800b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:59.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f397ffff700 1 -- 172.21.15.117:0/3766447049 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980072210 con 0x7f398006baf0 2023-07-19T20:44:59.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f398530e700 1 --2- 172.21.15.117:0/3766447049 >> v2:172.21.15.124:3300/0 conn(0x7f398006f560 0x7f39801518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:44:59.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f397ffff700 1 --2- 172.21.15.117:0/3766447049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f398006baf0 0x7f3980070110 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f398014a4e0 tx=0x7f396c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d43022cbf891bc server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:59.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f397f7fe700 1 -- 172.21.15.117:0/3766447049 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c00dbe0 con 0x7f398006baf0 2023-07-19T20:44:59.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f397f7fe700 1 -- 172.21.15.117:0/3766447049 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396c00dd40 con 0x7f398006baf0 2023-07-19T20:44:59.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.626+0000 7f397f7fe700 1 -- 172.21.15.117:0/3766447049 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c004270 con 0x7f398006baf0 2023-07-19T20:44:59.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.627+0000 7f3986d71700 1 -- 172.21.15.117:0/3766447049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f398006baf0 msgr2=0x7f3980070110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.627+0000 7f3986d71700 1 --2- 172.21.15.117:0/3766447049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f398006baf0 0x7f3980070110 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f398014a4e0 tx=0x7f396c00be70 comp rx=0 tx=0).stop 2023-07-19T20:44:59.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.627+0000 7f3986d71700 1 -- 172.21.15.117:0/3766447049 shutdown_connections 2023-07-19T20:44:59.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.627+0000 7f3986d71700 1 --2- 172.21.15.117:0/3766447049 >> v2:172.21.15.124:3300/0 conn(0x7f398006f560 0x7f39801518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.627+0000 7f3986d71700 1 --2- 172.21.15.117:0/3766447049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f398006baf0 0x7f3980070110 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.627+0000 7f3986d71700 1 -- 172.21.15.117:0/3766447049 >> 172.21.15.117:0/3766447049 conn(0x7f39800bdc00 msgr2=0x7f39800b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:59.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.627+0000 7f3986d71700 1 -- 172.21.15.117:0/3766447049 shutdown_connections 2023-07-19T20:44:59.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.627+0000 7f3986d71700 1 -- 172.21.15.117:0/3766447049 wait complete. 2023-07-19T20:44:59.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.628+0000 7f3986d71700 1 Processor -- start 2023-07-19T20:44:59.625 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.628+0000 7f3986d71700 1 -- start start 2023-07-19T20:44:59.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f3986d71700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f398006baf0 0x7f39800b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f3986d71700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f398006f560 0x7f39801dc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f3986d71700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39801447e0 0x7f39801dc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f3986d71700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39800b5990 con 0x7f39801447e0 2023-07-19T20:44:59.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f3986d71700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39801d07a0 con 0x7f398006baf0 2023-07-19T20:44:59.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f3986d71700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39801d0a80 con 0x7f398006f560 2023-07-19T20:44:59.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f398530e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39801447e0 0x7f39801dc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f398530e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39801447e0 0x7f39801dc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47802/0 (socket says 172.21.15.117:47802) 2023-07-19T20:44:59.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f398530e700 1 -- 172.21.15.117:0/884124587 learned_addr learned my addr 172.21.15.117:0/884124587 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:59.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f3984b0d700 1 --2- 172.21.15.117:0/884124587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f398006baf0 0x7f39800b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f397ffff700 1 --2- 172.21.15.117:0/884124587 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f398006f560 0x7f39801dc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f398530e700 1 -- 172.21.15.117:0/884124587 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f398006f560 msgr2=0x7f39801dc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f398530e700 1 --2- 172.21.15.117:0/884124587 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f398006f560 0x7f39801dc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f398530e700 1 -- 172.21.15.117:0/884124587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f398006baf0 msgr2=0x7f39800b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f398530e700 1 --2- 172.21.15.117:0/884124587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f398006baf0 0x7f39800b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f398530e700 1 -- 172.21.15.117:0/884124587 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c00b7f0 con 0x7f39801447e0 2023-07-19T20:44:59.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f398530e700 1 --2- 172.21.15.117:0/884124587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39801447e0 0x7f39801dc6d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f397800cef0 tx=0x7f397800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:59.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f397d7fa700 1 -- 172.21.15.117:0/884124587 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800ad00 con 0x7f39801447e0 2023-07-19T20:44:59.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f397d7fa700 1 -- 172.21.15.117:0/884124587 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397800ae60 con 0x7f39801447e0 2023-07-19T20:44:59.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f3986d71700 1 -- 172.21.15.117:0/884124587 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39801d0d60 con 0x7f39801447e0 2023-07-19T20:44:59.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f397d7fa700 1 -- 172.21.15.117:0/884124587 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978015680 con 0x7f39801447e0 2023-07-19T20:44:59.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.629+0000 7f3986d71700 1 -- 172.21.15.117:0/884124587 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39800b5c40 con 0x7f39801447e0 2023-07-19T20:44:59.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.630+0000 7f3986d71700 1 -- 172.21.15.117:0/884124587 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39801464f0 con 0x7f39801447e0 2023-07-19T20:44:59.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.631+0000 7f397d7fa700 1 -- 172.21.15.117:0/884124587 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f397800d430 con 0x7f39801447e0 2023-07-19T20:44:59.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.631+0000 7f397d7fa700 1 --2- 172.21.15.117:0/884124587 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f396406a660 0x7f396406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.631+0000 7f397d7fa700 1 -- 172.21.15.117:0/884124587 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3978088f50 con 0x7f39801447e0 2023-07-19T20:44:59.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.631+0000 7f3984b0d700 1 --2- 172.21.15.117:0/884124587 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f396406a660 0x7f396406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.632 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.631+0000 7f3984b0d700 1 --2- 172.21.15.117:0/884124587 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f396406a660 0x7f396406cb10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3974009960 tx=0x7f39740090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:59.633 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.635+0000 7f397d7fa700 1 -- 172.21.15.117:0/884124587 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3978054350 con 0x7f39801447e0 2023-07-19T20:44:59.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.823+0000 7f3986d71700 1 -- 172.21.15.117:0/884124587 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39800b6590 con 0x7f39801447e0 2023-07-19T20:44:59.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.824+0000 7f397d7fa700 1 -- 172.21.15.117:0/884124587 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17897 (secure 0 0 0) 0x7f397801a020 con 0x7f39801447e0 2023-07-19T20:44:59.818 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:44:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:39.549566+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:44:59.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.826+0000 7f3986d71700 1 -- 172.21.15.117:0/884124587 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f396406a660 msgr2=0x7f396406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.826+0000 7f3986d71700 1 --2- 172.21.15.117:0/884124587 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f396406a660 0x7f396406cb10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3974009960 tx=0x7f39740090e0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.826+0000 7f3986d71700 1 -- 172.21.15.117:0/884124587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39801447e0 msgr2=0x7f39801dc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.826+0000 7f3986d71700 1 --2- 172.21.15.117:0/884124587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39801447e0 0x7f39801dc6d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f397800cef0 tx=0x7f397800cf20 comp rx=0 tx=0).stop 2023-07-19T20:44:59.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.826+0000 7f3986d71700 1 -- 172.21.15.117:0/884124587 shutdown_connections 2023-07-19T20:44:59.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.826+0000 7f3986d71700 1 --2- 172.21.15.117:0/884124587 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f396406a660 0x7f396406cb10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.826+0000 7f3986d71700 1 --2- 172.21.15.117:0/884124587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39801447e0 0x7f39801dc6d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.826+0000 7f3986d71700 1 --2- 172.21.15.117:0/884124587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f398006baf0 0x7f39800b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.826+0000 7f3986d71700 1 --2- 172.21.15.117:0/884124587 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f398006f560 0x7f39801dc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.826+0000 7f3986d71700 1 -- 172.21.15.117:0/884124587 >> 172.21.15.117:0/884124587 conn(0x7f39800bdc00 msgr2=0x7f3980142860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:59.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.826+0000 7f3986d71700 1 -- 172.21.15.117:0/884124587 shutdown_connections 2023-07-19T20:44:59.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.826+0000 7f3986d71700 1 -- 172.21.15.117:0/884124587 wait complete. 2023-07-19T20:44:59.833 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-19T20:44:31.325778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-19T20:44:31.728215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-19T20:44:36.280405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-19T20:44:37.509195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-19T20:44:59.835 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-19T20:44:59.959 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.965+0000 7f8086d1e700 1 Processor -- start 2023-07-19T20:44:59.959 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.965+0000 7f8086d1e700 1 -- start start 2023-07-19T20:44:59.962 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.966+0000 7f8086d1e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f808009f770 0x7f80800bcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.962 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.966+0000 7f8086d1e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f80800bb720 0x7f80800b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.962 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.966+0000 7f8086d1e700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80800b95c0 con 0x7f80800bbb40 2023-07-19T20:44:59.962 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.966+0000 7f8086d1e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80800bc1c0 con 0x7f808009f770 2023-07-19T20:44:59.962 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.966+0000 7f8086d1e700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80800bc4a0 con 0x7f80800bb720 2023-07-19T20:44:59.962 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.967+0000 7f807ffff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f80800bb720 0x7f80800b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.963 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.967+0000 7f807ffff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f80800bb720 0x7f80800b9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:34134/0 (socket says 172.21.15.117:34134) 2023-07-19T20:44:59.963 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.967+0000 7f8084aba700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f808009f770 0x7f80800bcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.963 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.967+0000 7f807ffff700 1 -- 172.21.15.117:0/15973628 learned_addr learned my addr 172.21.15.117:0/15973628 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:59.963 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.967+0000 7f80852bb700 1 --1- 172.21.15.117:0/15973628 >> v1:172.21.15.124:6789/0 conn(0x7f80800bbb40 0x7f8080147f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.117:51398/0 (socket says 172.21.15.117:51398) 2023-07-19T20:44:59.963 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.967+0000 7f807f7fe700 1 -- 172.21.15.117:0/15973628 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182419626 0 0) 0x7f80800b95c0 con 0x7f80800bbb40 2023-07-19T20:44:59.963 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.967+0000 7f807f7fe700 1 -- 172.21.15.117:0/15973628 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80700035b0 con 0x7f80800bbb40 2023-07-19T20:44:59.963 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.967+0000 7f807ffff700 1 -- 172.21.15.117:0/15973628 >> v2:172.21.15.124:3300/0 conn(0x7f808009f770 msgr2=0x7f80800bcaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:44:59.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.967+0000 7f807ffff700 1 --2- 172.21.15.117:0/15973628 >> v2:172.21.15.124:3300/0 conn(0x7f808009f770 0x7f80800bcaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.967+0000 7f807ffff700 1 -- 172.21.15.117:0/15973628 >> v1:172.21.15.124:6789/0 conn(0x7f80800bbb40 legacy=0x7f8080147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.967+0000 7f807ffff700 1 -- 172.21.15.117:0/15973628 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80800b9840 con 0x7f80800bb720 2023-07-19T20:44:59.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.967+0000 7f8084aba700 1 --2- 172.21.15.117:0/15973628 >> v2:172.21.15.124:3300/0 conn(0x7f808009f770 0x7f80800bcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:44:59.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.967+0000 7f807ffff700 1 --2- 172.21.15.117:0/15973628 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f80800bb720 0x7f80800b9d60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f806c0098f0 tx=0x7f806c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4b1be022fa0015b server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:59.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.968+0000 7f807f7fe700 1 -- 172.21.15.117:0/15973628 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c011830 con 0x7f80800bb720 2023-07-19T20:44:59.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.968+0000 7f807f7fe700 1 -- 172.21.15.117:0/15973628 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c011990 con 0x7f80800bb720 2023-07-19T20:44:59.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.968+0000 7f807f7fe700 1 -- 172.21.15.117:0/15973628 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c011d00 con 0x7f80800bb720 2023-07-19T20:44:59.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.968+0000 7f8086d1e700 1 -- 172.21.15.117:0/15973628 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f80800bb720 msgr2=0x7f80800b9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.968+0000 7f8086d1e700 1 --2- 172.21.15.117:0/15973628 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f80800bb720 0x7f80800b9d60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f806c0098f0 tx=0x7f806c009c00 comp rx=0 tx=0).stop 2023-07-19T20:44:59.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.968+0000 7f8086d1e700 1 -- 172.21.15.117:0/15973628 shutdown_connections 2023-07-19T20:44:59.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.968+0000 7f8086d1e700 1 --2- 172.21.15.117:0/15973628 >> v2:172.21.15.124:3300/0 conn(0x7f808009f770 0x7f80800bcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.968+0000 7f8086d1e700 1 --2- 172.21.15.117:0/15973628 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f80800bb720 0x7f80800b9d60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.968+0000 7f8086d1e700 1 -- 172.21.15.117:0/15973628 >> 172.21.15.117:0/15973628 conn(0x7f80800bd920 msgr2=0x7f80800bdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:44:59.966 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.968+0000 7f8086d1e700 1 -- 172.21.15.117:0/15973628 shutdown_connections 2023-07-19T20:44:59.966 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.968+0000 7f8086d1e700 1 -- 172.21.15.117:0/15973628 wait complete. 2023-07-19T20:44:59.968 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.969+0000 7f8086d1e700 1 Processor -- start 2023-07-19T20:44:59.968 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.969+0000 7f8086d1e700 1 -- start start 2023-07-19T20:44:59.968 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f8086d1e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f808009f770 0x7f808006a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.968 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f8086d1e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f80800bb720 0x7f8080145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.969 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f8086d1e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f80800bbb40 0x7f808013fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.969 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f8086d1e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808006ad40 con 0x7f808009f770 2023-07-19T20:44:59.969 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f8086d1e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8080141e40 con 0x7f80800bb720 2023-07-19T20:44:59.969 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f8086d1e700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8080147220 con 0x7f80800bbb40 2023-07-19T20:44:59.969 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f8084aba700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f808009f770 0x7f808006a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.969 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f8084aba700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f808009f770 0x7f808006a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47804/0 (socket says 172.21.15.117:47804) 2023-07-19T20:44:59.970 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f8084aba700 1 -- 172.21.15.117:0/3336195303 learned_addr learned my addr 172.21.15.117:0/3336195303 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:44:59.970 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f807ffff700 1 --2- 172.21.15.117:0/3336195303 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f80800bb720 0x7f8080145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.970 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f80852bb700 1 --2- 172.21.15.117:0/3336195303 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f80800bbb40 0x7f808013fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.970 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f8084aba700 1 -- 172.21.15.117:0/3336195303 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f80800bbb40 msgr2=0x7f808013fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.971 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f8084aba700 1 --2- 172.21.15.117:0/3336195303 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f80800bbb40 0x7f808013fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.971 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f8084aba700 1 -- 172.21.15.117:0/3336195303 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f80800bb720 msgr2=0x7f8080145d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:44:59.971 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f8084aba700 1 --2- 172.21.15.117:0/3336195303 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f80800bb720 0x7f8080145d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:44:59.971 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.970+0000 7f8084aba700 1 -- 172.21.15.117:0/3336195303 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80740094a0 con 0x7f808009f770 2023-07-19T20:44:59.971 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.971+0000 7f8084aba700 1 --2- 172.21.15.117:0/3336195303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f808009f770 0x7f808006a800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f807400ebe0 tx=0x7f807400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:59.971 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.971+0000 7f807d7fa700 1 -- 172.21.15.117:0/3336195303 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074009800 con 0x7f808009f770 2023-07-19T20:44:59.971 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.971+0000 7f807d7fa700 1 -- 172.21.15.117:0/3336195303 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807400c910 con 0x7f808009f770 2023-07-19T20:44:59.972 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.971+0000 7f807d7fa700 1 -- 172.21.15.117:0/3336195303 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807400cc80 con 0x7f808009f770 2023-07-19T20:44:59.972 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.971+0000 7f8086d1e700 1 -- 172.21.15.117:0/3336195303 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806c009550 con 0x7f808009f770 2023-07-19T20:44:59.972 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.971+0000 7f8086d1e700 1 -- 172.21.15.117:0/3336195303 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80801432c0 con 0x7f808009f770 2023-07-19T20:44:59.972 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.972+0000 7f8086d1e700 1 -- 172.21.15.117:0/3336195303 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8080072040 con 0x7f808009f770 2023-07-19T20:44:59.972 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.972+0000 7f807d7fa700 1 -- 172.21.15.117:0/3336195303 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f8074013470 con 0x7f808009f770 2023-07-19T20:44:59.973 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.972+0000 7f807d7fa700 1 --2- 172.21.15.117:0/3336195303 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f806406a660 0x7f806406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:44:59.973 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.973+0000 7f807d7fa700 1 -- 172.21.15.117:0/3336195303 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8074088d00 con 0x7f808009f770 2023-07-19T20:44:59.973 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.973+0000 7f807ffff700 1 --2- 172.21.15.117:0/3336195303 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f806406a660 0x7f806406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:44:59.973 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.973+0000 7f807ffff700 1 --2- 172.21.15.117:0/3336195303 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f806406a660 0x7f806406cb10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80800bbaf0 tx=0x7f806c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:44:59.973 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:44:59.977+0000 7f807d7fa700 1 -- 172.21.15.117:0/3336195303 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f8074057a80 con 0x7f808009f770 2023-07-19T20:45:00.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.161+0000 7f8086d1e700 1 -- 172.21.15.117:0/3336195303 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f80800b8d20 con 0x7f808009f770 2023-07-19T20:45:00.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.161+0000 7f807d7fa700 1 -- 172.21.15.117:0/3336195303 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8074021020 con 0x7f808009f770 2023-07-19T20:45:00.156 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 8 2023-07-19T20:45:00.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.163+0000 7f8086d1e700 1 -- 172.21.15.117:0/3336195303 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f806406a660 msgr2=0x7f806406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.163+0000 7f8086d1e700 1 --2- 172.21.15.117:0/3336195303 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f806406a660 0x7f806406cb10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80800bbaf0 tx=0x7f806c008030 comp rx=0 tx=0).stop 2023-07-19T20:45:00.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.163+0000 7f8086d1e700 1 -- 172.21.15.117:0/3336195303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f808009f770 msgr2=0x7f808006a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.163+0000 7f8086d1e700 1 --2- 172.21.15.117:0/3336195303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f808009f770 0x7f808006a800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f807400ebe0 tx=0x7f807400eef0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.163+0000 7f8086d1e700 1 -- 172.21.15.117:0/3336195303 shutdown_connections 2023-07-19T20:45:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.163+0000 7f8086d1e700 1 --2- 172.21.15.117:0/3336195303 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f806406a660 0x7f806406cb10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.163+0000 7f8086d1e700 1 --2- 172.21.15.117:0/3336195303 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f80800bbb40 0x7f808013fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.163+0000 7f8086d1e700 1 --2- 172.21.15.117:0/3336195303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f808009f770 0x7f808006a800 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.163+0000 7f8086d1e700 1 --2- 172.21.15.117:0/3336195303 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f80800bb720 0x7f8080145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.163+0000 7f8086d1e700 1 -- 172.21.15.117:0/3336195303 >> 172.21.15.117:0/3336195303 conn(0x7f80800bd920 msgr2=0x7f808009dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:00.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.163+0000 7f8086d1e700 1 -- 172.21.15.117:0/3336195303 shutdown_connections 2023-07-19T20:45:00.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.163+0000 7f8086d1e700 1 -- 172.21.15.117:0/3336195303 wait complete. 2023-07-19T20:45:00.169 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-19T20:45:00.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.299+0000 7fd5d8271700 1 Processor -- start 2023-07-19T20:45:00.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.299+0000 7fd5d8271700 1 -- start start 2023-07-19T20:45:00.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d8271700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5d006a560 0x7fd5d00a0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d8271700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd5d00a2b60 0x7fd5d00ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d8271700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d00b8490 con 0x7fd5d00a0eb0 2023-07-19T20:45:00.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d8271700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d00bcda0 con 0x7fd5d00a2b60 2023-07-19T20:45:00.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d8271700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d00b9ab0 con 0x7fd5d006a560 2023-07-19T20:45:00.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d680e700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd5d00a0eb0 0x7fd5d00ba830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41764/0 (socket says 172.21.15.117:41764) 2023-07-19T20:45:00.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d680e700 1 -- 172.21.15.117:0/3849590669 learned_addr learned my addr 172.21.15.117:0/3849590669 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:00.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d600d700 1 --2- 172.21.15.117:0/3849590669 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5d006a560 0x7fd5d00a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d580c700 1 --2- 172.21.15.117:0/3849590669 >> v2:172.21.15.124:3300/0 conn(0x7fd5d00a2b60 0x7fd5d00ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d500b700 1 -- 172.21.15.117:0/3849590669 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261760212 0 0) 0x7fd5d00b8490 con 0x7fd5d00a0eb0 2023-07-19T20:45:00.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d500b700 1 -- 172.21.15.117:0/3849590669 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5bc0035b0 con 0x7fd5d00a0eb0 2023-07-19T20:45:00.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d500b700 1 -- 172.21.15.117:0/3849590669 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1432548307 0 0) 0x7fd5bc0035b0 con 0x7fd5d00a0eb0 2023-07-19T20:45:00.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d500b700 1 -- 172.21.15.117:0/3849590669 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5d006a560 msgr2=0x7fd5d00a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d500b700 1 --2- 172.21.15.117:0/3849590669 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5d006a560 0x7fd5d00a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d500b700 1 -- 172.21.15.117:0/3849590669 >> v2:172.21.15.124:3300/0 conn(0x7fd5d00a2b60 msgr2=0x7fd5d00ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d500b700 1 --2- 172.21.15.117:0/3849590669 >> v2:172.21.15.124:3300/0 conn(0x7fd5d00a2b60 0x7fd5d00ba2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d500b700 1 -- 172.21.15.117:0/3849590669 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d00b9560 con 0x7fd5d00a0eb0 2023-07-19T20:45:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d500b700 1 -- 172.21.15.117:0/3849590669 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7fd5c80019f0 con 0x7fd5d00a0eb0 2023-07-19T20:45:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.300+0000 7fd5d580c700 1 --2- 172.21.15.117:0/3849590669 >> v2:172.21.15.124:3300/0 conn(0x7fd5d00a2b60 0x7fd5d00ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:45:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d500b700 1 -- 172.21.15.117:0/3849590669 >> v1:172.21.15.117:6789/0 conn(0x7fd5d00a0eb0 legacy=0x7fd5d00ba830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d500b700 1 --2- 172.21.15.117:0/3849590669 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5d006a560 0x7fd5bc003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d500b700 1 --2- 172.21.15.117:0/3849590669 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5bc003ff0 0x7fd5bc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d500b700 1 --2- 172.21.15.117:0/3849590669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5bc004d90 0x7fd5bc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d500b700 1 -- 172.21.15.117:0/3849590669 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d00bcda0 con 0x7fd5bc004d90 2023-07-19T20:45:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d500b700 1 -- 172.21.15.117:0/3849590669 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d00b9ab0 con 0x7fd5bc003ff0 2023-07-19T20:45:00.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d500b700 1 -- 172.21.15.117:0/3849590669 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc00ba10 con 0x7fd5d006a560 2023-07-19T20:45:00.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d680e700 1 --2- 172.21.15.117:0/3849590669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5bc004d90 0x7fd5bc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d600d700 1 --2- 172.21.15.117:0/3849590669 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5d006a560 0x7fd5bc003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d580c700 1 --2- 172.21.15.117:0/3849590669 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5bc003ff0 0x7fd5bc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d680e700 1 -- 172.21.15.117:0/3849590669 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5d006a560 msgr2=0x7fd5bc003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:00.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d680e700 1 --2- 172.21.15.117:0/3849590669 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5d006a560 0x7fd5bc003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d680e700 1 -- 172.21.15.117:0/3849590669 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5bc003ff0 msgr2=0x7fd5bc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:00.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d680e700 1 --2- 172.21.15.117:0/3849590669 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5bc003ff0 0x7fd5bc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d680e700 1 -- 172.21.15.117:0/3849590669 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc0035b0 con 0x7fd5bc004d90 2023-07-19T20:45:00.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d680e700 1 --2- 172.21.15.117:0/3849590669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5bc004d90 0x7fd5bc005200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00a12b0 tx=0x7fd5bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416f38645402c29f server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:00.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d500b700 1 -- 172.21.15.117:0/3849590669 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8012600 con 0x7fd5bc004d90 2023-07-19T20:45:00.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d500b700 1 -- 172.21.15.117:0/3849590669 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c8012780 con 0x7fd5bc004d90 2023-07-19T20:45:00.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.301+0000 7fd5d500b700 1 -- 172.21.15.117:0/3849590669 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8012b30 con 0x7fd5bc004d90 2023-07-19T20:45:00.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.302+0000 7fd5d8271700 1 -- 172.21.15.117:0/3849590669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5bc004d90 msgr2=0x7fd5bc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.302+0000 7fd5d8271700 1 --2- 172.21.15.117:0/3849590669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5bc004d90 0x7fd5bc005200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00a12b0 tx=0x7fd5bc005880 comp rx=0 tx=0).stop 2023-07-19T20:45:00.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.302+0000 7fd5d680e700 1 -- 172.21.15.117:0/3849590669 reap_dead start 2023-07-19T20:45:00.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.302+0000 7fd5d8271700 1 -- 172.21.15.117:0/3849590669 shutdown_connections 2023-07-19T20:45:00.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.302+0000 7fd5d8271700 1 -- 172.21.15.117:0/3849590669 >> 172.21.15.117:0/3849590669 conn(0x7fd5d009f570 msgr2=0x7fd5d009f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:00.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.302+0000 7fd5d8271700 1 -- 172.21.15.117:0/3849590669 shutdown_connections 2023-07-19T20:45:00.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.302+0000 7fd5d8271700 1 -- 172.21.15.117:0/3849590669 wait complete. 2023-07-19T20:45:00.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.303+0000 7fd5d8271700 1 Processor -- start 2023-07-19T20:45:00.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.303+0000 7fd5d8271700 1 -- start start 2023-07-19T20:45:00.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d8271700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5bc004d90 0x7fd5d01cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d8271700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5d01ccab0 0x7fd5d01d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d8271700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5d01c9d40 0x7fd5d01ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d8271700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d01d15e0 con 0x7fd5bc004d90 2023-07-19T20:45:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d8271700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d01cd8e0 con 0x7fd5d01c9d40 2023-07-19T20:45:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d8271700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d01d4710 con 0x7fd5d01ccab0 2023-07-19T20:45:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d600d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5bc004d90 0x7fd5d01cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d600d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5bc004d90 0x7fd5d01cab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47834/0 (socket says 172.21.15.117:47834) 2023-07-19T20:45:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d600d700 1 -- 172.21.15.117:0/981571753 learned_addr learned my addr 172.21.15.117:0/981571753 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d580c700 1 --2- 172.21.15.117:0/981571753 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5d01ccab0 0x7fd5d01d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d680e700 1 --2- 172.21.15.117:0/981571753 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5d01c9d40 0x7fd5d01ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d600d700 1 -- 172.21.15.117:0/981571753 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5d01ccab0 msgr2=0x7fd5d01d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d600d700 1 --2- 172.21.15.117:0/981571753 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5d01ccab0 0x7fd5d01d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d600d700 1 -- 172.21.15.117:0/981571753 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5d01c9d40 msgr2=0x7fd5d01ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d600d700 1 --2- 172.21.15.117:0/981571753 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5d01c9d40 0x7fd5d01ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d600d700 1 -- 172.21.15.117:0/981571753 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d01d49f0 con 0x7fd5bc004d90 2023-07-19T20:45:00.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d600d700 1 --2- 172.21.15.117:0/981571753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5bc004d90 0x7fd5d01cab30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0011aa0 tx=0x7fd5c0011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:00.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5c6ffd700 1 -- 172.21.15.117:0/981571753 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0011ee0 con 0x7fd5bc004d90 2023-07-19T20:45:00.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5c6ffd700 1 -- 172.21.15.117:0/981571753 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c000f940 con 0x7fd5bc004d90 2023-07-19T20:45:00.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d8271700 1 -- 172.21.15.117:0/981571753 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d01d4cd0 con 0x7fd5bc004d90 2023-07-19T20:45:00.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5c6ffd700 1 -- 172.21.15.117:0/981571753 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000fcf0 con 0x7fd5bc004d90 2023-07-19T20:45:00.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.304+0000 7fd5d8271700 1 -- 172.21.15.117:0/981571753 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d01d4330 con 0x7fd5bc004d90 2023-07-19T20:45:00.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.305+0000 7fd5d8271700 1 -- 172.21.15.117:0/981571753 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d01d4550 con 0x7fd5bc004d90 2023-07-19T20:45:00.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.306+0000 7fd5c6ffd700 1 -- 172.21.15.117:0/981571753 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fd5c0014440 con 0x7fd5bc004d90 2023-07-19T20:45:00.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.306+0000 7fd5c6ffd700 1 --2- 172.21.15.117:0/981571753 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd5b406a690 0x7fd5b406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.306+0000 7fd5c6ffd700 1 -- 172.21.15.117:0/981571753 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd5c0089020 con 0x7fd5bc004d90 2023-07-19T20:45:00.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.306+0000 7fd5d580c700 1 --2- 172.21.15.117:0/981571753 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd5b406a690 0x7fd5b406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.307+0000 7fd5d580c700 1 --2- 172.21.15.117:0/981571753 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd5b406a690 0x7fd5b406cb40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd5d01d1810 tx=0x7fd5cc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:00.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.310+0000 7fd5c6ffd700 1 -- 172.21.15.117:0/981571753 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fd5c00580b0 con 0x7fd5bc004d90 2023-07-19T20:45:00.490 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.496+0000 7fd5d8271700 1 -- 172.21.15.117:0/981571753 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5d0067940 con 0x7fd5bc004d90 2023-07-19T20:45:00.490 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.497+0000 7fd5c6ffd700 1 -- 172.21.15.117:0/981571753 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5c0057c40 con 0x7fd5bc004d90 2023-07-19T20:45:00.490 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2023-07-19T20:45:00.493 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.499+0000 7fd5d8271700 1 -- 172.21.15.117:0/981571753 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd5b406a690 msgr2=0x7fd5b406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.499+0000 7fd5d8271700 1 --2- 172.21.15.117:0/981571753 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd5b406a690 0x7fd5b406cb40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd5d01d1810 tx=0x7fd5cc009210 comp rx=0 tx=0).stop 2023-07-19T20:45:00.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.499+0000 7fd5d8271700 1 -- 172.21.15.117:0/981571753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5bc004d90 msgr2=0x7fd5d01cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.499+0000 7fd5d8271700 1 --2- 172.21.15.117:0/981571753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5bc004d90 0x7fd5d01cab30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0011aa0 tx=0x7fd5c0011db0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.499+0000 7fd5d8271700 1 -- 172.21.15.117:0/981571753 shutdown_connections 2023-07-19T20:45:00.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.499+0000 7fd5d8271700 1 --2- 172.21.15.117:0/981571753 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd5b406a690 0x7fd5b406cb40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.499+0000 7fd5d8271700 1 --2- 172.21.15.117:0/981571753 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5d01c9d40 0x7fd5d01ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.495 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.499+0000 7fd5d8271700 1 --2- 172.21.15.117:0/981571753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5bc004d90 0x7fd5d01cab30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.495 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.499+0000 7fd5d8271700 1 --2- 172.21.15.117:0/981571753 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5d01ccab0 0x7fd5d01d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.495 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.499+0000 7fd5d8271700 1 -- 172.21.15.117:0/981571753 >> 172.21.15.117:0/981571753 conn(0x7fd5d009f570 msgr2=0x7fd5d009d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:00.495 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.499+0000 7fd5d8271700 1 -- 172.21.15.117:0/981571753 shutdown_connections 2023-07-19T20:45:00.495 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.499+0000 7fd5d8271700 1 -- 172.21.15.117:0/981571753 wait complete. 2023-07-19T20:45:00.504 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-19T20:45:00.636 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.633+0000 7f99252f5700 1 Processor -- start 2023-07-19T20:45:00.637 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.633+0000 7f99252f5700 1 -- start start 2023-07-19T20:45:00.637 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.634+0000 7f99252f5700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99200ba7f0 0x7f992014a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.637 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.634+0000 7f99252f5700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f992014e930 0x7f99200b8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.637 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.634+0000 7f99252f5700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99200b9210 con 0x7f99200babc0 2023-07-19T20:45:00.637 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.634+0000 7f99252f5700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200b44f0 con 0x7f992014e930 2023-07-19T20:45:00.637 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.634+0000 7f99252f5700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992014e4a0 con 0x7f99200ba7f0 2023-07-19T20:45:00.638 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.634+0000 7f991e7fc700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f992014e930 0x7f99200b8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.638 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.634+0000 7f991f7fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f99200babc0 0x7f99200bb4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41772/0 (socket says 172.21.15.117:41772) 2023-07-19T20:45:00.639 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.634+0000 7f991f7fe700 1 -- 172.21.15.117:0/2012364142 learned_addr learned my addr 172.21.15.117:0/2012364142 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:00.640 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.634+0000 7f991effd700 1 --2- 172.21.15.117:0/2012364142 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99200ba7f0 0x7f992014a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.640 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.634+0000 7f991e7fc700 1 -- 172.21.15.117:0/2012364142 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99200ba7f0 msgr2=0x7f992014a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:00.640 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.634+0000 7f991e7fc700 1 --2- 172.21.15.117:0/2012364142 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99200ba7f0 0x7f992014a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.640 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.634+0000 7f991e7fc700 1 -- 172.21.15.117:0/2012364142 >> v1:172.21.15.117:6789/0 conn(0x7f99200babc0 legacy=0x7f99200bb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.640 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.635+0000 7f991e7fc700 1 -- 172.21.15.117:0/2012364142 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920144e60 con 0x7f992014e930 2023-07-19T20:45:00.641 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.635+0000 7f991dffb700 1 -- 172.21.15.117:0/2012364142 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100499051 0 0) 0x7f99200b9210 con 0x7f99200babc0 2023-07-19T20:45:00.641 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.635+0000 7f991e7fc700 1 --2- 172.21.15.117:0/2012364142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992014e930 0x7f99200b8670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9910009840 tx=0x7f9910009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38949b3966640875 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:00.641 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.635+0000 7f991dffb700 1 -- 172.21.15.117:0/2012364142 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910011830 con 0x7f992014e930 2023-07-19T20:45:00.641 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.635+0000 7f991dffb700 1 -- 172.21.15.117:0/2012364142 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910011990 con 0x7f992014e930 2023-07-19T20:45:00.641 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.635+0000 7f991dffb700 1 -- 172.21.15.117:0/2012364142 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910011d20 con 0x7f992014e930 2023-07-19T20:45:00.641 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.635+0000 7f99252f5700 1 -- 172.21.15.117:0/2012364142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992014e930 msgr2=0x7f99200b8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.641 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.635+0000 7f99252f5700 1 --2- 172.21.15.117:0/2012364142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992014e930 0x7f99200b8670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9910009840 tx=0x7f9910009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:00.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.635+0000 7f99252f5700 1 -- 172.21.15.117:0/2012364142 shutdown_connections 2023-07-19T20:45:00.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.635+0000 7f99252f5700 1 --2- 172.21.15.117:0/2012364142 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99200ba7f0 0x7f992014a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.635+0000 7f99252f5700 1 --2- 172.21.15.117:0/2012364142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992014e930 0x7f99200b8670 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.635+0000 7f99252f5700 1 -- 172.21.15.117:0/2012364142 >> 172.21.15.117:0/2012364142 conn(0x7f9920071c90 msgr2=0x7f9920072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:00.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.635+0000 7f99252f5700 1 -- 172.21.15.117:0/2012364142 shutdown_connections 2023-07-19T20:45:00.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.635+0000 7f99252f5700 1 -- 172.21.15.117:0/2012364142 wait complete. 2023-07-19T20:45:00.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.637+0000 7f99252f5700 1 Processor -- start 2023-07-19T20:45:00.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.637+0000 7f99252f5700 1 -- start start 2023-07-19T20:45:00.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.637+0000 7f99252f5700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99200ba7f0 0x7f99201d73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.637+0000 7f99252f5700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99200babc0 0x7f99201e3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.637+0000 7f99252f5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992014e930 0x7f99201d6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.637+0000 7f99252f5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99201d7920 con 0x7f992014e930 2023-07-19T20:45:00.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.637+0000 7f99252f5700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99201e38f0 con 0x7f99200babc0 2023-07-19T20:45:00.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.637+0000 7f99252f5700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99201e35c0 con 0x7f99200ba7f0 2023-07-19T20:45:00.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.637+0000 7f991f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992014e930 0x7f99201d6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.637+0000 7f991f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992014e930 0x7f99201d6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47846/0 (socket says 172.21.15.117:47846) 2023-07-19T20:45:00.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.637+0000 7f991f7fe700 1 -- 172.21.15.117:0/1193059810 learned_addr learned my addr 172.21.15.117:0/1193059810 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:00.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.637+0000 7f991effd700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99200ba7f0 0x7f99201d73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.637+0000 7f991e7fc700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99200babc0 0x7f99201e3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.638+0000 7f991f7fe700 1 -- 172.21.15.117:0/1193059810 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99200ba7f0 msgr2=0x7f99201d73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.638+0000 7f991f7fe700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99200ba7f0 0x7f99201d73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.638+0000 7f991f7fe700 1 -- 172.21.15.117:0/1193059810 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99200babc0 msgr2=0x7f99201e3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.638+0000 7f991f7fe700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99200babc0 0x7f99201e3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.638+0000 7f991f7fe700 1 -- 172.21.15.117:0/1193059810 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99100094a0 con 0x7f992014e930 2023-07-19T20:45:00.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.638+0000 7f991e7fc700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99200babc0 0x7f99201e3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:00.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.638+0000 7f991f7fe700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992014e930 0x7f99201d6070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9918002230 tx=0x7f991800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:00.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.638+0000 7f99077fe700 1 -- 172.21.15.117:0/1193059810 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991800ab70 con 0x7f992014e930 2023-07-19T20:45:00.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.638+0000 7f99077fe700 1 -- 172.21.15.117:0/1193059810 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991800acf0 con 0x7f992014e930 2023-07-19T20:45:00.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.638+0000 7f99252f5700 1 -- 172.21.15.117:0/1193059810 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992014a1f0 con 0x7f992014e930 2023-07-19T20:45:00.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.638+0000 7f99077fe700 1 -- 172.21.15.117:0/1193059810 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918007310 con 0x7f992014e930 2023-07-19T20:45:00.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.638+0000 7f99252f5700 1 -- 172.21.15.117:0/1193059810 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99201d69d0 con 0x7f992014e930 2023-07-19T20:45:00.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.639+0000 7f99252f5700 1 -- 172.21.15.117:0/1193059810 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99200ba0c0 con 0x7f992014e930 2023-07-19T20:45:00.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.639+0000 7f99077fe700 1 -- 172.21.15.117:0/1193059810 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f9918007470 con 0x7f992014e930 2023-07-19T20:45:00.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.640+0000 7f99077fe700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f990c06a660 0x7f990c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.640+0000 7f99077fe700 1 -- 172.21.15.117:0/1193059810 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9918088910 con 0x7f992014e930 2023-07-19T20:45:00.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.640+0000 7f991effd700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f990c06a660 0x7f990c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.640+0000 7f991effd700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f990c06a660 0x7f990c06cb10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9914006b20 tx=0x7f9914008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:00.648 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.644+0000 7f99077fe700 1 -- 172.21.15.117:0/1193059810 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9918053d00 con 0x7f992014e930 2023-07-19T20:45:00.826 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.832+0000 7f99252f5700 1 -- 172.21.15.117:0/1193059810 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f992008b0b0 con 0x7f992014e930 2023-07-19T20:45:00.827 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.832+0000 7f99077fe700 1 -- 172.21.15.117:0/1193059810 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9918018020 con 0x7f992014e930 2023-07-19T20:45:00.827 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2023-07-19T20:45:00.828 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.834+0000 7f99252f5700 1 -- 172.21.15.117:0/1193059810 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f990c06a660 msgr2=0x7f990c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.828 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.834+0000 7f99252f5700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f990c06a660 0x7f990c06cb10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9914006b20 tx=0x7f9914008040 comp rx=0 tx=0).stop 2023-07-19T20:45:00.829 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.834+0000 7f99252f5700 1 -- 172.21.15.117:0/1193059810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992014e930 msgr2=0x7f99201d6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.829 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.834+0000 7f99252f5700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992014e930 0x7f99201d6070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9918002230 tx=0x7f991800cf50 comp rx=0 tx=0).stop 2023-07-19T20:45:00.829 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.834+0000 7f99252f5700 1 -- 172.21.15.117:0/1193059810 shutdown_connections 2023-07-19T20:45:00.829 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.834+0000 7f99252f5700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f990c06a660 0x7f990c06cb10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.829 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.834+0000 7f99252f5700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992014e930 0x7f99201d6070 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.829 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.834+0000 7f99252f5700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99200ba7f0 0x7f99201d73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.829 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.834+0000 7f99252f5700 1 --2- 172.21.15.117:0/1193059810 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99200babc0 0x7f99201e3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.830 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.834+0000 7f99252f5700 1 -- 172.21.15.117:0/1193059810 >> 172.21.15.117:0/1193059810 conn(0x7f9920071c90 msgr2=0x7f99200be9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:00.830 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.834+0000 7f99252f5700 1 -- 172.21.15.117:0/1193059810 shutdown_connections 2023-07-19T20:45:00.830 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.834+0000 7f99252f5700 1 -- 172.21.15.117:0/1193059810 wait complete. 2023-07-19T20:45:00.840 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-19T20:45:00.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.970+0000 7fd35022d700 1 Processor -- start 2023-07-19T20:45:00.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.970+0000 7fd35022d700 1 -- start start 2023-07-19T20:45:00.966 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.971+0000 7fd35022d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3480baa60 0x7fd3480b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.966 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.971+0000 7fd35022d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd3480bca00 0x7fd3480bd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.966 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.971+0000 7fd35022d700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3480bd540 con 0x7fd34814ddd0 2023-07-19T20:45:00.968 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.971+0000 7fd35022d700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3480bdf10 con 0x7fd3480baa60 2023-07-19T20:45:00.968 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.971+0000 7fd35022d700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480b8d70 con 0x7fd3480bca00 2023-07-19T20:45:00.968 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.971+0000 7fd34dfc9700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3480baa60 0x7fd3480b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.969 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.971+0000 7fd34dfc9700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3480baa60 0x7fd3480b7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47858/0 (socket says 172.21.15.117:47858) 2023-07-19T20:45:00.969 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.971+0000 7fd34dfc9700 1 -- 172.21.15.117:0/2526796651 learned_addr learned my addr 172.21.15.117:0/2526796651 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:00.969 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.971+0000 7fd34e7ca700 1 --1- 172.21.15.117:0/2526796651 >> v1:172.21.15.117:6789/0 conn(0x7fd34814ddd0 0x7fd348144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41784/0 (socket says 172.21.15.117:41784) 2023-07-19T20:45:00.969 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.971+0000 7fd34dfc9700 1 -- 172.21.15.117:0/2526796651 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd3480bca00 msgr2=0x7fd3480bd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:00.970 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.971+0000 7fd34dfc9700 1 --2- 172.21.15.117:0/2526796651 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd3480bca00 0x7fd3480bd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.970 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.971+0000 7fd34dfc9700 1 -- 172.21.15.117:0/2526796651 >> v1:172.21.15.117:6789/0 conn(0x7fd34814ddd0 legacy=0x7fd348144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.970 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.971+0000 7fd34dfc9700 1 -- 172.21.15.117:0/2526796651 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348144ea0 con 0x7fd3480baa60 2023-07-19T20:45:00.971 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.971+0000 7fd34cfc7700 1 -- 172.21.15.117:0/2526796651 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551480322 0 0) 0x7fd3480bd540 con 0x7fd34814ddd0 2023-07-19T20:45:00.971 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.972+0000 7fd34dfc9700 1 --2- 172.21.15.117:0/2526796651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3480baa60 0x7fd3480b7f30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd3400098f0 tx=0x7fd340009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506953cb245472c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:00.971 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.972+0000 7fd34cfc7700 1 -- 172.21.15.117:0/2526796651 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34000b8a0 con 0x7fd3480baa60 2023-07-19T20:45:00.972 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.972+0000 7fd34cfc7700 1 -- 172.21.15.117:0/2526796651 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34000ba00 con 0x7fd3480baa60 2023-07-19T20:45:00.972 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.972+0000 7fd34cfc7700 1 -- 172.21.15.117:0/2526796651 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34000bd90 con 0x7fd3480baa60 2023-07-19T20:45:00.972 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.972+0000 7fd35022d700 1 -- 172.21.15.117:0/2526796651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3480baa60 msgr2=0x7fd3480b7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.972 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.972+0000 7fd35022d700 1 --2- 172.21.15.117:0/2526796651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3480baa60 0x7fd3480b7f30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd3400098f0 tx=0x7fd340009c00 comp rx=0 tx=0).stop 2023-07-19T20:45:00.973 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.972+0000 7fd35022d700 1 -- 172.21.15.117:0/2526796651 shutdown_connections 2023-07-19T20:45:00.973 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.972+0000 7fd35022d700 1 --2- 172.21.15.117:0/2526796651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3480baa60 0x7fd3480b7f30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.973 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.972+0000 7fd35022d700 1 --2- 172.21.15.117:0/2526796651 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd3480bca00 0x7fd3480bd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.974 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.972+0000 7fd35022d700 1 -- 172.21.15.117:0/2526796651 >> 172.21.15.117:0/2526796651 conn(0x7fd348071c90 msgr2=0x7fd348072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:00.974 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.972+0000 7fd35022d700 1 -- 172.21.15.117:0/2526796651 shutdown_connections 2023-07-19T20:45:00.974 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.972+0000 7fd35022d700 1 -- 172.21.15.117:0/2526796651 wait complete. 2023-07-19T20:45:00.978 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.973+0000 7fd35022d700 1 Processor -- start 2023-07-19T20:45:00.979 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.973+0000 7fd35022d700 1 -- start start 2023-07-19T20:45:00.979 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd35022d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3480baa60 0x7fd3480bb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.979 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd35022d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd3480bca00 0x7fd348145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.979 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd35022d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd34814ddd0 0x7fd348146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.979 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd35022d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480a6e30 con 0x7fd3480baa60 2023-07-19T20:45:00.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd35022d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd348145130 con 0x7fd34814ddd0 2023-07-19T20:45:00.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd35022d700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3481d66c0 con 0x7fd3480bca00 2023-07-19T20:45:00.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd34dfc9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3480baa60 0x7fd3480bb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd34dfc9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3480baa60 0x7fd3480bb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47870/0 (socket says 172.21.15.117:47870) 2023-07-19T20:45:00.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd34dfc9700 1 -- 172.21.15.117:0/667757194 learned_addr learned my addr 172.21.15.117:0/667757194 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:00.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd34e7ca700 1 --2- 172.21.15.117:0/667757194 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd34814ddd0 0x7fd348146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd34d7c8700 1 --2- 172.21.15.117:0/667757194 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd3480bca00 0x7fd348145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd34dfc9700 1 -- 172.21.15.117:0/667757194 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd3480bca00 msgr2=0x7fd348145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd34dfc9700 1 --2- 172.21.15.117:0/667757194 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd3480bca00 0x7fd348145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd34dfc9700 1 -- 172.21.15.117:0/667757194 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd34814ddd0 msgr2=0x7fd348146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:00.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd34dfc9700 1 --2- 172.21.15.117:0/667757194 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd34814ddd0 0x7fd348146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:00.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd34dfc9700 1 -- 172.21.15.117:0/667757194 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd340009550 con 0x7fd3480baa60 2023-07-19T20:45:00.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.974+0000 7fd34dfc9700 1 --2- 172.21.15.117:0/667757194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3480baa60 0x7fd3480bb990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd340014040 tx=0x7fd340004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:00.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.975+0000 7fd3467fc700 1 -- 172.21.15.117:0/667757194 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3400036a0 con 0x7fd3480baa60 2023-07-19T20:45:00.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.975+0000 7fd3467fc700 1 -- 172.21.15.117:0/667757194 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34001e070 con 0x7fd3480baa60 2023-07-19T20:45:00.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.975+0000 7fd35022d700 1 -- 172.21.15.117:0/667757194 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3481d6390 con 0x7fd3480baa60 2023-07-19T20:45:00.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.975+0000 7fd3467fc700 1 -- 172.21.15.117:0/667757194 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340003a40 con 0x7fd3480baa60 2023-07-19T20:45:00.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.975+0000 7fd35022d700 1 -- 172.21.15.117:0/667757194 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd348148030 con 0x7fd3480baa60 2023-07-19T20:45:00.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.975+0000 7fd35022d700 1 -- 172.21.15.117:0/667757194 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3480b9800 con 0x7fd3480baa60 2023-07-19T20:45:00.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.976+0000 7fd3467fc700 1 -- 172.21.15.117:0/667757194 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fd340003ba0 con 0x7fd3480baa60 2023-07-19T20:45:00.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.976+0000 7fd3467fc700 1 --2- 172.21.15.117:0/667757194 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd33406a660 0x7fd33406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:00.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.976+0000 7fd3467fc700 1 -- 172.21.15.117:0/667757194 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd340020070 con 0x7fd3480baa60 2023-07-19T20:45:00.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.976+0000 7fd34d7c8700 1 --2- 172.21.15.117:0/667757194 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd33406a660 0x7fd33406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:00.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.977+0000 7fd34d7c8700 1 --2- 172.21.15.117:0/667757194 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd33406a660 0x7fd33406cb10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd33c006fd0 tx=0x7fd33c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:00.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:00.980+0000 7fd3467fc700 1 -- 172.21.15.117:0/667757194 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fd340055560 con 0x7fd3480baa60 2023-07-19T20:45:01.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.164+0000 7fd35022d700 1 -- 172.21.15.117:0/667757194 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd348074890 con 0x7fd3480baa60 2023-07-19T20:45:01.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.164+0000 7fd3467fc700 1 -- 172.21.15.117:0/667757194 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd340058b80 con 0x7fd3480baa60 2023-07-19T20:45:01.159 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 64 2023-07-19T20:45:01.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.166+0000 7fd35022d700 1 -- 172.21.15.117:0/667757194 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd33406a660 msgr2=0x7fd33406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.166+0000 7fd35022d700 1 --2- 172.21.15.117:0/667757194 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd33406a660 0x7fd33406cb10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd33c006fd0 tx=0x7fd33c008040 comp rx=0 tx=0).stop 2023-07-19T20:45:01.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.166+0000 7fd35022d700 1 -- 172.21.15.117:0/667757194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3480baa60 msgr2=0x7fd3480bb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.166+0000 7fd35022d700 1 --2- 172.21.15.117:0/667757194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3480baa60 0x7fd3480bb990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd340014040 tx=0x7fd340004750 comp rx=0 tx=0).stop 2023-07-19T20:45:01.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.166+0000 7fd35022d700 1 -- 172.21.15.117:0/667757194 shutdown_connections 2023-07-19T20:45:01.162 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.166+0000 7fd35022d700 1 --2- 172.21.15.117:0/667757194 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd33406a660 0x7fd33406cb10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.162 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.166+0000 7fd35022d700 1 --2- 172.21.15.117:0/667757194 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd34814ddd0 0x7fd348146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.162 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.166+0000 7fd35022d700 1 --2- 172.21.15.117:0/667757194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3480baa60 0x7fd3480bb990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.163 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.166+0000 7fd35022d700 1 --2- 172.21.15.117:0/667757194 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd3480bca00 0x7fd348145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.163 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.166+0000 7fd35022d700 1 -- 172.21.15.117:0/667757194 >> 172.21.15.117:0/667757194 conn(0x7fd348071c90 msgr2=0x7fd3480bef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:01.163 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.166+0000 7fd35022d700 1 -- 172.21.15.117:0/667757194 shutdown_connections 2023-07-19T20:45:01.165 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.166+0000 7fd35022d700 1 -- 172.21.15.117:0/667757194 wait complete. 2023-07-19T20:45:01.172 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:45:01.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.300+0000 7f70f9317700 1 Processor -- start 2023-07-19T20:45:01.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.300+0000 7f70f9317700 1 -- start start 2023-07-19T20:45:01.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.300+0000 7f70f9317700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f70f4149f50 0x7f70f414a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.300+0000 7f70f9317700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f70f4153250 0x7f70f4155630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.300+0000 7f70f9317700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f40bcd00 con 0x7f70f40c1470 2023-07-19T20:45:01.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.300+0000 7f70f9317700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f40b8710 con 0x7f70f4149f50 2023-07-19T20:45:01.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.300+0000 7f70f9317700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f40b8bd0 con 0x7f70f4153250 2023-07-19T20:45:01.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.301+0000 7f70f27fc700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f70f4149f50 0x7f70f414a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.301+0000 7f70f27fc700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f70f4149f50 0x7f70f414a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47878/0 (socket says 172.21.15.117:47878) 2023-07-19T20:45:01.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.301+0000 7f70f27fc700 1 -- 172.21.15.117:0/2837541836 learned_addr learned my addr 172.21.15.117:0/2837541836 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:01.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.301+0000 7f70f2ffd700 1 --1- 172.21.15.117:0/2837541836 >> v1:172.21.15.117:6789/0 conn(0x7f70f40c1470 0x7f70f40b8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41800/0 (socket says 172.21.15.117:41800) 2023-07-19T20:45:01.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.301+0000 7f70f37fe700 1 --2- 172.21.15.117:0/2837541836 >> v2:172.21.15.124:3300/0 conn(0x7f70f4153250 0x7f70f4155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.301+0000 7f70f27fc700 1 -- 172.21.15.117:0/2837541836 >> v2:172.21.15.124:3300/0 conn(0x7f70f4153250 msgr2=0x7f70f4155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:01.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.301+0000 7f70f27fc700 1 --2- 172.21.15.117:0/2837541836 >> v2:172.21.15.124:3300/0 conn(0x7f70f4153250 0x7f70f4155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.301+0000 7f70f27fc700 1 -- 172.21.15.117:0/2837541836 >> v1:172.21.15.117:6789/0 conn(0x7f70f40c1470 legacy=0x7f70f40b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.301+0000 7f70f27fc700 1 -- 172.21.15.117:0/2837541836 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f40bab50 con 0x7f70f4149f50 2023-07-19T20:45:01.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.301+0000 7f70f1ffb700 1 -- 172.21.15.117:0/2837541836 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204488005 0 0) 0x7f70f40bcd00 con 0x7f70f40c1470 2023-07-19T20:45:01.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.301+0000 7f70f27fc700 1 --2- 172.21.15.117:0/2837541836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f4149f50 0x7f70f414a3d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f70f40b9dc0 tx=0x7f70dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e560be78cf7ec4e server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:01.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.301+0000 7f70f1ffb700 1 -- 172.21.15.117:0/2837541836 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc011830 con 0x7f70f4149f50 2023-07-19T20:45:01.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.301+0000 7f70f1ffb700 1 -- 172.21.15.117:0/2837541836 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc011990 con 0x7f70f4149f50 2023-07-19T20:45:01.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.301+0000 7f70f1ffb700 1 -- 172.21.15.117:0/2837541836 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc011d20 con 0x7f70f4149f50 2023-07-19T20:45:01.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.302+0000 7f70f9317700 1 -- 172.21.15.117:0/2837541836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f4149f50 msgr2=0x7f70f414a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.302+0000 7f70f9317700 1 --2- 172.21.15.117:0/2837541836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f4149f50 0x7f70f414a3d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f70f40b9dc0 tx=0x7f70dc009bd0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.302 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.302+0000 7f70f9317700 1 -- 172.21.15.117:0/2837541836 shutdown_connections 2023-07-19T20:45:01.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.302+0000 7f70f9317700 1 --2- 172.21.15.117:0/2837541836 >> v2:172.21.15.124:3300/0 conn(0x7f70f4153250 0x7f70f4155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.302+0000 7f70f9317700 1 --2- 172.21.15.117:0/2837541836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f4149f50 0x7f70f414a3d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.302+0000 7f70f9317700 1 -- 172.21.15.117:0/2837541836 >> 172.21.15.117:0/2837541836 conn(0x7f70f4072920 msgr2=0x7f70f40c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:01.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.302+0000 7f70f9317700 1 -- 172.21.15.117:0/2837541836 shutdown_connections 2023-07-19T20:45:01.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.302+0000 7f70f9317700 1 -- 172.21.15.117:0/2837541836 wait complete. 2023-07-19T20:45:01.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.303+0000 7f70f9317700 1 Processor -- start 2023-07-19T20:45:01.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.303+0000 7f70f9317700 1 -- start start 2023-07-19T20:45:01.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f9317700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70f40c1470 0x7f70f41529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f9317700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70f4149f50 0x7f70f40b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f9317700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f4153250 0x7f70f41e3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f9317700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f4152ef0 con 0x7f70f4153250 2023-07-19T20:45:01.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f9317700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40b3730 con 0x7f70f4149f50 2023-07-19T20:45:01.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f9317700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f4152290 con 0x7f70f40c1470 2023-07-19T20:45:01.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f4153250 0x7f70f41e3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f4153250 0x7f70f41e3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47884/0 (socket says 172.21.15.117:47884) 2023-07-19T20:45:01.304 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f37fe700 1 -- 172.21.15.117:0/4221631089 learned_addr learned my addr 172.21.15.117:0/4221631089 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:01.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f27fc700 1 --2- 172.21.15.117:0/4221631089 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70f4149f50 0x7f70f40b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f2ffd700 1 --2- 172.21.15.117:0/4221631089 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70f40c1470 0x7f70f41529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f37fe700 1 -- 172.21.15.117:0/4221631089 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70f40c1470 msgr2=0x7f70f41529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f37fe700 1 --2- 172.21.15.117:0/4221631089 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70f40c1470 0x7f70f41529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f37fe700 1 -- 172.21.15.117:0/4221631089 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70f4149f50 msgr2=0x7f70f40b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f37fe700 1 --2- 172.21.15.117:0/4221631089 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70f4149f50 0x7f70f40b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f37fe700 1 -- 172.21.15.117:0/4221631089 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc009550 con 0x7f70f4153250 2023-07-19T20:45:01.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70f37fe700 1 --2- 172.21.15.117:0/4221631089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f4153250 0x7f70f41e3330 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f70e400e800 tx=0x7f70e400eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:01.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70eb7fe700 1 -- 172.21.15.117:0/4221631089 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4013680 con 0x7f70f4153250 2023-07-19T20:45:01.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70eb7fe700 1 -- 172.21.15.117:0/4221631089 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e4013800 con 0x7f70f4153250 2023-07-19T20:45:01.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.304+0000 7f70eb7fe700 1 -- 172.21.15.117:0/4221631089 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4013bb0 con 0x7f70f4153250 2023-07-19T20:45:01.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.305+0000 7f70f9317700 1 -- 172.21.15.117:0/4221631089 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f4150790 con 0x7f70f4153250 2023-07-19T20:45:01.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.305+0000 7f70f9317700 1 -- 172.21.15.117:0/4221631089 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f4150d50 con 0x7f70f4153250 2023-07-19T20:45:01.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.306+0000 7f70f9317700 1 -- 172.21.15.117:0/4221631089 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f4074890 con 0x7f70f4153250 2023-07-19T20:45:01.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.306+0000 7f70eb7fe700 1 -- 172.21.15.117:0/4221631089 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f70e4013d10 con 0x7f70f4153250 2023-07-19T20:45:01.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.307+0000 7f70eb7fe700 1 --2- 172.21.15.117:0/4221631089 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f70d406a660 0x7f70d406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.307+0000 7f70eb7fe700 1 -- 172.21.15.117:0/4221631089 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70e40888a0 con 0x7f70f4153250 2023-07-19T20:45:01.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.307+0000 7f70f2ffd700 1 --2- 172.21.15.117:0/4221631089 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f70d406a660 0x7f70d406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.307+0000 7f70f2ffd700 1 --2- 172.21.15.117:0/4221631089 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f70d406a660 0x7f70d406cb10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0012e0 tx=0x7f70ec001b70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:01.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.311+0000 7f70eb7fe700 1 -- 172.21.15.117:0/4221631089 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f70e4053c90 con 0x7f70f4153250 2023-07-19T20:45:01.492 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.499+0000 7f70f9317700 1 -- 172.21.15.117:0/4221631089 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70f40c0e50 con 0x7f70f4153250 2023-07-19T20:45:01.493 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.500+0000 7f70eb7fe700 1 -- 172.21.15.117:0/4221631089 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17897 (secure 0 0 0) 0x7f70e4017090 con 0x7f70f4153250 2023-07-19T20:45:01.494 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:01.494 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:39.549566+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:45:01.496 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.502+0000 7f70f9317700 1 -- 172.21.15.117:0/4221631089 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f70d406a660 msgr2=0x7f70d406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.497 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.502+0000 7f70f9317700 1 --2- 172.21.15.117:0/4221631089 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f70d406a660 0x7f70d406cb10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0012e0 tx=0x7f70ec001b70 comp rx=0 tx=0).stop 2023-07-19T20:45:01.497 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.502+0000 7f70f9317700 1 -- 172.21.15.117:0/4221631089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f4153250 msgr2=0x7f70f41e3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.497 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.502+0000 7f70f9317700 1 --2- 172.21.15.117:0/4221631089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f4153250 0x7f70f41e3330 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f70e400e800 tx=0x7f70e400eb10 comp rx=0 tx=0).stop 2023-07-19T20:45:01.497 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.502+0000 7f70f9317700 1 -- 172.21.15.117:0/4221631089 shutdown_connections 2023-07-19T20:45:01.497 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.502+0000 7f70f9317700 1 --2- 172.21.15.117:0/4221631089 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f70d406a660 0x7f70d406cb10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.498 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.502+0000 7f70f9317700 1 --2- 172.21.15.117:0/4221631089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f4153250 0x7f70f41e3330 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.498 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.502+0000 7f70f9317700 1 --2- 172.21.15.117:0/4221631089 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f70f40c1470 0x7f70f41529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.498 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.502+0000 7f70f9317700 1 --2- 172.21.15.117:0/4221631089 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70f4149f50 0x7f70f40b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.498 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.502+0000 7f70f9317700 1 -- 172.21.15.117:0/4221631089 >> 172.21.15.117:0/4221631089 conn(0x7f70f4072920 msgr2=0x7f70f414b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:01.499 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.502+0000 7f70f9317700 1 -- 172.21.15.117:0/4221631089 shutdown_connections 2023-07-19T20:45:01.499 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.502+0000 7f70f9317700 1 -- 172.21.15.117:0/4221631089 wait complete. 2023-07-19T20:45:01.508 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-19T20:44:31.325778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-19T20:44:31.728215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-19T20:44:36.280405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-19T20:44:37.509195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-19T20:45:01.509 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-19T20:45:01.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.639+0000 7f47ab71e700 1 Processor -- start 2023-07-19T20:45:01.688 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.640+0000 7f47ab71e700 1 -- start start 2023-07-19T20:45:01.688 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.640+0000 7f47ab71e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f47a40bd1d0 0x7f47a4072540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.688 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.640+0000 7f47ab71e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f47a406d840 0x7f47a40bb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.688 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.640+0000 7f47ab71e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47a40bbc20 0x7f47a40bc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.689 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.640+0000 7f47ab71e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a40bc5a0 con 0x7f47a40bbc20 2023-07-19T20:45:01.689 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.640+0000 7f47ab71e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a406cf40 con 0x7f47a40bd1d0 2023-07-19T20:45:01.689 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.640+0000 7f47ab71e700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a406d360 con 0x7f47a406d840 2023-07-19T20:45:01.689 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.640+0000 7f47a9cbb700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47a40bbc20 0x7f47a40bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.689 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.640+0000 7f47a9cbb700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47a40bbc20 0x7f47a40bc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47898/0 (socket says 172.21.15.117:47898) 2023-07-19T20:45:01.689 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.640+0000 7f47a9cbb700 1 -- 172.21.15.117:0/48677630 learned_addr learned my addr 172.21.15.117:0/48677630 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:01.689 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.641+0000 7f47a94ba700 1 --2- 172.21.15.117:0/48677630 >> v2:172.21.15.124:3300/0 conn(0x7f47a40bd1d0 0x7f47a4072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.690 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.641+0000 7f47a8cb9700 1 --2- 172.21.15.117:0/48677630 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f47a406d840 0x7f47a40bb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.690 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.641+0000 7f47a9cbb700 1 -- 172.21.15.117:0/48677630 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f47a406d840 msgr2=0x7f47a40bb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:01.691 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.641+0000 7f47a9cbb700 1 --2- 172.21.15.117:0/48677630 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f47a406d840 0x7f47a40bb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.691 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.641+0000 7f47a9cbb700 1 -- 172.21.15.117:0/48677630 >> v2:172.21.15.124:3300/0 conn(0x7f47a40bd1d0 msgr2=0x7f47a4072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:01.691 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.641+0000 7f47a9cbb700 1 --2- 172.21.15.117:0/48677630 >> v2:172.21.15.124:3300/0 conn(0x7f47a40bd1d0 0x7f47a4072540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.691 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.641+0000 7f47a9cbb700 1 -- 172.21.15.117:0/48677630 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a4072a80 con 0x7f47a40bbc20 2023-07-19T20:45:01.691 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.641+0000 7f47a9cbb700 1 --2- 172.21.15.117:0/48677630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47a40bbc20 0x7f47a40bc060 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f47a40bccb0 tx=0x7f479c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3de184ea4a5f7e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:01.692 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.641+0000 7f4797fff700 1 -- 172.21.15.117:0/48677630 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c00e070 con 0x7f47a40bbc20 2023-07-19T20:45:01.692 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.641+0000 7f4797fff700 1 -- 172.21.15.117:0/48677630 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c00b9c0 con 0x7f47a40bbc20 2023-07-19T20:45:01.692 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.641+0000 7f4797fff700 1 -- 172.21.15.117:0/48677630 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c00bd70 con 0x7f47a40bbc20 2023-07-19T20:45:01.692 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.642+0000 7f47ab71e700 1 -- 172.21.15.117:0/48677630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47a40bbc20 msgr2=0x7f47a40bc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.692 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.642+0000 7f47ab71e700 1 --2- 172.21.15.117:0/48677630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47a40bbc20 0x7f47a40bc060 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f47a40bccb0 tx=0x7f479c00b330 comp rx=0 tx=0).stop 2023-07-19T20:45:01.693 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.642+0000 7f47ab71e700 1 -- 172.21.15.117:0/48677630 shutdown_connections 2023-07-19T20:45:01.693 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.642+0000 7f47ab71e700 1 --2- 172.21.15.117:0/48677630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47a40bbc20 0x7f47a40bc060 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.693 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.642+0000 7f47ab71e700 1 --2- 172.21.15.117:0/48677630 >> v2:172.21.15.124:3300/0 conn(0x7f47a40bd1d0 0x7f47a4072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.693 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.642+0000 7f47ab71e700 1 --2- 172.21.15.117:0/48677630 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f47a406d840 0x7f47a40bb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.693 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.642+0000 7f47ab71e700 1 -- 172.21.15.117:0/48677630 >> 172.21.15.117:0/48677630 conn(0x7f47a409f570 msgr2=0x7f47a409f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:01.693 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.642+0000 7f47ab71e700 1 -- 172.21.15.117:0/48677630 shutdown_connections 2023-07-19T20:45:01.693 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.642+0000 7f47ab71e700 1 -- 172.21.15.117:0/48677630 wait complete. 2023-07-19T20:45:01.693 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.643+0000 7f47ab71e700 1 Processor -- start 2023-07-19T20:45:01.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.643+0000 7f47ab71e700 1 -- start start 2023-07-19T20:45:01.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.643+0000 7f47ab71e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f47a406d840 0x7f47a40717d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.643+0000 7f47ab71e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f47a40bbc20 0x7f47a40a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.643+0000 7f47ab71e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47a40bd1d0 0x7f47a414a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.643+0000 7f47ab71e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4071d10 con 0x7f47a40bd1d0 2023-07-19T20:45:01.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.643+0000 7f47ab71e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40b3470 con 0x7f47a40bbc20 2023-07-19T20:45:01.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.643+0000 7f47ab71e700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40b2e10 con 0x7f47a406d840 2023-07-19T20:45:01.695 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47a9cbb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47a40bd1d0 0x7f47a414a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.695 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47a9cbb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47a40bd1d0 0x7f47a414a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47900/0 (socket says 172.21.15.117:47900) 2023-07-19T20:45:01.695 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47a9cbb700 1 -- 172.21.15.117:0/3316220053 learned_addr learned my addr 172.21.15.117:0/3316220053 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:01.695 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47a8cb9700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f47a40bbc20 0x7f47a40a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.695 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47a94ba700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f47a406d840 0x7f47a40717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.695 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47a9cbb700 1 -- 172.21.15.117:0/3316220053 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f47a406d840 msgr2=0x7f47a40717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.695 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47a9cbb700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f47a406d840 0x7f47a40717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.695 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47a9cbb700 1 -- 172.21.15.117:0/3316220053 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f47a40bbc20 msgr2=0x7f47a40a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.696 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47a9cbb700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f47a40bbc20 0x7f47a40a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.696 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47a9cbb700 1 -- 172.21.15.117:0/3316220053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c009b30 con 0x7f47a40bd1d0 2023-07-19T20:45:01.696 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47a94ba700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f47a406d840 0x7f47a40717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:01.696 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47a8cb9700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f47a40bbc20 0x7f47a40a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:01.696 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47a9cbb700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47a40bd1d0 0x7f47a414a120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f479c00b730 tx=0x7f479c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:01.696 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f4795ffb700 1 -- 172.21.15.117:0/3316220053 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c004250 con 0x7f47a40bd1d0 2023-07-19T20:45:01.696 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f4795ffb700 1 -- 172.21.15.117:0/3316220053 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c0043b0 con 0x7f47a40bd1d0 2023-07-19T20:45:01.697 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47ab71e700 1 -- 172.21.15.117:0/3316220053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a40b2b30 con 0x7f47a40bd1d0 2023-07-19T20:45:01.697 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f4795ffb700 1 -- 172.21.15.117:0/3316220053 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c004760 con 0x7f47a40bd1d0 2023-07-19T20:45:01.697 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.644+0000 7f47ab71e700 1 -- 172.21.15.117:0/3316220053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a40b27e0 con 0x7f47a40bd1d0 2023-07-19T20:45:01.697 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.645+0000 7f47ab71e700 1 -- 172.21.15.117:0/3316220053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a40b3600 con 0x7f47a40bd1d0 2023-07-19T20:45:01.697 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.646+0000 7f4795ffb700 1 -- 172.21.15.117:0/3316220053 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f479c01c440 con 0x7f47a40bd1d0 2023-07-19T20:45:01.697 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.646+0000 7f4795ffb700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f478806a690 0x7f478806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.697 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.646+0000 7f4795ffb700 1 -- 172.21.15.117:0/3316220053 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f479c08a010 con 0x7f47a40bd1d0 2023-07-19T20:45:01.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.646+0000 7f47a94ba700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f478806a690 0x7f478806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.646+0000 7f47a94ba700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f478806a690 0x7f478806cb40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f47a000bd40 tx=0x7f47a000b330 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:01.698 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.650+0000 7f4795ffb700 1 -- 172.21.15.117:0/3316220053 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f479c055420 con 0x7f47a40bd1d0 2023-07-19T20:45:01.830 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.835+0000 7f47ab71e700 1 -- 172.21.15.117:0/3316220053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f47a4067940 con 0x7f47a40bd1d0 2023-07-19T20:45:01.830 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.836+0000 7f4795ffb700 1 -- 172.21.15.117:0/3316220053 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f479c0200a0 con 0x7f47a40bd1d0 2023-07-19T20:45:01.830 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 8 2023-07-19T20:45:01.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.838+0000 7f47ab71e700 1 -- 172.21.15.117:0/3316220053 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f478806a690 msgr2=0x7f478806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.838+0000 7f47ab71e700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f478806a690 0x7f478806cb40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f47a000bd40 tx=0x7f47a000b330 comp rx=0 tx=0).stop 2023-07-19T20:45:01.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.838+0000 7f47ab71e700 1 -- 172.21.15.117:0/3316220053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47a40bd1d0 msgr2=0x7f47a414a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.838+0000 7f47ab71e700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47a40bd1d0 0x7f47a414a120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f479c00b730 tx=0x7f479c004ad0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.838+0000 7f47ab71e700 1 -- 172.21.15.117:0/3316220053 shutdown_connections 2023-07-19T20:45:01.840 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.838+0000 7f47ab71e700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f478806a690 0x7f478806cb40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.840 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.838+0000 7f47ab71e700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47a40bd1d0 0x7f47a414a120 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.840 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.838+0000 7f47ab71e700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f47a406d840 0x7f47a40717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.840 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.838+0000 7f47ab71e700 1 --2- 172.21.15.117:0/3316220053 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f47a40bbc20 0x7f47a40a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.841 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.838+0000 7f47ab71e700 1 -- 172.21.15.117:0/3316220053 >> 172.21.15.117:0/3316220053 conn(0x7f47a409f570 msgr2=0x7f47a40b8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:01.841 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.838+0000 7f47ab71e700 1 -- 172.21.15.117:0/3316220053 shutdown_connections 2023-07-19T20:45:01.841 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.838+0000 7f47ab71e700 1 -- 172.21.15.117:0/3316220053 wait complete. 2023-07-19T20:45:01.846 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-19T20:45:01.972 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.978+0000 7f7ba5f45700 1 Processor -- start 2023-07-19T20:45:01.973 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.979+0000 7f7ba5f45700 1 -- start start 2023-07-19T20:45:01.979 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.979+0000 7f7ba5f45700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ba00a2b60 0x7f7ba0152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.979+0000 7f7ba5f45700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7ba006a930 0x7f7ba01550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.979+0000 7f7ba5f45700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba00b8490 con 0x7f7ba006a560 2023-07-19T20:45:01.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.979+0000 7f7ba5f45700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba00bcda0 con 0x7f7ba006a930 2023-07-19T20:45:01.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.979+0000 7f7ba5f45700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00b9ab0 con 0x7f7ba00a2b60 2023-07-19T20:45:01.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.979+0000 7f7b9ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7ba006a930 0x7f7ba01550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.979+0000 7f7b9effd700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ba00a2b60 0x7f7ba0152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.979+0000 7f7b9f7fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f7ba006a560 0x7f7ba00a0970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.117:51412/0 (socket says 172.21.15.117:51412) 2023-07-19T20:45:01.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.979+0000 7f7b9effd700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ba00a2b60 0x7f7ba0152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:34254/0 (socket says 172.21.15.117:34254) 2023-07-19T20:45:01.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.979+0000 7f7b9ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7ba006a930 0x7f7ba01550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:40678/0 (socket says 172.21.15.117:40678) 2023-07-19T20:45:01.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.979+0000 7f7b9f7fe700 1 -- 172.21.15.117:0/3902655782 learned_addr learned my addr 172.21.15.117:0/3902655782 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:01.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.980+0000 7f7b9effd700 1 -- 172.21.15.117:0/3902655782 >> v2:172.21.15.124:3300/0 conn(0x7f7ba006a930 msgr2=0x7f7ba01550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:01.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.980+0000 7f7b9effd700 1 --2- 172.21.15.117:0/3902655782 >> v2:172.21.15.124:3300/0 conn(0x7f7ba006a930 0x7f7ba01550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.980+0000 7f7b9effd700 1 -- 172.21.15.117:0/3902655782 >> v1:172.21.15.124:6789/0 conn(0x7f7ba006a560 legacy=0x7f7ba00a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.980+0000 7f7b9effd700 1 -- 172.21.15.117:0/3902655782 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba00b9560 con 0x7f7ba00a2b60 2023-07-19T20:45:01.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.980+0000 7f7b9effd700 1 --2- 172.21.15.117:0/3902655782 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ba00a2b60 0x7f7ba0152ba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009840 tx=0x7f7b88009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1ff31922a2561af server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:01.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.980+0000 7f7b9e7fc700 1 -- 172.21.15.117:0/3902655782 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88011830 con 0x7f7ba00a2b60 2023-07-19T20:45:01.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.980+0000 7f7b9e7fc700 1 -- 172.21.15.117:0/3902655782 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b88011990 con 0x7f7ba00a2b60 2023-07-19T20:45:01.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.980+0000 7f7b9e7fc700 1 -- 172.21.15.117:0/3902655782 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88011d20 con 0x7f7ba00a2b60 2023-07-19T20:45:01.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.981+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3902655782 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ba00a2b60 msgr2=0x7f7ba0152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.981+0000 7f7ba5f45700 1 --2- 172.21.15.117:0/3902655782 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ba00a2b60 0x7f7ba0152ba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009840 tx=0x7f7b88009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:01.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.981+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3902655782 shutdown_connections 2023-07-19T20:45:01.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.981+0000 7f7ba5f45700 1 --2- 172.21.15.117:0/3902655782 >> v2:172.21.15.124:3300/0 conn(0x7f7ba006a930 0x7f7ba01550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.981+0000 7f7ba5f45700 1 --2- 172.21.15.117:0/3902655782 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ba00a2b60 0x7f7ba0152ba0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.981+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3902655782 >> 172.21.15.117:0/3902655782 conn(0x7f7ba009f570 msgr2=0x7f7ba009f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:01.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.981+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3902655782 shutdown_connections 2023-07-19T20:45:01.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.981+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3902655782 wait complete. 2023-07-19T20:45:01.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.982+0000 7f7ba5f45700 1 Processor -- start 2023-07-19T20:45:01.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.982+0000 7f7ba5f45700 1 -- start start 2023-07-19T20:45:01.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.982+0000 7f7ba5f45700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba006a560 0x7f7ba01e3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7ba5f45700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ba006a930 0x7f7ba006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7ba5f45700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ba00a2b60 0x7f7ba0070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7ba5f45700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba01d4d90 con 0x7f7ba006a560 2023-07-19T20:45:01.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7ba5f45700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba01e45b0 con 0x7f7ba006a930 2023-07-19T20:45:01.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7ba5f45700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba01d4460 con 0x7f7ba00a2b60 2023-07-19T20:45:01.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7b9f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba006a560 0x7f7ba01e3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7b9f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba006a560 0x7f7ba01e3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47902/0 (socket says 172.21.15.117:47902) 2023-07-19T20:45:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7b9f7fe700 1 -- 172.21.15.117:0/3236591769 learned_addr learned my addr 172.21.15.117:0/3236591769 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7b9effd700 1 --2- 172.21.15.117:0/3236591769 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ba006a930 0x7f7ba006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7b9ffff700 1 --2- 172.21.15.117:0/3236591769 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ba00a2b60 0x7f7ba0070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7b9f7fe700 1 -- 172.21.15.117:0/3236591769 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ba00a2b60 msgr2=0x7f7ba0070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7b9f7fe700 1 --2- 172.21.15.117:0/3236591769 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ba00a2b60 0x7f7ba0070400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7b9f7fe700 1 -- 172.21.15.117:0/3236591769 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ba006a930 msgr2=0x7f7ba006fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7b9f7fe700 1 --2- 172.21.15.117:0/3236591769 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ba006a930 0x7f7ba006fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7b9f7fe700 1 -- 172.21.15.117:0/3236591769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880094a0 con 0x7f7ba006a560 2023-07-19T20:45:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7b9f7fe700 1 --2- 172.21.15.117:0/3236591769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba006a560 0x7f7ba01e3700 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000c480 tx=0x7f7b9000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:01.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7b97fff700 1 -- 172.21.15.117:0/3236591769 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90005d70 con 0x7f7ba006a560 2023-07-19T20:45:01.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7b97fff700 1 -- 172.21.15.117:0/3236591769 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9000ce90 con 0x7f7ba006a560 2023-07-19T20:45:01.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3236591769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba01d4740 con 0x7f7ba006a560 2023-07-19T20:45:01.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7b97fff700 1 -- 172.21.15.117:0/3236591769 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b900072d0 con 0x7f7ba006a560 2023-07-19T20:45:01.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.983+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3236591769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba01ca5b0 con 0x7f7ba006a560 2023-07-19T20:45:01.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.984+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3236591769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba00a1af0 con 0x7f7ba006a560 2023-07-19T20:45:01.992 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.985+0000 7f7b97fff700 1 -- 172.21.15.117:0/3236591769 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f7b90007430 con 0x7f7ba006a560 2023-07-19T20:45:01.992 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.985+0000 7f7b97fff700 1 --2- 172.21.15.117:0/3236591769 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7b8006a660 0x7f7b8006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:01.992 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.985+0000 7f7b97fff700 1 -- 172.21.15.117:0/3236591769 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b90087c20 con 0x7f7ba006a560 2023-07-19T20:45:01.992 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.985+0000 7f7b9effd700 1 --2- 172.21.15.117:0/3236591769 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7b8006a660 0x7f7b8006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:01.992 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.985+0000 7f7b9effd700 1 --2- 172.21.15.117:0/3236591769 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7b8006a660 0x7f7b8006cb10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009fd0 tx=0x7f7b88008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:01.993 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:01.989+0000 7f7b97fff700 1 -- 172.21.15.117:0/3236591769 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7b9004c2c0 con 0x7f7ba006a560 2023-07-19T20:45:02.169 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.174+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3236591769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ba0067940 con 0x7f7ba006a560 2023-07-19T20:45:02.169 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.174+0000 7f7b97fff700 1 -- 172.21.15.117:0/3236591769 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b90053160 con 0x7f7ba006a560 2023-07-19T20:45:02.170 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2023-07-19T20:45:02.171 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.176+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3236591769 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7b8006a660 msgr2=0x7f7b8006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.171 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.176+0000 7f7ba5f45700 1 --2- 172.21.15.117:0/3236591769 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7b8006a660 0x7f7b8006cb10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009fd0 tx=0x7f7b88008030 comp rx=0 tx=0).stop 2023-07-19T20:45:02.171 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.176+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3236591769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba006a560 msgr2=0x7f7ba01e3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.171 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.176+0000 7f7ba5f45700 1 --2- 172.21.15.117:0/3236591769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba006a560 0x7f7ba01e3700 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000c480 tx=0x7f7b9000c790 comp rx=0 tx=0).stop 2023-07-19T20:45:02.171 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.176+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3236591769 shutdown_connections 2023-07-19T20:45:02.172 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.176+0000 7f7ba5f45700 1 --2- 172.21.15.117:0/3236591769 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7b8006a660 0x7f7b8006cb10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.172 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.176+0000 7f7ba5f45700 1 --2- 172.21.15.117:0/3236591769 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ba00a2b60 0x7f7ba0070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.172 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.176+0000 7f7ba5f45700 1 --2- 172.21.15.117:0/3236591769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ba006a560 0x7f7ba01e3700 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.172 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.176+0000 7f7ba5f45700 1 --2- 172.21.15.117:0/3236591769 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ba006a930 0x7f7ba006fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.172 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.176+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3236591769 >> 172.21.15.117:0/3236591769 conn(0x7f7ba009f570 msgr2=0x7f7ba009eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:02.172 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.176+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3236591769 shutdown_connections 2023-07-19T20:45:02.172 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.176+0000 7f7ba5f45700 1 -- 172.21.15.117:0/3236591769 wait complete. 2023-07-19T20:45:02.182 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-19T20:45:02.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.313+0000 7f4078160700 1 Processor -- start 2023-07-19T20:45:02.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.313+0000 7f4078160700 1 -- start start 2023-07-19T20:45:02.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.313+0000 7f4078160700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4070144b60 0x7f407006c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4078160700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f407014ae50 0x7f407014b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4078160700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407014b7b0 con 0x7f40700b9800 2023-07-19T20:45:02.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4078160700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4070144f30 con 0x7f407014ae50 2023-07-19T20:45:02.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4078160700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407006ee80 con 0x7f4070144b60 2023-07-19T20:45:02.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f40756fb700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f40700b9800 0x7f407006e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:34364/0 (socket says 172.21.15.117:34364) 2023-07-19T20:45:02.309 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f40756fb700 1 -- 172.21.15.117:0/2837298417 learned_addr learned my addr 172.21.15.117:0/2837298417 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:02.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f40766fd700 1 --2- 172.21.15.117:0/2837298417 >> v2:172.21.15.124:3300/0 conn(0x7f407014ae50 0x7f407014b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4075efc700 1 --2- 172.21.15.117:0/2837298417 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4070144b60 0x7f407006c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4074efa700 1 -- 172.21.15.117:0/2837298417 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261541458 0 0) 0x7f407014b7b0 con 0x7f40700b9800 2023-07-19T20:45:02.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4074efa700 1 -- 172.21.15.117:0/2837298417 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f405c0035b0 con 0x7f40700b9800 2023-07-19T20:45:02.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4075efc700 1 -- 172.21.15.117:0/2837298417 >> v2:172.21.15.124:3300/0 conn(0x7f407014ae50 msgr2=0x7f407014b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:02.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4075efc700 1 --2- 172.21.15.117:0/2837298417 >> v2:172.21.15.124:3300/0 conn(0x7f407014ae50 0x7f407014b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.310 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4075efc700 1 -- 172.21.15.117:0/2837298417 >> v1:172.21.15.117:6789/0 conn(0x7f40700b9800 legacy=0x7f407006e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4074efa700 1 -- 172.21.15.117:0/2837298417 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 274610115 0 0) 0x7f405c0035b0 con 0x7f40700b9800 2023-07-19T20:45:02.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4075efc700 1 -- 172.21.15.117:0/2837298417 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407006cb80 con 0x7f4070144b60 2023-07-19T20:45:02.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4075efc700 1 --2- 172.21.15.117:0/2837298417 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4070144b60 0x7f407006c580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f406c009840 tx=0x7f406c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1bd0c0e9dd4b1ca server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:02.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4074efa700 1 -- 172.21.15.117:0/2837298417 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060001670 con 0x7f4070144b60 2023-07-19T20:45:02.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4074efa700 1 -- 172.21.15.117:0/2837298417 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c004030 con 0x7f4070144b60 2023-07-19T20:45:02.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.314+0000 7f4074efa700 1 -- 172.21.15.117:0/2837298417 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c0043c0 con 0x7f4070144b60 2023-07-19T20:45:02.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.315+0000 7f4078160700 1 -- 172.21.15.117:0/2837298417 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4070144b60 msgr2=0x7f407006c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.315+0000 7f4078160700 1 --2- 172.21.15.117:0/2837298417 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4070144b60 0x7f407006c580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f406c009840 tx=0x7f406c009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:02.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.315+0000 7f4078160700 1 -- 172.21.15.117:0/2837298417 shutdown_connections 2023-07-19T20:45:02.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.315+0000 7f4078160700 1 --2- 172.21.15.117:0/2837298417 >> v2:172.21.15.124:3300/0 conn(0x7f407014ae50 0x7f407014b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.315+0000 7f4078160700 1 --2- 172.21.15.117:0/2837298417 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4070144b60 0x7f407006c580 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.315+0000 7f4078160700 1 -- 172.21.15.117:0/2837298417 >> 172.21.15.117:0/2837298417 conn(0x7f40700be9c0 msgr2=0x7f40700bed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:02.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.315+0000 7f4078160700 1 -- 172.21.15.117:0/2837298417 shutdown_connections 2023-07-19T20:45:02.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.315+0000 7f4078160700 1 -- 172.21.15.117:0/2837298417 wait complete. 2023-07-19T20:45:02.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.316+0000 7f4078160700 1 Processor -- start 2023-07-19T20:45:02.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.316+0000 7f4078160700 1 -- start start 2023-07-19T20:45:02.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f4078160700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40700b9800 0x7f4070141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f4078160700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4070144b60 0x7f40701d1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.316 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f4078160700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f407014ae50 0x7f40700b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.316 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f4078160700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4070141890 con 0x7f407014ae50 2023-07-19T20:45:02.316 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f4078160700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407014a500 con 0x7f40700b9800 2023-07-19T20:45:02.316 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f4078160700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40701d16c0 con 0x7f4070144b60 2023-07-19T20:45:02.316 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f40766fd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f407014ae50 0x7f40700b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.316 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f40766fd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f407014ae50 0x7f40700b7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51632/0 (socket says 172.21.15.117:51632) 2023-07-19T20:45:02.316 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f40766fd700 1 -- 172.21.15.117:0/2114604645 learned_addr learned my addr 172.21.15.117:0/2114604645 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:02.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f4075efc700 1 --2- 172.21.15.117:0/2114604645 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40700b9800 0x7f4070141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f40756fb700 1 --2- 172.21.15.117:0/2114604645 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4070144b60 0x7f40701d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f40766fd700 1 -- 172.21.15.117:0/2114604645 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4070144b60 msgr2=0x7f40701d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f40766fd700 1 --2- 172.21.15.117:0/2114604645 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4070144b60 0x7f40701d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f40766fd700 1 -- 172.21.15.117:0/2114604645 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40700b9800 msgr2=0x7f4070141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f40766fd700 1 --2- 172.21.15.117:0/2114604645 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40700b9800 0x7f4070141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f40766fd700 1 -- 172.21.15.117:0/2114604645 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c0094a0 con 0x7f407014ae50 2023-07-19T20:45:02.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f40766fd700 1 --2- 172.21.15.117:0/2114604645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f407014ae50 0x7f40700b7480 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f406800efc0 tx=0x7f406800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:02.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f40667fc700 1 -- 172.21.15.117:0/2114604645 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406800ca70 con 0x7f407014ae50 2023-07-19T20:45:02.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f40667fc700 1 -- 172.21.15.117:0/2114604645 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406800f040 con 0x7f407014ae50 2023-07-19T20:45:02.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f4078160700 1 -- 172.21.15.117:0/2114604645 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40700b6fc0 con 0x7f407014ae50 2023-07-19T20:45:02.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.317+0000 7f40667fc700 1 -- 172.21.15.117:0/2114604645 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406800ce10 con 0x7f407014ae50 2023-07-19T20:45:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.318+0000 7f4078160700 1 -- 172.21.15.117:0/2114604645 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407013fce0 con 0x7f407014ae50 2023-07-19T20:45:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.318+0000 7f4078160700 1 -- 172.21.15.117:0/2114604645 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407014a8f0 con 0x7f407014ae50 2023-07-19T20:45:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.319+0000 7f40667fc700 1 -- 172.21.15.117:0/2114604645 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f4068014480 con 0x7f407014ae50 2023-07-19T20:45:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.319+0000 7f40667fc700 1 --2- 172.21.15.117:0/2114604645 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f405406a660 0x7f405406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.319+0000 7f40667fc700 1 -- 172.21.15.117:0/2114604645 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40680891f0 con 0x7f407014ae50 2023-07-19T20:45:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.319+0000 7f4075efc700 1 --2- 172.21.15.117:0/2114604645 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f405406a660 0x7f405406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.320+0000 7f4075efc700 1 --2- 172.21.15.117:0/2114604645 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f405406a660 0x7f405406cb10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f406c0090b0 tx=0x7f406c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:02.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.324+0000 7f40667fc700 1 -- 172.21.15.117:0/2114604645 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f4068054600 con 0x7f407014ae50 2023-07-19T20:45:02.499 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.505+0000 7f4078160700 1 -- 172.21.15.117:0/2114604645 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40700b7150 con 0x7f407014ae50 2023-07-19T20:45:02.500 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.506+0000 7f40667fc700 1 -- 172.21.15.117:0/2114604645 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4068057c20 con 0x7f407014ae50 2023-07-19T20:45:02.500 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2023-07-19T20:45:02.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.508+0000 7f4078160700 1 -- 172.21.15.117:0/2114604645 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f405406a660 msgr2=0x7f405406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.502 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.508+0000 7f4078160700 1 --2- 172.21.15.117:0/2114604645 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f405406a660 0x7f405406cb10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f406c0090b0 tx=0x7f406c008030 comp rx=0 tx=0).stop 2023-07-19T20:45:02.503 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.508+0000 7f4078160700 1 -- 172.21.15.117:0/2114604645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f407014ae50 msgr2=0x7f40700b7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.503 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.508+0000 7f4078160700 1 --2- 172.21.15.117:0/2114604645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f407014ae50 0x7f40700b7480 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f406800efc0 tx=0x7f406800c0c0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.503 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.508+0000 7f4078160700 1 -- 172.21.15.117:0/2114604645 shutdown_connections 2023-07-19T20:45:02.504 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.508+0000 7f4078160700 1 --2- 172.21.15.117:0/2114604645 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f405406a660 0x7f405406cb10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.504 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.508+0000 7f4078160700 1 --2- 172.21.15.117:0/2114604645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f407014ae50 0x7f40700b7480 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.504 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.508+0000 7f4078160700 1 --2- 172.21.15.117:0/2114604645 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40700b9800 0x7f4070141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.508+0000 7f4078160700 1 --2- 172.21.15.117:0/2114604645 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4070144b60 0x7f40701d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.508+0000 7f4078160700 1 -- 172.21.15.117:0/2114604645 >> 172.21.15.117:0/2114604645 conn(0x7f40700be9c0 msgr2=0x7f4070071b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:02.505 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.508+0000 7f4078160700 1 -- 172.21.15.117:0/2114604645 shutdown_connections 2023-07-19T20:45:02.506 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.508+0000 7f4078160700 1 -- 172.21.15.117:0/2114604645 wait complete. 2023-07-19T20:45:02.513 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-19T20:45:02.640 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.646+0000 7f627b2a8700 1 Processor -- start 2023-07-19T20:45:02.640 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.646+0000 7f627b2a8700 1 -- start start 2023-07-19T20:45:02.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f627b2a8700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62740baa60 0x7f62740b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f627b2a8700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f62740bca00 0x7f62740bd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f627b2a8700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f627414ddd0 0x7f6274144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f627b2a8700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62740bdf10 con 0x7f62740bca00 2023-07-19T20:45:02.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f627b2a8700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62740bd540 con 0x7f627414ddd0 2023-07-19T20:45:02.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f627b2a8700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62740b8d70 con 0x7f62740baa60 2023-07-19T20:45:02.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f6278843700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f62740bca00 0x7f62740bd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f6278843700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f62740bca00 0x7f62740bd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51634/0 (socket says 172.21.15.117:51634) 2023-07-19T20:45:02.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f6278843700 1 -- 172.21.15.117:0/1593036031 learned_addr learned my addr 172.21.15.117:0/1593036031 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:02.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f6279845700 1 --2- 172.21.15.117:0/1593036031 >> v2:172.21.15.124:3300/0 conn(0x7f627414ddd0 0x7f6274144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f6278843700 1 -- 172.21.15.117:0/1593036031 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62740baa60 msgr2=0x7f62740b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:02.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f6279044700 1 --2- 172.21.15.117:0/1593036031 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62740baa60 0x7f62740b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f6278843700 1 --2- 172.21.15.117:0/1593036031 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62740baa60 0x7f62740b7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f6278843700 1 -- 172.21.15.117:0/1593036031 >> v2:172.21.15.124:3300/0 conn(0x7f627414ddd0 msgr2=0x7f6274144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:02.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f6278843700 1 --2- 172.21.15.117:0/1593036031 >> v2:172.21.15.124:3300/0 conn(0x7f627414ddd0 0x7f6274144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f6278843700 1 -- 172.21.15.117:0/1593036031 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62740b8fe0 con 0x7f62740bca00 2023-07-19T20:45:02.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f6279845700 1 --2- 172.21.15.117:0/1593036031 >> v2:172.21.15.124:3300/0 conn(0x7f627414ddd0 0x7f6274144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:02.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f6278843700 1 --2- 172.21.15.117:0/1593036031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62740bca00 0x7f62740bd9d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f627408b240 tx=0x7f6270009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb61d6451b1bd5d server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:02.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f626bfff700 1 -- 172.21.15.117:0/1593036031 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627000b870 con 0x7f62740bca00 2023-07-19T20:45:02.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f626bfff700 1 -- 172.21.15.117:0/1593036031 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627000b9d0 con 0x7f62740bca00 2023-07-19T20:45:02.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.647+0000 7f626bfff700 1 -- 172.21.15.117:0/1593036031 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627000bd60 con 0x7f62740bca00 2023-07-19T20:45:02.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.648+0000 7f627b2a8700 1 -- 172.21.15.117:0/1593036031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62740bca00 msgr2=0x7f62740bd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.648+0000 7f627b2a8700 1 --2- 172.21.15.117:0/1593036031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62740bca00 0x7f62740bd9d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f627408b240 tx=0x7f6270009bd0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.648+0000 7f627b2a8700 1 -- 172.21.15.117:0/1593036031 shutdown_connections 2023-07-19T20:45:02.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.648+0000 7f627b2a8700 1 --2- 172.21.15.117:0/1593036031 >> v2:172.21.15.124:3300/0 conn(0x7f627414ddd0 0x7f6274144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.648+0000 7f627b2a8700 1 --2- 172.21.15.117:0/1593036031 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62740baa60 0x7f62740b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.648+0000 7f627b2a8700 1 --2- 172.21.15.117:0/1593036031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62740bca00 0x7f62740bd9d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.648+0000 7f627b2a8700 1 -- 172.21.15.117:0/1593036031 >> 172.21.15.117:0/1593036031 conn(0x7f6274071c90 msgr2=0x7f6274072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:02.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.648+0000 7f627b2a8700 1 -- 172.21.15.117:0/1593036031 shutdown_connections 2023-07-19T20:45:02.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.648+0000 7f627b2a8700 1 -- 172.21.15.117:0/1593036031 wait complete. 2023-07-19T20:45:02.648 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.649+0000 7f627b2a8700 1 Processor -- start 2023-07-19T20:45:02.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.649+0000 7f627b2a8700 1 -- start start 2023-07-19T20:45:02.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f627b2a8700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62740baa60 0x7f62741d4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f627b2a8700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62740bca00 0x7f6274147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f627b2a8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627414ddd0 0x7f62741459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.650 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f627b2a8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62740c1770 con 0x7f627414ddd0 2023-07-19T20:45:02.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f627b2a8700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62741d4840 con 0x7f62740bca00 2023-07-19T20:45:02.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f627b2a8700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62740c0e10 con 0x7f62740baa60 2023-07-19T20:45:02.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6279845700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627414ddd0 0x7f62741459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6279845700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627414ddd0 0x7f62741459e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51644/0 (socket says 172.21.15.117:51644) 2023-07-19T20:45:02.655 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6279845700 1 -- 172.21.15.117:0/4114575927 learned_addr learned my addr 172.21.15.117:0/4114575927 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:02.655 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6278843700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62740bca00 0x7f6274147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.655 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6279044700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62740baa60 0x7f62741d4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6279845700 1 -- 172.21.15.117:0/4114575927 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62740baa60 msgr2=0x7f62741d4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6279845700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62740baa60 0x7f62741d4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6279845700 1 -- 172.21.15.117:0/4114575927 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62740bca00 msgr2=0x7f6274147a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6279845700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62740bca00 0x7f6274147a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6279845700 1 -- 172.21.15.117:0/4114575927 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270009550 con 0x7f627414ddd0 2023-07-19T20:45:02.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6278843700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62740bca00 0x7f6274147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:02.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6279845700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627414ddd0 0x7f62741459e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f626c00cef0 tx=0x7f626c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:02.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6269ffb700 1 -- 172.21.15.117:0/4114575927 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00ae50 con 0x7f627414ddd0 2023-07-19T20:45:02.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6269ffb700 1 -- 172.21.15.117:0/4114575927 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c015440 con 0x7f627414ddd0 2023-07-19T20:45:02.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f6269ffb700 1 -- 172.21.15.117:0/4114575927 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c0157f0 con 0x7f627414ddd0 2023-07-19T20:45:02.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f627b2a8700 1 -- 172.21.15.117:0/4114575927 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62740c10b0 con 0x7f627414ddd0 2023-07-19T20:45:02.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.650+0000 7f627b2a8700 1 -- 172.21.15.117:0/4114575927 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62741450b0 con 0x7f627414ddd0 2023-07-19T20:45:02.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.651+0000 7f627b2a8700 1 -- 172.21.15.117:0/4114575927 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62740b9800 con 0x7f627414ddd0 2023-07-19T20:45:02.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.652+0000 7f6269ffb700 1 -- 172.21.15.117:0/4114575927 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f626c00d430 con 0x7f627414ddd0 2023-07-19T20:45:02.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.652+0000 7f6269ffb700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f625806a660 0x7f625806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.658 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.652+0000 7f6279044700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f625806a660 0x7f625806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.658 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.652+0000 7f6269ffb700 1 -- 172.21.15.117:0/4114575927 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f626c088fe0 con 0x7f627414ddd0 2023-07-19T20:45:02.658 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.652+0000 7f6279044700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f625806a660 0x7f625806cb10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f626400a950 tx=0x7f6264008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:02.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.656+0000 7f6269ffb700 1 -- 172.21.15.117:0/4114575927 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f626c054470 con 0x7f627414ddd0 2023-07-19T20:45:02.836 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.842+0000 7f627b2a8700 1 -- 172.21.15.117:0/4114575927 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6274074890 con 0x7f627414ddd0 2023-07-19T20:45:02.836 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.843+0000 7f6269ffb700 1 -- 172.21.15.117:0/4114575927 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f626c01a0a0 con 0x7f627414ddd0 2023-07-19T20:45:02.837 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 64 2023-07-19T20:45:02.838 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.845+0000 7f627b2a8700 1 -- 172.21.15.117:0/4114575927 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f625806a660 msgr2=0x7f625806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.845+0000 7f627b2a8700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f625806a660 0x7f625806cb10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f626400a950 tx=0x7f6264008040 comp rx=0 tx=0).stop 2023-07-19T20:45:02.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.845+0000 7f627b2a8700 1 -- 172.21.15.117:0/4114575927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627414ddd0 msgr2=0x7f62741459e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.845+0000 7f627b2a8700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627414ddd0 0x7f62741459e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f626c00cef0 tx=0x7f626c00a340 comp rx=0 tx=0).stop 2023-07-19T20:45:02.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.845+0000 7f627b2a8700 1 -- 172.21.15.117:0/4114575927 shutdown_connections 2023-07-19T20:45:02.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.845+0000 7f627b2a8700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f625806a660 0x7f625806cb10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.845+0000 7f627b2a8700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f627414ddd0 0x7f62741459e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.845+0000 7f627b2a8700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62740baa60 0x7f62741d4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.840 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.845+0000 7f627b2a8700 1 --2- 172.21.15.117:0/4114575927 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62740bca00 0x7f6274147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.840 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.845+0000 7f627b2a8700 1 -- 172.21.15.117:0/4114575927 >> 172.21.15.117:0/4114575927 conn(0x7f6274071c90 msgr2=0x7f627414bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:02.840 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.845+0000 7f627b2a8700 1 -- 172.21.15.117:0/4114575927 shutdown_connections 2023-07-19T20:45:02.840 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.845+0000 7f627b2a8700 1 -- 172.21.15.117:0/4114575927 wait complete. 2023-07-19T20:45:02.850 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:45:02.978 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.977+0000 7ff89b1d5700 1 Processor -- start 2023-07-19T20:45:02.978 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.977+0000 7ff89b1d5700 1 -- start start 2023-07-19T20:45:02.979 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.978+0000 7ff89b1d5700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff8940c1470 0x7ff8940b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.979 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.978+0000 7ff89b1d5700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8940b9370 0x7ff894149f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.979 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.978+0000 7ff89b1d5700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8940bcd00 con 0x7ff89414a490 2023-07-19T20:45:02.979 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.978+0000 7ff89b1d5700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8940b8710 con 0x7ff8940c1470 2023-07-19T20:45:02.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.978+0000 7ff89b1d5700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940b8bd0 con 0x7ff8940b9370 2023-07-19T20:45:02.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.978+0000 7ff898f71700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff8940c1470 0x7ff8940b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.978+0000 7ff893fff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8940b9370 0x7ff894149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.978+0000 7ff899772700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff89414a490 0x7ff89414df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.117:39102/0 (socket says 172.21.15.117:39102) 2023-07-19T20:45:02.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.978+0000 7ff899772700 1 -- 172.21.15.117:0/2490505659 learned_addr learned my addr 172.21.15.117:0/2490505659 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:02.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.979+0000 7ff898f71700 1 -- 172.21.15.117:0/2490505659 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8940b9370 msgr2=0x7ff894149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:02.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.979+0000 7ff898f71700 1 --2- 172.21.15.117:0/2490505659 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8940b9370 0x7ff894149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.979+0000 7ff898f71700 1 -- 172.21.15.117:0/2490505659 >> v1:172.21.15.124:6789/0 conn(0x7ff89414a490 legacy=0x7ff89414df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.979+0000 7ff898f71700 1 -- 172.21.15.117:0/2490505659 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8940bab50 con 0x7ff8940c1470 2023-07-19T20:45:02.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.979+0000 7ff893fff700 1 --2- 172.21.15.117:0/2490505659 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8940b9370 0x7ff894149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:45:02.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.979+0000 7ff898f71700 1 --2- 172.21.15.117:0/2490505659 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8940c1470 0x7ff8940b8e30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff888009840 tx=0x7ff888009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3df9280669be6ef server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:02.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.979+0000 7ff8937fe700 1 -- 172.21.15.117:0/2490505659 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888011830 con 0x7ff8940c1470 2023-07-19T20:45:02.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.979+0000 7ff8937fe700 1 -- 172.21.15.117:0/2490505659 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff888011990 con 0x7ff8940c1470 2023-07-19T20:45:02.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.979+0000 7ff8937fe700 1 -- 172.21.15.117:0/2490505659 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888011d20 con 0x7ff8940c1470 2023-07-19T20:45:02.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.979+0000 7ff89b1d5700 1 -- 172.21.15.117:0/2490505659 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8940c1470 msgr2=0x7ff8940b8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.979+0000 7ff89b1d5700 1 --2- 172.21.15.117:0/2490505659 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8940c1470 0x7ff8940b8e30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff888009840 tx=0x7ff888009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:02.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.980+0000 7ff89b1d5700 1 -- 172.21.15.117:0/2490505659 shutdown_connections 2023-07-19T20:45:02.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.980+0000 7ff89b1d5700 1 --2- 172.21.15.117:0/2490505659 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8940c1470 0x7ff8940b8e30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.980+0000 7ff89b1d5700 1 --2- 172.21.15.117:0/2490505659 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8940b9370 0x7ff894149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.980+0000 7ff89b1d5700 1 -- 172.21.15.117:0/2490505659 >> 172.21.15.117:0/2490505659 conn(0x7ff894072920 msgr2=0x7ff8940c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:02.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.980+0000 7ff89b1d5700 1 -- 172.21.15.117:0/2490505659 shutdown_connections 2023-07-19T20:45:02.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.980+0000 7ff89b1d5700 1 -- 172.21.15.117:0/2490505659 wait complete. 2023-07-19T20:45:02.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.981+0000 7ff89b1d5700 1 Processor -- start 2023-07-19T20:45:02.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.981+0000 7ff89b1d5700 1 -- start start 2023-07-19T20:45:02.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.981+0000 7ff89b1d5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8940b9370 0x7ff8941d76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.981+0000 7ff89b1d5700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8940c1470 0x7ff894143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.981+0000 7ff89b1d5700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff89414a490 0x7ff894140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.981+0000 7ff89b1d5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff894142240 con 0x7ff8940b9370 2023-07-19T20:45:02.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.981+0000 7ff89b1d5700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940b4fe0 con 0x7ff89414a490 2023-07-19T20:45:02.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.981+0000 7ff89b1d5700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940b6860 con 0x7ff8940c1470 2023-07-19T20:45:02.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.981+0000 7ff898f71700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8940b9370 0x7ff8941d76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff898f71700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8940b9370 0x7ff8941d76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51646/0 (socket says 172.21.15.117:51646) 2023-07-19T20:45:02.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff898f71700 1 -- 172.21.15.117:0/780860756 learned_addr learned my addr 172.21.15.117:0/780860756 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:02.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff899772700 1 --2- 172.21.15.117:0/780860756 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff89414a490 0x7ff894140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff893fff700 1 --2- 172.21.15.117:0/780860756 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8940c1470 0x7ff894143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff898f71700 1 -- 172.21.15.117:0/780860756 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8940c1470 msgr2=0x7ff894143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff898f71700 1 --2- 172.21.15.117:0/780860756 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8940c1470 0x7ff894143a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff898f71700 1 -- 172.21.15.117:0/780860756 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff89414a490 msgr2=0x7ff894140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:02.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff898f71700 1 --2- 172.21.15.117:0/780860756 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff89414a490 0x7ff894140d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:02.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff898f71700 1 -- 172.21.15.117:0/780860756 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8800094a0 con 0x7ff8940b9370 2023-07-19T20:45:02.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff898f71700 1 --2- 172.21.15.117:0/780860756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8940b9370 0x7ff8941d76f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff8880090b0 tx=0x7ff888004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:02.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff8917fa700 1 -- 172.21.15.117:0/780860756 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880036a0 con 0x7ff8940b9370 2023-07-19T20:45:02.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff8917fa700 1 -- 172.21.15.117:0/780860756 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88801f070 con 0x7ff8940b9370 2023-07-19T20:45:02.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff8917fa700 1 -- 172.21.15.117:0/780860756 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888003a60 con 0x7ff8940b9370 2023-07-19T20:45:02.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff89b1d5700 1 -- 172.21.15.117:0/780860756 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8880094a0 con 0x7ff8940b9370 2023-07-19T20:45:02.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.982+0000 7ff89b1d5700 1 -- 172.21.15.117:0/780860756 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8940b6610 con 0x7ff8940b9370 2023-07-19T20:45:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.983+0000 7ff89b1d5700 1 -- 172.21.15.117:0/780860756 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff894142380 con 0x7ff8940b9370 2023-07-19T20:45:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.984+0000 7ff8917fa700 1 -- 172.21.15.117:0/780860756 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7ff888003bc0 con 0x7ff8940b9370 2023-07-19T20:45:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.984+0000 7ff8917fa700 1 --2- 172.21.15.117:0/780860756 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff87806a690 0x7ff87806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.984+0000 7ff8917fa700 1 -- 172.21.15.117:0/780860756 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff888021070 con 0x7ff8940b9370 2023-07-19T20:45:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.984+0000 7ff893fff700 1 --2- 172.21.15.117:0/780860756 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff87806a690 0x7ff87806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.984+0000 7ff893fff700 1 --2- 172.21.15.117:0/780860756 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff87806a690 0x7ff87806cb40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff8941d8030 tx=0x7ff880008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:02.988+0000 7ff8917fa700 1 -- 172.21.15.117:0/780860756 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff888055910 con 0x7ff8940b9370 2023-07-19T20:45:03.169 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.176+0000 7ff89b1d5700 1 -- 172.21.15.117:0/780860756 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8941437c0 con 0x7ff8940b9370 2023-07-19T20:45:03.170 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.177+0000 7ff8917fa700 1 -- 172.21.15.117:0/780860756 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17897 (secure 0 0 0) 0x7ff888058f30 con 0x7ff8940b9370 2023-07-19T20:45:03.171 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:03.171 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:39.549566+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:45:03.173 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.179+0000 7ff89b1d5700 1 -- 172.21.15.117:0/780860756 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff87806a690 msgr2=0x7ff87806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.173 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.179+0000 7ff89b1d5700 1 --2- 172.21.15.117:0/780860756 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff87806a690 0x7ff87806cb40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff8941d8030 tx=0x7ff880008040 comp rx=0 tx=0).stop 2023-07-19T20:45:03.173 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.179+0000 7ff89b1d5700 1 -- 172.21.15.117:0/780860756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8940b9370 msgr2=0x7ff8941d76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.173 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.179+0000 7ff89b1d5700 1 --2- 172.21.15.117:0/780860756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8940b9370 0x7ff8941d76f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff8880090b0 tx=0x7ff888004750 comp rx=0 tx=0).stop 2023-07-19T20:45:03.173 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.179+0000 7ff89b1d5700 1 -- 172.21.15.117:0/780860756 shutdown_connections 2023-07-19T20:45:03.174 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.179+0000 7ff89b1d5700 1 --2- 172.21.15.117:0/780860756 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff87806a690 0x7ff87806cb40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.174 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.179+0000 7ff89b1d5700 1 --2- 172.21.15.117:0/780860756 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff89414a490 0x7ff894140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.174 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.179+0000 7ff89b1d5700 1 --2- 172.21.15.117:0/780860756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8940b9370 0x7ff8941d76f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.174 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.179+0000 7ff89b1d5700 1 --2- 172.21.15.117:0/780860756 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8940c1470 0x7ff894143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.174 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.179+0000 7ff89b1d5700 1 -- 172.21.15.117:0/780860756 >> 172.21.15.117:0/780860756 conn(0x7ff894072920 msgr2=0x7ff8940befe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:03.174 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.179+0000 7ff89b1d5700 1 -- 172.21.15.117:0/780860756 shutdown_connections 2023-07-19T20:45:03.174 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.179+0000 7ff89b1d5700 1 -- 172.21.15.117:0/780860756 wait complete. 2023-07-19T20:45:03.185 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-19T20:44:31.325778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-19T20:44:31.728215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-19T20:44:36.280405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-19T20:44:37.509195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-19T20:45:03.185 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-19T20:45:03.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.316+0000 7fba073ca700 1 Processor -- start 2023-07-19T20:45:03.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.317+0000 7fba073ca700 1 -- start start 2023-07-19T20:45:03.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.317+0000 7fba073ca700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fba0006b7e0 0x7fba0006c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.317+0000 7fba073ca700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba00147720 con 0x7fba001482c0 2023-07-19T20:45:03.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.317+0000 7fba073ca700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba000b91a0 con 0x7fba00141610 2023-07-19T20:45:03.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.317+0000 7fba073ca700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba000b3920 con 0x7fba0006b7e0 2023-07-19T20:45:03.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.317+0000 7fba05166700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fba0006b7e0 0x7fba0006c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.318+0000 7fba05166700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fba0006b7e0 0x7fba0006c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51648/0 (socket says 172.21.15.117:51648) 2023-07-19T20:45:03.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.318+0000 7fba05166700 1 -- 172.21.15.117:0/1631691456 learned_addr learned my addr 172.21.15.117:0/1631691456 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:03.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.318+0000 7fba05967700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fba001482c0 0x7fba00151f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:34368/0 (socket says 172.21.15.117:34368) 2023-07-19T20:45:03.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.318+0000 7fba05166700 1 -- 172.21.15.117:0/1631691456 >> v1:172.21.15.124:6789/0 conn(0x7fba00141610 legacy=0x7fba00147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.316 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.318+0000 7fba05166700 1 -- 172.21.15.117:0/1631691456 >> v1:172.21.15.117:6789/0 conn(0x7fba001482c0 legacy=0x7fba00151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.316 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.318+0000 7fba05166700 1 -- 172.21.15.117:0/1631691456 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba000b9480 con 0x7fba0006b7e0 2023-07-19T20:45:03.316 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.318+0000 7fb9f7fff700 1 -- 172.21.15.117:0/1631691456 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272979108 0 0) 0x7fba00147720 con 0x7fba001482c0 2023-07-19T20:45:03.316 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.318+0000 7fba05166700 1 --2- 172.21.15.117:0/1631691456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba0006b7e0 0x7fba0006c790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0098f0 tx=0x7fb9fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7666787ca980329 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:03.316 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.318+0000 7fb9f7fff700 1 -- 172.21.15.117:0/1631691456 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00b8a0 con 0x7fba0006b7e0 2023-07-19T20:45:03.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.318+0000 7fb9f7fff700 1 -- 172.21.15.117:0/1631691456 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc00ba00 con 0x7fba0006b7e0 2023-07-19T20:45:03.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.318+0000 7fb9f7fff700 1 -- 172.21.15.117:0/1631691456 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00bd90 con 0x7fba0006b7e0 2023-07-19T20:45:03.317 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.319+0000 7fba073ca700 1 -- 172.21.15.117:0/1631691456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba0006b7e0 msgr2=0x7fba0006c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.319+0000 7fba073ca700 1 --2- 172.21.15.117:0/1631691456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba0006b7e0 0x7fba0006c790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0098f0 tx=0x7fb9fc009c00 comp rx=0 tx=0).stop 2023-07-19T20:45:03.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.319+0000 7fba073ca700 1 -- 172.21.15.117:0/1631691456 shutdown_connections 2023-07-19T20:45:03.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.319+0000 7fba073ca700 1 --2- 172.21.15.117:0/1631691456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba0006b7e0 0x7fba0006c790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.318 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.319+0000 7fba073ca700 1 -- 172.21.15.117:0/1631691456 >> 172.21.15.117:0/1631691456 conn(0x7fba000bdc50 msgr2=0x7fba0006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:03.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.319+0000 7fba073ca700 1 -- 172.21.15.117:0/1631691456 shutdown_connections 2023-07-19T20:45:03.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.319+0000 7fba073ca700 1 -- 172.21.15.117:0/1631691456 wait complete. 2023-07-19T20:45:03.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.320+0000 7fba073ca700 1 Processor -- start 2023-07-19T20:45:03.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.320+0000 7fba073ca700 1 -- start start 2023-07-19T20:45:03.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.320+0000 7fba073ca700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba0006b7e0 0x7fba00071980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.320+0000 7fba073ca700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fba00141610 0x7fba000b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.320+0000 7fba073ca700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fba001482c0 0x7fba000b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.320+0000 7fba073ca700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba00071ec0 con 0x7fba0006b7e0 2023-07-19T20:45:03.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.320+0000 7fba073ca700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba000b4560 con 0x7fba00141610 2023-07-19T20:45:03.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.320+0000 7fba073ca700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba000b5fd0 con 0x7fba001482c0 2023-07-19T20:45:03.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fba05166700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba0006b7e0 0x7fba00071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fba05166700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba0006b7e0 0x7fba00071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51652/0 (socket says 172.21.15.117:51652) 2023-07-19T20:45:03.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fba05166700 1 -- 172.21.15.117:0/1670118784 learned_addr learned my addr 172.21.15.117:0/1670118784 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:03.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fba04965700 1 --2- 172.21.15.117:0/1670118784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fba00141610 0x7fba000b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fba05967700 1 --2- 172.21.15.117:0/1670118784 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fba001482c0 0x7fba000b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fba05166700 1 -- 172.21.15.117:0/1670118784 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fba001482c0 msgr2=0x7fba000b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fba05166700 1 --2- 172.21.15.117:0/1670118784 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fba001482c0 0x7fba000b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fba05166700 1 -- 172.21.15.117:0/1670118784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fba00141610 msgr2=0x7fba000b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fba05166700 1 --2- 172.21.15.117:0/1670118784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fba00141610 0x7fba000b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fba05166700 1 -- 172.21.15.117:0/1670118784 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc009550 con 0x7fba0006b7e0 2023-07-19T20:45:03.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fba05166700 1 --2- 172.21.15.117:0/1670118784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba0006b7e0 0x7fba00071980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba00066c20 tx=0x7fb9fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:03.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fb9f5ffb700 1 -- 172.21.15.117:0/1670118784 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc01a900 con 0x7fba0006b7e0 2023-07-19T20:45:03.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fb9f5ffb700 1 -- 172.21.15.117:0/1670118784 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc01f070 con 0x7fba0006b7e0 2023-07-19T20:45:03.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fba073ca700 1 -- 172.21.15.117:0/1670118784 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba000b61e0 con 0x7fba0006b7e0 2023-07-19T20:45:03.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fb9f5ffb700 1 -- 172.21.15.117:0/1670118784 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc01ac60 con 0x7fba0006b7e0 2023-07-19T20:45:03.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.321+0000 7fba073ca700 1 -- 172.21.15.117:0/1670118784 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba000b6c30 con 0x7fba0006b7e0 2023-07-19T20:45:03.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.322+0000 7fba073ca700 1 -- 172.21.15.117:0/1670118784 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba000b4800 con 0x7fba0006b7e0 2023-07-19T20:45:03.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.323+0000 7fb9f5ffb700 1 -- 172.21.15.117:0/1670118784 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fb9fc01b430 con 0x7fba0006b7e0 2023-07-19T20:45:03.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.323+0000 7fb9f5ffb700 1 --2- 172.21.15.117:0/1670118784 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb9e406a660 0x7fb9e406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.323+0000 7fb9f5ffb700 1 -- 172.21.15.117:0/1670118784 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9fc021070 con 0x7fba0006b7e0 2023-07-19T20:45:03.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.324+0000 7fba04965700 1 --2- 172.21.15.117:0/1670118784 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb9e406a660 0x7fb9e406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.324+0000 7fba04965700 1 --2- 172.21.15.117:0/1670118784 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb9e406a660 0x7fb9e406cb10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fba00140e30 tx=0x7fb9f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:03.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.327+0000 7fb9f5ffb700 1 -- 172.21.15.117:0/1670118784 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fb9fc055db0 con 0x7fba0006b7e0 2023-07-19T20:45:03.504 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.510+0000 7fba073ca700 1 -- 172.21.15.117:0/1670118784 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fba00067940 con 0x7fba0006b7e0 2023-07-19T20:45:03.504 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.511+0000 7fb9f5ffb700 1 -- 172.21.15.117:0/1670118784 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb9fc05ae60 con 0x7fba0006b7e0 2023-07-19T20:45:03.505 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 8 2023-07-19T20:45:03.506 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.513+0000 7fba073ca700 1 -- 172.21.15.117:0/1670118784 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb9e406a660 msgr2=0x7fb9e406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.506 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.513+0000 7fba073ca700 1 --2- 172.21.15.117:0/1670118784 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb9e406a660 0x7fb9e406cb10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fba00140e30 tx=0x7fb9f0009040 comp rx=0 tx=0).stop 2023-07-19T20:45:03.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.513+0000 7fba073ca700 1 -- 172.21.15.117:0/1670118784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba0006b7e0 msgr2=0x7fba00071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.513+0000 7fba073ca700 1 --2- 172.21.15.117:0/1670118784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba0006b7e0 0x7fba00071980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba00066c20 tx=0x7fb9fc004750 comp rx=0 tx=0).stop 2023-07-19T20:45:03.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.513+0000 7fba073ca700 1 -- 172.21.15.117:0/1670118784 shutdown_connections 2023-07-19T20:45:03.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.513+0000 7fba073ca700 1 --2- 172.21.15.117:0/1670118784 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb9e406a660 0x7fb9e406cb10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.513+0000 7fba073ca700 1 --2- 172.21.15.117:0/1670118784 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fba001482c0 0x7fba000b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.513+0000 7fba073ca700 1 --2- 172.21.15.117:0/1670118784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba0006b7e0 0x7fba00071980 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.507 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.513+0000 7fba073ca700 1 --2- 172.21.15.117:0/1670118784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fba00141610 0x7fba000b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.513+0000 7fba073ca700 1 -- 172.21.15.117:0/1670118784 >> 172.21.15.117:0/1670118784 conn(0x7fba000bdc50 msgr2=0x7fba0013f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:03.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.513+0000 7fba073ca700 1 -- 172.21.15.117:0/1670118784 shutdown_connections 2023-07-19T20:45:03.508 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.513+0000 7fba073ca700 1 -- 172.21.15.117:0/1670118784 wait complete. 2023-07-19T20:45:03.519 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-19T20:45:03.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.649+0000 7fcec3c63700 1 Processor -- start 2023-07-19T20:45:03.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.650+0000 7fcec3c63700 1 -- start start 2023-07-19T20:45:03.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.650+0000 7fcec3c63700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcebc06d840 0x7fcebc14b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.650+0000 7fcec3c63700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcebc14b8a0 0x7fcebc14bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec3c63700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc06cf40 con 0x7fcebc0bd1d0 2023-07-19T20:45:03.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec3c63700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc14c200 con 0x7fcebc14b8a0 2023-07-19T20:45:03.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec3c63700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc06d360 con 0x7fcebc06d840 2023-07-19T20:45:03.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec2200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcebc14b8a0 0x7fcebc14bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec2200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcebc14b8a0 0x7fcebc14bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51654/0 (socket says 172.21.15.117:51654) 2023-07-19T20:45:03.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec2200700 1 -- 172.21.15.117:0/2280409018 learned_addr learned my addr 172.21.15.117:0/2280409018 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:03.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec11fe700 1 --2- 172.21.15.117:0/2280409018 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcebc06d840 0x7fcebc14b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec2200700 1 -- 172.21.15.117:0/2280409018 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcebc06d840 msgr2=0x7fcebc14b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:03.648 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec2200700 1 --2- 172.21.15.117:0/2280409018 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcebc06d840 0x7fcebc14b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.648 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec2200700 1 -- 172.21.15.117:0/2280409018 >> v1:172.21.15.124:6789/0 conn(0x7fcebc0bd1d0 legacy=0x7fcebc072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.648 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec2200700 1 -- 172.21.15.117:0/2280409018 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0ba560 con 0x7fcebc14b8a0 2023-07-19T20:45:03.648 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec2200700 1 --2- 172.21.15.117:0/2280409018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcebc14b8a0 0x7fcebc14bcc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009e50 tx=0x7fceb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bbef1e61b1c843 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:03.648 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec09fd700 1 -- 172.21.15.117:0/2280409018 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb400e070 con 0x7fcebc14b8a0 2023-07-19T20:45:03.648 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec09fd700 1 -- 172.21.15.117:0/2280409018 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb400b9c0 con 0x7fcebc14b8a0 2023-07-19T20:45:03.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.651+0000 7fcec09fd700 1 -- 172.21.15.117:0/2280409018 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb400bd70 con 0x7fcebc14b8a0 2023-07-19T20:45:03.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.652+0000 7fcec3c63700 1 -- 172.21.15.117:0/2280409018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcebc14b8a0 msgr2=0x7fcebc14bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.652+0000 7fcec3c63700 1 --2- 172.21.15.117:0/2280409018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcebc14b8a0 0x7fcebc14bcc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009e50 tx=0x7fceb400b330 comp rx=0 tx=0).stop 2023-07-19T20:45:03.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.652+0000 7fcec3c63700 1 -- 172.21.15.117:0/2280409018 shutdown_connections 2023-07-19T20:45:03.650 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.652+0000 7fcec3c63700 1 --2- 172.21.15.117:0/2280409018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcebc14b8a0 0x7fcebc14bcc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.650 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.652+0000 7fcec3c63700 1 --2- 172.21.15.117:0/2280409018 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcebc06d840 0x7fcebc14b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.650 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.652+0000 7fcec3c63700 1 -- 172.21.15.117:0/2280409018 >> 172.21.15.117:0/2280409018 conn(0x7fcebc09f570 msgr2=0x7fcebc09f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:03.650 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.652+0000 7fcec3c63700 1 -- 172.21.15.117:0/2280409018 shutdown_connections 2023-07-19T20:45:03.650 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.652+0000 7fcec3c63700 1 -- 172.21.15.117:0/2280409018 wait complete. 2023-07-19T20:45:03.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.653+0000 7fcec3c63700 1 Processor -- start 2023-07-19T20:45:03.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.653+0000 7fcec3c63700 1 -- start start 2023-07-19T20:45:03.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec3c63700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcebc06d840 0x7fcebc0b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.653 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec3c63700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcebc0bd1d0 0x7fcebc09bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec3c63700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcebc14b8a0 0x7fcebc0a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec3c63700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc1da990 con 0x7fcebc06d840 2023-07-19T20:45:03.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec3c63700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc1e0b80 con 0x7fcebc0bd1d0 2023-07-19T20:45:03.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec3c63700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc1e0e60 con 0x7fcebc14b8a0 2023-07-19T20:45:03.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec19ff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcebc06d840 0x7fcebc0b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec19ff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcebc06d840 0x7fcebc0b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51658/0 (socket says 172.21.15.117:51658) 2023-07-19T20:45:03.654 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec19ff700 1 -- 172.21.15.117:0/534116548 learned_addr learned my addr 172.21.15.117:0/534116548 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:03.655 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec11fe700 1 --2- 172.21.15.117:0/534116548 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcebc0bd1d0 0x7fcebc09bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.655 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec2200700 1 --2- 172.21.15.117:0/534116548 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcebc14b8a0 0x7fcebc0a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.655 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec19ff700 1 -- 172.21.15.117:0/534116548 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcebc14b8a0 msgr2=0x7fcebc0a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.655 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec19ff700 1 --2- 172.21.15.117:0/534116548 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcebc14b8a0 0x7fcebc0a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.655 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec19ff700 1 -- 172.21.15.117:0/534116548 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcebc0bd1d0 msgr2=0x7fcebc09bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.655 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec19ff700 1 --2- 172.21.15.117:0/534116548 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcebc0bd1d0 0x7fcebc09bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.655 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec19ff700 1 -- 172.21.15.117:0/534116548 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4009b30 con 0x7fcebc06d840 2023-07-19T20:45:03.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec19ff700 1 --2- 172.21.15.117:0/534116548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcebc06d840 0x7fcebc0b2e30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fceac00c4e0 tx=0x7fceac00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:03.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fceb27fc700 1 -- 172.21.15.117:0/534116548 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0052d0 con 0x7fcebc06d840 2023-07-19T20:45:03.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fceb27fc700 1 -- 172.21.15.117:0/534116548 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac005430 con 0x7fcebc06d840 2023-07-19T20:45:03.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec3c63700 1 -- 172.21.15.117:0/534116548 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc0a17b0 con 0x7fcebc06d840 2023-07-19T20:45:03.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fceb27fc700 1 -- 172.21.15.117:0/534116548 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0038c0 con 0x7fcebc06d840 2023-07-19T20:45:03.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.654+0000 7fcec3c63700 1 -- 172.21.15.117:0/534116548 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc1e1140 con 0x7fcebc06d840 2023-07-19T20:45:03.656 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.655+0000 7fcec3c63700 1 -- 172.21.15.117:0/534116548 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc0a1b20 con 0x7fcebc06d840 2023-07-19T20:45:03.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.656+0000 7fceb27fc700 1 -- 172.21.15.117:0/534116548 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fceac003a20 con 0x7fcebc06d840 2023-07-19T20:45:03.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.656+0000 7fceb27fc700 1 --2- 172.21.15.117:0/534116548 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcea006a660 0x7fcea006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.657+0000 7fceb27fc700 1 -- 172.21.15.117:0/534116548 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fceac0882d0 con 0x7fcebc06d840 2023-07-19T20:45:03.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.657+0000 7fcec11fe700 1 --2- 172.21.15.117:0/534116548 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcea006a660 0x7fcea006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.657+0000 7fcec11fe700 1 --2- 172.21.15.117:0/534116548 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcea006a660 0x7fcea006cb10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0b4b70 tx=0x7fceb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:03.658 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.660+0000 7fceb27fc700 1 -- 172.21.15.117:0/534116548 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fceac0536b0 con 0x7fcebc06d840 2023-07-19T20:45:03.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.845+0000 7fcec3c63700 1 -- 172.21.15.117:0/534116548 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcebc06ac70 con 0x7fcebc06d840 2023-07-19T20:45:03.839 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.845+0000 7fceb27fc700 1 -- 172.21.15.117:0/534116548 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fceac056cd0 con 0x7fcebc06d840 2023-07-19T20:45:03.839 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2023-07-19T20:45:03.841 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.847+0000 7fcec3c63700 1 -- 172.21.15.117:0/534116548 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcea006a660 msgr2=0x7fcea006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.841 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.847+0000 7fcec3c63700 1 --2- 172.21.15.117:0/534116548 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcea006a660 0x7fcea006cb10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0b4b70 tx=0x7fceb8008040 comp rx=0 tx=0).stop 2023-07-19T20:45:03.841 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.848+0000 7fcec3c63700 1 -- 172.21.15.117:0/534116548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcebc06d840 msgr2=0x7fcebc0b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.842 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.848+0000 7fcec3c63700 1 --2- 172.21.15.117:0/534116548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcebc06d840 0x7fcebc0b2e30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fceac00c4e0 tx=0x7fceac00c7f0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.842 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.848+0000 7fcec3c63700 1 -- 172.21.15.117:0/534116548 shutdown_connections 2023-07-19T20:45:03.842 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.848+0000 7fcec3c63700 1 --2- 172.21.15.117:0/534116548 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcea006a660 0x7fcea006cb10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.842 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.848+0000 7fcec3c63700 1 --2- 172.21.15.117:0/534116548 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcebc14b8a0 0x7fcebc0a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.842 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.848+0000 7fcec3c63700 1 --2- 172.21.15.117:0/534116548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcebc06d840 0x7fcebc0b2e30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.842 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.848+0000 7fcec3c63700 1 --2- 172.21.15.117:0/534116548 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcebc0bd1d0 0x7fcebc09bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.843 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.848+0000 7fcec3c63700 1 -- 172.21.15.117:0/534116548 >> 172.21.15.117:0/534116548 conn(0x7fcebc09f570 msgr2=0x7fcebc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:03.843 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.848+0000 7fcec3c63700 1 -- 172.21.15.117:0/534116548 shutdown_connections 2023-07-19T20:45:03.843 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.848+0000 7fcec3c63700 1 -- 172.21.15.117:0/534116548 wait complete. 2023-07-19T20:45:03.854 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-19T20:45:03.978 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.985+0000 7f543a2d9700 1 Processor -- start 2023-07-19T20:45:03.979 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.985+0000 7f543a2d9700 1 -- start start 2023-07-19T20:45:03.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.986+0000 7f543a2d9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5434148150 0x7f543414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.986+0000 7f543a2d9700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f54340b2500 0x7f54341515e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.986+0000 7f543a2d9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543406bc80 con 0x7f5434141070 2023-07-19T20:45:03.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.986+0000 7f543a2d9700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54341485a0 con 0x7f54340b2500 2023-07-19T20:45:03.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.986+0000 7f543a2d9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5434141440 con 0x7f5434148150 2023-07-19T20:45:03.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.986+0000 7f5433fff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f5434141070 0x7f543406b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:34376/0 (socket says 172.21.15.117:34376) 2023-07-19T20:45:03.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.986+0000 7f5433fff700 1 -- 172.21.15.117:0/1402983817 learned_addr learned my addr 172.21.15.117:0/1402983817 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:03.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.986+0000 7f5438876700 1 --2- 172.21.15.117:0/1402983817 >> v2:172.21.15.124:3300/0 conn(0x7f54340b2500 0x7f54341515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.986+0000 7f54337fe700 1 --2- 172.21.15.117:0/1402983817 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5434148150 0x7f543414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.986+0000 7f5432ffd700 1 -- 172.21.15.117:0/1402983817 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849764532 0 0) 0x7f543406bc80 con 0x7f5434141070 2023-07-19T20:45:03.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.986+0000 7f5432ffd700 1 -- 172.21.15.117:0/1402983817 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f541c0035b0 con 0x7f5434141070 2023-07-19T20:45:03.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f5438876700 1 -- 172.21.15.117:0/1402983817 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5434148150 msgr2=0x7f543414ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:03.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f5438876700 1 --2- 172.21.15.117:0/1402983817 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5434148150 0x7f543414ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f5438876700 1 -- 172.21.15.117:0/1402983817 >> v1:172.21.15.117:6789/0 conn(0x7f5434141070 legacy=0x7f543406b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f5432ffd700 1 -- 172.21.15.117:0/1402983817 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1102004266 0 0) 0x7f541c0035b0 con 0x7f5434141070 2023-07-19T20:45:03.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f5438876700 1 -- 172.21.15.117:0/1402983817 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543414a2f0 con 0x7f54340b2500 2023-07-19T20:45:03.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f5438876700 1 --2- 172.21.15.117:0/1402983817 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54340b2500 0x7f54341515e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f542c009d90 tx=0x7f542c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=883686cc46bfb23b server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:03.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f5432ffd700 1 -- 172.21.15.117:0/1402983817 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c00e070 con 0x7f54340b2500 2023-07-19T20:45:03.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f5432ffd700 1 -- 172.21.15.117:0/1402983817 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c003a20 con 0x7f54340b2500 2023-07-19T20:45:03.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f5432ffd700 1 -- 172.21.15.117:0/1402983817 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424001670 con 0x7f54340b2500 2023-07-19T20:45:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f543a2d9700 1 -- 172.21.15.117:0/1402983817 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54340b2500 msgr2=0x7f54341515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f543a2d9700 1 --2- 172.21.15.117:0/1402983817 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54340b2500 0x7f54341515e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f542c009d90 tx=0x7f542c00b330 comp rx=0 tx=0).stop 2023-07-19T20:45:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f543a2d9700 1 -- 172.21.15.117:0/1402983817 shutdown_connections 2023-07-19T20:45:03.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f543a2d9700 1 --2- 172.21.15.117:0/1402983817 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54340b2500 0x7f54341515e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f543a2d9700 1 --2- 172.21.15.117:0/1402983817 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5434148150 0x7f543414ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.987+0000 7f543a2d9700 1 -- 172.21.15.117:0/1402983817 >> 172.21.15.117:0/1402983817 conn(0x7f54340bdc50 msgr2=0x7f543406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:03.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.988+0000 7f543a2d9700 1 -- 172.21.15.117:0/1402983817 shutdown_connections 2023-07-19T20:45:03.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.988+0000 7f543a2d9700 1 -- 172.21.15.117:0/1402983817 wait complete. 2023-07-19T20:45:03.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.989+0000 7f543a2d9700 1 Processor -- start 2023-07-19T20:45:03.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.989+0000 7f543a2d9700 1 -- start start 2023-07-19T20:45:03.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f543a2d9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f54340b2500 0x7f543406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f543a2d9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5434141070 0x7f5434137b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f543a2d9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5434148150 0x7f5434136280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f543a2d9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543406b320 con 0x7f5434148150 2023-07-19T20:45:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f543a2d9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54340a07a0 con 0x7f5434141070 2023-07-19T20:45:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f543a2d9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543406bbe0 con 0x7f54340b2500 2023-07-19T20:45:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f5438876700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5434148150 0x7f5434136280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f5438876700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5434148150 0x7f5434136280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51674/0 (socket says 172.21.15.117:51674) 2023-07-19T20:45:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f5438876700 1 -- 172.21.15.117:0/3269864503 learned_addr learned my addr 172.21.15.117:0/3269864503 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f54337fe700 1 --2- 172.21.15.117:0/3269864503 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5434141070 0x7f5434137b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f5433fff700 1 --2- 172.21.15.117:0/3269864503 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f54340b2500 0x7f543406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f5438876700 1 -- 172.21.15.117:0/3269864503 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f54340b2500 msgr2=0x7f543406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f5438876700 1 --2- 172.21.15.117:0/3269864503 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f54340b2500 0x7f543406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f5438876700 1 -- 172.21.15.117:0/3269864503 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5434141070 msgr2=0x7f5434137b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f5438876700 1 --2- 172.21.15.117:0/3269864503 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5434141070 0x7f5434137b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f5438876700 1 -- 172.21.15.117:0/3269864503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c009a70 con 0x7f5434148150 2023-07-19T20:45:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.990+0000 7f5438876700 1 --2- 172.21.15.117:0/3269864503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5434148150 0x7f5434136280 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f542c00b680 tx=0x7f542c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.991+0000 7f5430ff9700 1 -- 172.21.15.117:0/3269864503 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c0045c0 con 0x7f5434148150 2023-07-19T20:45:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.991+0000 7f5430ff9700 1 -- 172.21.15.117:0/3269864503 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c004720 con 0x7f5434148150 2023-07-19T20:45:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.991+0000 7f543a2d9700 1 -- 172.21.15.117:0/3269864503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5434138090 con 0x7f5434148150 2023-07-19T20:45:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.991+0000 7f5430ff9700 1 -- 172.21.15.117:0/3269864503 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c012430 con 0x7f5434148150 2023-07-19T20:45:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.991+0000 7f543a2d9700 1 -- 172.21.15.117:0/3269864503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5434137350 con 0x7f5434148150 2023-07-19T20:45:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.992+0000 7f543a2d9700 1 -- 172.21.15.117:0/3269864503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54340b7560 con 0x7f5434148150 2023-07-19T20:45:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.992+0000 7f5430ff9700 1 -- 172.21.15.117:0/3269864503 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f542c012590 con 0x7f5434148150 2023-07-19T20:45:03.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.992+0000 7f5430ff9700 1 --2- 172.21.15.117:0/3269864503 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f542006a660 0x7f542006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:03.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.993+0000 7f5433fff700 1 --2- 172.21.15.117:0/3269864503 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f542006a660 0x7f542006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:03.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.993+0000 7f5430ff9700 1 -- 172.21.15.117:0/3269864503 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f542c08a810 con 0x7f5434148150 2023-07-19T20:45:03.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.993+0000 7f5433fff700 1 --2- 172.21.15.117:0/3269864503 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f542006a660 0x7f542006cb10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f54240011e0 tx=0x7f5424001530 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:03.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:03.997+0000 7f5430ff9700 1 -- 172.21.15.117:0/3269864503 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f542c055ca0 con 0x7f5434148150 2023-07-19T20:45:04.174 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.180+0000 7f543a2d9700 1 -- 172.21.15.117:0/3269864503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54340a2150 con 0x7f5434148150 2023-07-19T20:45:04.174 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.181+0000 7f5430ff9700 1 -- 172.21.15.117:0/3269864503 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f54340a2150 con 0x7f5434148150 2023-07-19T20:45:04.175 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2023-07-19T20:45:04.176 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.183+0000 7f543a2d9700 1 -- 172.21.15.117:0/3269864503 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f542006a660 msgr2=0x7f542006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:04.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.183+0000 7f543a2d9700 1 --2- 172.21.15.117:0/3269864503 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f542006a660 0x7f542006cb10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f54240011e0 tx=0x7f5424001530 comp rx=0 tx=0).stop 2023-07-19T20:45:04.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.183+0000 7f543a2d9700 1 -- 172.21.15.117:0/3269864503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5434148150 msgr2=0x7f5434136280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:04.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.183+0000 7f543a2d9700 1 --2- 172.21.15.117:0/3269864503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5434148150 0x7f5434136280 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f542c00b680 tx=0x7f542c004ad0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.183+0000 7f543a2d9700 1 -- 172.21.15.117:0/3269864503 shutdown_connections 2023-07-19T20:45:04.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.183+0000 7f543a2d9700 1 --2- 172.21.15.117:0/3269864503 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f542006a660 0x7f542006cb10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.177 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.183+0000 7f543a2d9700 1 --2- 172.21.15.117:0/3269864503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5434148150 0x7f5434136280 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.183+0000 7f543a2d9700 1 --2- 172.21.15.117:0/3269864503 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f54340b2500 0x7f543406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.183+0000 7f543a2d9700 1 --2- 172.21.15.117:0/3269864503 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5434141070 0x7f5434137b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.183+0000 7f543a2d9700 1 -- 172.21.15.117:0/3269864503 >> 172.21.15.117:0/3269864503 conn(0x7f54340bdc50 msgr2=0x7f543413b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:04.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.183+0000 7f543a2d9700 1 -- 172.21.15.117:0/3269864503 shutdown_connections 2023-07-19T20:45:04.178 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.183+0000 7f543a2d9700 1 -- 172.21.15.117:0/3269864503 wait complete. 2023-07-19T20:45:04.189 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-19T20:45:04.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.320+0000 7fa22dfc1700 1 Processor -- start 2023-07-19T20:45:04.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.320+0000 7fa22dfc1700 1 -- start start 2023-07-19T20:45:04.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.320+0000 7fa22dfc1700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa2280bf470 0x7fa2280bc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:04.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.320+0000 7fa22dfc1700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa2280ba810 0x7fa2280bac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:04.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.320+0000 7fa22dfc1700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2280be510 con 0x7fa2280bf0a0 2023-07-19T20:45:04.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.320+0000 7fa22dfc1700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2280bb1d0 con 0x7fa2280bf470 2023-07-19T20:45:04.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.320+0000 7fa22dfc1700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280bdec0 con 0x7fa2280ba810 2023-07-19T20:45:04.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.321+0000 7fa227fff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa2280ba810 0x7fa2280bac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:04.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.321+0000 7fa226ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa2280bf470 0x7fa2280bc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:04.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.321+0000 7fa227fff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa2280ba810 0x7fa2280bac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:43410/0 (socket says 172.21.15.117:43410) 2023-07-19T20:45:04.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.321+0000 7fa227fff700 1 -- 172.21.15.117:0/958074673 learned_addr learned my addr 172.21.15.117:0/958074673 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:04.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.321+0000 7fa227fff700 1 -- 172.21.15.117:0/958074673 >> v2:172.21.15.124:3300/0 conn(0x7fa2280bf470 msgr2=0x7fa2280bc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:04.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.321+0000 7fa227fff700 1 --2- 172.21.15.117:0/958074673 >> v2:172.21.15.124:3300/0 conn(0x7fa2280bf470 0x7fa2280bc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.321+0000 7fa227fff700 1 -- 172.21.15.117:0/958074673 >> v1:172.21.15.124:6789/0 conn(0x7fa2280bf0a0 legacy=0x7fa2280bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:04.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.321+0000 7fa227fff700 1 -- 172.21.15.117:0/958074673 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2280be1a0 con 0x7fa2280ba810 2023-07-19T20:45:04.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.321+0000 7fa227fff700 1 --2- 172.21.15.117:0/958074673 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa2280ba810 0x7fa2280bac90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa220009e50 tx=0x7fa22000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4af0e3226ddda2f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:04.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.321+0000 7fa2267fc700 1 -- 172.21.15.117:0/958074673 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000e070 con 0x7fa2280ba810 2023-07-19T20:45:04.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.321+0000 7fa2267fc700 1 -- 172.21.15.117:0/958074673 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22000b910 con 0x7fa2280ba810 2023-07-19T20:45:04.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.321+0000 7fa2267fc700 1 -- 172.21.15.117:0/958074673 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000bcc0 con 0x7fa2280ba810 2023-07-19T20:45:04.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.322+0000 7fa22dfc1700 1 -- 172.21.15.117:0/958074673 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa2280ba810 msgr2=0x7fa2280bac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:04.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.322+0000 7fa22dfc1700 1 --2- 172.21.15.117:0/958074673 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa2280ba810 0x7fa2280bac90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa220009e50 tx=0x7fa22000b330 comp rx=0 tx=0).stop 2023-07-19T20:45:04.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.322+0000 7fa22dfc1700 1 -- 172.21.15.117:0/958074673 shutdown_connections 2023-07-19T20:45:04.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.322+0000 7fa22dfc1700 1 --2- 172.21.15.117:0/958074673 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa2280ba810 0x7fa2280bac90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.322+0000 7fa22dfc1700 1 --2- 172.21.15.117:0/958074673 >> v2:172.21.15.124:3300/0 conn(0x7fa2280bf470 0x7fa2280bc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.322+0000 7fa22dfc1700 1 -- 172.21.15.117:0/958074673 >> 172.21.15.117:0/958074673 conn(0x7fa2280a1210 msgr2=0x7fa2280be990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:04.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.322+0000 7fa22dfc1700 1 -- 172.21.15.117:0/958074673 shutdown_connections 2023-07-19T20:45:04.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.322+0000 7fa22dfc1700 1 -- 172.21.15.117:0/958074673 wait complete. 2023-07-19T20:45:04.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.323+0000 7fa22dfc1700 1 Processor -- start 2023-07-19T20:45:04.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.323+0000 7fa22dfc1700 1 -- start start 2023-07-19T20:45:04.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa22dfc1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2280ba810 0x7fa2280b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:04.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa22dfc1700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa2280bf0a0 0x7fa22806cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:04.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa22dfc1700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2280bf470 0x7fa2281e3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:04.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa22dfc1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280b82e0 con 0x7fa2280ba810 2023-07-19T20:45:04.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa22dfc1700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22806d280 con 0x7fa2280bf470 2023-07-19T20:45:04.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa22dfc1700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2281e4060 con 0x7fa2280bf0a0 2023-07-19T20:45:04.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa2277fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2280ba810 0x7fa2280b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:04.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa2277fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2280ba810 0x7fa2280b5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51684/0 (socket says 172.21.15.117:51684) 2023-07-19T20:45:04.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa2277fe700 1 -- 172.21.15.117:0/1481396171 learned_addr learned my addr 172.21.15.117:0/1481396171 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:04.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa226ffd700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa2280bf0a0 0x7fa22806cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:04.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa227fff700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2280bf470 0x7fa2281e3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:04.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa226ffd700 1 -- 172.21.15.117:0/1481396171 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2280bf470 msgr2=0x7fa2281e3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:04.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa226ffd700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2280bf470 0x7fa2281e3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa226ffd700 1 -- 172.21.15.117:0/1481396171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2280ba810 msgr2=0x7fa2280b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:04.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa226ffd700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2280ba810 0x7fa2280b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa226ffd700 1 -- 172.21.15.117:0/1481396171 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa220009b30 con 0x7fa2280bf0a0 2023-07-19T20:45:04.325 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa2277fe700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2280ba810 0x7fa2280b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:45:04.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa226ffd700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa2280bf0a0 0x7fa22806cd40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa21000e8a0 tx=0x7fa21000ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:04.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa21ffff700 1 -- 172.21.15.117:0/1481396171 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210013680 con 0x7fa2280bf0a0 2023-07-19T20:45:04.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa21ffff700 1 -- 172.21.15.117:0/1481396171 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2100137e0 con 0x7fa2280bf0a0 2023-07-19T20:45:04.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.324+0000 7fa22dfc1700 1 -- 172.21.15.117:0/1481396171 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2280b64c0 con 0x7fa2280bf0a0 2023-07-19T20:45:04.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.325+0000 7fa21ffff700 1 -- 172.21.15.117:0/1481396171 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210013b70 con 0x7fa2280bf0a0 2023-07-19T20:45:04.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.325+0000 7fa22dfc1700 1 -- 172.21.15.117:0/1481396171 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2280b67a0 con 0x7fa2280bf0a0 2023-07-19T20:45:04.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.325+0000 7fa22dfc1700 1 -- 172.21.15.117:0/1481396171 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2280b58b0 con 0x7fa2280bf0a0 2023-07-19T20:45:04.326 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.326+0000 7fa21ffff700 1 -- 172.21.15.117:0/1481396171 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fa210013cd0 con 0x7fa2280bf0a0 2023-07-19T20:45:04.327 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.326+0000 7fa21ffff700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa20806a660 0x7fa20806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:04.328 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.326+0000 7fa21ffff700 1 -- 172.21.15.117:0/1481396171 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa210088c00 con 0x7fa2280bf0a0 2023-07-19T20:45:04.328 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.326+0000 7fa2277fe700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa20806a660 0x7fa20806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:04.328 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.327+0000 7fa2277fe700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa20806a660 0x7fa20806cb10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa218001d10 tx=0x7fa218009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:04.328 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.331+0000 7fa21ffff700 1 -- 172.21.15.117:0/1481396171 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fa210057b00 con 0x7fa2280bf0a0 2023-07-19T20:45:04.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.515+0000 7fa22dfc1700 1 -- 172.21.15.117:0/1481396171 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2280b8420 con 0x7fa2280bf0a0 2023-07-19T20:45:04.509 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.516+0000 7fa21ffff700 1 -- 172.21.15.117:0/1481396171 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2280b8420 con 0x7fa2280bf0a0 2023-07-19T20:45:04.510 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 64 2023-07-19T20:45:04.512 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.518+0000 7fa22dfc1700 1 -- 172.21.15.117:0/1481396171 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa20806a660 msgr2=0x7fa20806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:04.512 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.518+0000 7fa22dfc1700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa20806a660 0x7fa20806cb10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa218001d10 tx=0x7fa218009040 comp rx=0 tx=0).stop 2023-07-19T20:45:04.512 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.518+0000 7fa22dfc1700 1 -- 172.21.15.117:0/1481396171 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa2280bf0a0 msgr2=0x7fa22806cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:04.512 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.518+0000 7fa22dfc1700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa2280bf0a0 0x7fa22806cd40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa21000e8a0 tx=0x7fa21000ebb0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.512 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.518+0000 7fa22dfc1700 1 -- 172.21.15.117:0/1481396171 shutdown_connections 2023-07-19T20:45:04.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.518+0000 7fa22dfc1700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fa20806a660 0x7fa20806cb10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.518+0000 7fa22dfc1700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2280bf470 0x7fa2281e3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.518+0000 7fa22dfc1700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2280ba810 0x7fa2280b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.518+0000 7fa22dfc1700 1 --2- 172.21.15.117:0/1481396171 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa2280bf0a0 0x7fa22806cd40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.518+0000 7fa22dfc1700 1 -- 172.21.15.117:0/1481396171 >> 172.21.15.117:0/1481396171 conn(0x7fa2280a1210 msgr2=0x7fa2280bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:04.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.518+0000 7fa22dfc1700 1 -- 172.21.15.117:0/1481396171 shutdown_connections 2023-07-19T20:45:04.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.518+0000 7fa22dfc1700 1 -- 172.21.15.117:0/1481396171 wait complete. 2023-07-19T20:45:04.590 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-07-19T20:45:04.591 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-07-19T20:45:04.713 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.719+0000 7fc441c97700 1 Processor -- start 2023-07-19T20:45:04.713 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.719+0000 7fc441c97700 1 -- start start 2023-07-19T20:45:04.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.720+0000 7fc441c97700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc43c0b6dc0 0x7fc43c0b8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:04.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.720+0000 7fc441c97700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc43c0b95e0 0x7fc43c06b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:04.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.720+0000 7fc441c97700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c141f60 con 0x7fc43c14ad30 2023-07-19T20:45:04.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.720+0000 7fc441c97700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c0719f0 con 0x7fc43c0b95e0 2023-07-19T20:45:04.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.720+0000 7fc441c97700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c070a50 con 0x7fc43c0b6dc0 2023-07-19T20:45:04.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.720+0000 7fc43affd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc43c0b95e0 0x7fc43c06b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:04.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.720+0000 7fc43affd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc43c0b95e0 0x7fc43c06b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51692/0 (socket says 172.21.15.117:51692) 2023-07-19T20:45:04.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.720+0000 7fc43affd700 1 -- 172.21.15.117:0/3625006698 learned_addr learned my addr 172.21.15.117:0/3625006698 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:04.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.720+0000 7fc43b7fe700 1 --2- 172.21.15.117:0/3625006698 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc43c0b6dc0 0x7fc43c0b8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:04.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc43affd700 1 -- 172.21.15.117:0/3625006698 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc43c0b6dc0 msgr2=0x7fc43c0b8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:04.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc43affd700 1 --2- 172.21.15.117:0/3625006698 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc43c0b6dc0 0x7fc43c0b8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc43affd700 1 -- 172.21.15.117:0/3625006698 >> v1:172.21.15.117:6789/0 conn(0x7fc43c14ad30 legacy=0x7fc43c147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:04.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc43affd700 1 -- 172.21.15.117:0/3625006698 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c0b9300 con 0x7fc43c0b95e0 2023-07-19T20:45:04.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc43a7fc700 1 -- 172.21.15.117:0/3625006698 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469919309 0 0) 0x7fc43c141f60 con 0x7fc43c14ad30 2023-07-19T20:45:04.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc43affd700 1 --2- 172.21.15.117:0/3625006698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c0b95e0 0x7fc43c06b570 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0098f0 tx=0x7fc42c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86d1a1503e6099e server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:04.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc43a7fc700 1 -- 172.21.15.117:0/3625006698 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c00b8a0 con 0x7fc43c0b95e0 2023-07-19T20:45:04.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc43a7fc700 1 -- 172.21.15.117:0/3625006698 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c00ba00 con 0x7fc43c0b95e0 2023-07-19T20:45:04.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc43a7fc700 1 -- 172.21.15.117:0/3625006698 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c00bd90 con 0x7fc43c0b95e0 2023-07-19T20:45:04.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc441c97700 1 -- 172.21.15.117:0/3625006698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c0b95e0 msgr2=0x7fc43c06b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:04.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc441c97700 1 --2- 172.21.15.117:0/3625006698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c0b95e0 0x7fc43c06b570 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0098f0 tx=0x7fc42c009c00 comp rx=0 tx=0).stop 2023-07-19T20:45:04.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc441c97700 1 -- 172.21.15.117:0/3625006698 shutdown_connections 2023-07-19T20:45:04.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc441c97700 1 --2- 172.21.15.117:0/3625006698 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc43c0b6dc0 0x7fc43c0b8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc441c97700 1 --2- 172.21.15.117:0/3625006698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c0b95e0 0x7fc43c06b570 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc441c97700 1 -- 172.21.15.117:0/3625006698 >> 172.21.15.117:0/3625006698 conn(0x7fc43c0bdc00 msgr2=0x7fc43c0b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:04.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc441c97700 1 -- 172.21.15.117:0/3625006698 shutdown_connections 2023-07-19T20:45:04.720 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.721+0000 7fc441c97700 1 -- 172.21.15.117:0/3625006698 wait complete. 2023-07-19T20:45:04.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.722+0000 7fc441c97700 1 Processor -- start 2023-07-19T20:45:04.722 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.723+0000 7fc441c97700 1 -- start start 2023-07-19T20:45:04.722 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.723+0000 7fc441c97700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc43c0b6dc0 0x7fc43c144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:04.722 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.723+0000 7fc441c97700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc43c0b95e0 0x7fc43c13a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:04.722 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.723+0000 7fc441c97700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c14ad30 0x7fc43c149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:04.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.723+0000 7fc441c97700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c149020 con 0x7fc43c14ad30 2023-07-19T20:45:04.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.723+0000 7fc441c97700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c144c70 con 0x7fc43c0b95e0 2023-07-19T20:45:04.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.723+0000 7fc441c97700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c142370 con 0x7fc43c0b6dc0 2023-07-19T20:45:04.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.723+0000 7fc43bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c14ad30 0x7fc43c149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:04.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.723+0000 7fc43bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c14ad30 0x7fc43c149440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51702/0 (socket says 172.21.15.117:51702) 2023-07-19T20:45:04.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.723+0000 7fc43bfff700 1 -- 172.21.15.117:0/1577600644 learned_addr learned my addr 172.21.15.117:0/1577600644 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:04.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.723+0000 7fc43affd700 1 --2- 172.21.15.117:0/1577600644 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc43c0b95e0 0x7fc43c13a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:04.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.723+0000 7fc43b7fe700 1 --2- 172.21.15.117:0/1577600644 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc43c0b6dc0 0x7fc43c144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:04.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.724+0000 7fc43bfff700 1 -- 172.21.15.117:0/1577600644 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc43c0b6dc0 msgr2=0x7fc43c144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:04.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.724+0000 7fc43bfff700 1 --2- 172.21.15.117:0/1577600644 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc43c0b6dc0 0x7fc43c144730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.724+0000 7fc43bfff700 1 -- 172.21.15.117:0/1577600644 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc43c0b95e0 msgr2=0x7fc43c13a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:04.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.724+0000 7fc43bfff700 1 --2- 172.21.15.117:0/1577600644 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc43c0b95e0 0x7fc43c13a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:04.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.724+0000 7fc43bfff700 1 -- 172.21.15.117:0/1577600644 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c009550 con 0x7fc43c14ad30 2023-07-19T20:45:04.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.724+0000 7fc43bfff700 1 --2- 172.21.15.117:0/1577600644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c14ad30 0x7fc43c149440 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc43400c850 tx=0x7fc43400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:04.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.725+0000 7fc433fff700 1 -- 172.21.15.117:0/1577600644 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434003e30 con 0x7fc43c14ad30 2023-07-19T20:45:04.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.725+0000 7fc433fff700 1 -- 172.21.15.117:0/1577600644 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4340050f0 con 0x7fc43c14ad30 2023-07-19T20:45:04.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.725+0000 7fc433fff700 1 -- 172.21.15.117:0/1577600644 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4340054a0 con 0x7fc43c14ad30 2023-07-19T20:45:04.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.725+0000 7fc441c97700 1 -- 172.21.15.117:0/1577600644 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c1431c0 con 0x7fc43c14ad30 2023-07-19T20:45:04.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.725+0000 7fc441c97700 1 -- 172.21.15.117:0/1577600644 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c13a210 con 0x7fc43c14ad30 2023-07-19T20:45:04.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.726+0000 7fc441c97700 1 -- 172.21.15.117:0/1577600644 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c143020 con 0x7fc43c14ad30 2023-07-19T20:45:04.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.727+0000 7fc433fff700 1 -- 172.21.15.117:0/1577600644 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fc434005600 con 0x7fc43c14ad30 2023-07-19T20:45:04.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.727+0000 7fc433fff700 1 --2- 172.21.15.117:0/1577600644 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc41c06a660 0x7fc41c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:04.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.727+0000 7fc433fff700 1 -- 172.21.15.117:0/1577600644 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc434088100 con 0x7fc43c14ad30 2023-07-19T20:45:04.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.727+0000 7fc43b7fe700 1 --2- 172.21.15.117:0/1577600644 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc41c06a660 0x7fc41c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:04.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.727+0000 7fc43b7fe700 1 --2- 172.21.15.117:0/1577600644 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc41c06a660 0x7fc41c06cb10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc424006fd0 tx=0x7fc424008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:04.729 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.731+0000 7fc433fff700 1 -- 172.21.15.117:0/1577600644 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fc43c143020 con 0x7fc43c14ad30 2023-07-19T20:45:04.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:04.991+0000 7fc441c97700 1 -- 172.21.15.117:0/1577600644 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7fc43c143020 con 0x7fc43c14ad30 2023-07-19T20:45:05.823 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.829+0000 7fc433fff700 1 -- 172.21.15.117:0/1577600644 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v44) v1 ==== 166+0+0 (secure 0 0 0) 0x7fc43c143020 con 0x7fc43c14ad30 2023-07-19T20:45:05.826 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.832+0000 7fc441c97700 1 -- 172.21.15.117:0/1577600644 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc41c06a660 msgr2=0x7fc41c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:05.826 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.832+0000 7fc441c97700 1 --2- 172.21.15.117:0/1577600644 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc41c06a660 0x7fc41c06cb10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc424006fd0 tx=0x7fc424008040 comp rx=0 tx=0).stop 2023-07-19T20:45:05.826 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.832+0000 7fc441c97700 1 -- 172.21.15.117:0/1577600644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c14ad30 msgr2=0x7fc43c149440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:05.827 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.832+0000 7fc441c97700 1 --2- 172.21.15.117:0/1577600644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c14ad30 0x7fc43c149440 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc43400c850 tx=0x7fc43400cb60 comp rx=0 tx=0).stop 2023-07-19T20:45:05.827 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.832+0000 7fc441c97700 1 -- 172.21.15.117:0/1577600644 shutdown_connections 2023-07-19T20:45:05.827 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.832+0000 7fc441c97700 1 --2- 172.21.15.117:0/1577600644 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc41c06a660 0x7fc41c06cb10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:05.827 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.832+0000 7fc441c97700 1 --2- 172.21.15.117:0/1577600644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c14ad30 0x7fc43c149440 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:05.827 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.832+0000 7fc441c97700 1 --2- 172.21.15.117:0/1577600644 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc43c0b6dc0 0x7fc43c144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:05.827 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.832+0000 7fc441c97700 1 --2- 172.21.15.117:0/1577600644 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc43c0b95e0 0x7fc43c13a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:05.827 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.832+0000 7fc441c97700 1 -- 172.21.15.117:0/1577600644 >> 172.21.15.117:0/1577600644 conn(0x7fc43c0bdc00 msgr2=0x7fc43c06b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:05.828 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.832+0000 7fc441c97700 1 -- 172.21.15.117:0/1577600644 shutdown_connections 2023-07-19T20:45:05.828 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.832+0000 7fc441c97700 1 -- 172.21.15.117:0/1577600644 wait complete. 2023-07-19T20:45:05.847 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-19T20:45:05.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.990+0000 7fde24fa2700 1 Processor -- start 2023-07-19T20:45:05.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.990+0000 7fde24fa2700 1 -- start start 2023-07-19T20:45:05.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde24fa2700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fde20144b90 0x7fde200b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:05.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde24fa2700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fde2006fd50 0x7fde2006a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:05.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde24fa2700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde20071f80 con 0x7fde2014de80 2023-07-19T20:45:05.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde24fa2700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde200ba1d0 con 0x7fde20144b90 2023-07-19T20:45:05.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde24fa2700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde20071ca0 con 0x7fde2006fd50 2023-07-19T20:45:05.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde1e59c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fde20144b90 0x7fde200b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:05.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde1ed9d700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fde2014de80 0x7fde2006d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:34382/0 (socket says 172.21.15.117:34382) 2023-07-19T20:45:05.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde1ed9d700 1 -- 172.21.15.117:0/2697565257 learned_addr learned my addr 172.21.15.117:0/2697565257 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:05.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde1dd9b700 1 --2- 172.21.15.117:0/2697565257 >> v2:172.21.15.124:3300/0 conn(0x7fde2006fd50 0x7fde2006a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:05.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde1e59c700 1 -- 172.21.15.117:0/2697565257 >> v2:172.21.15.124:3300/0 conn(0x7fde2006fd50 msgr2=0x7fde2006a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:05.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde1e59c700 1 --2- 172.21.15.117:0/2697565257 >> v2:172.21.15.124:3300/0 conn(0x7fde2006fd50 0x7fde2006a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:05.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde1e59c700 1 -- 172.21.15.117:0/2697565257 >> v1:172.21.15.117:6789/0 conn(0x7fde2014de80 legacy=0x7fde2006d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:05.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde1e59c700 1 -- 172.21.15.117:0/2697565257 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde20144f60 con 0x7fde20144b90 2023-07-19T20:45:05.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde1d59a700 1 -- 172.21.15.117:0/2697565257 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636373367 0 0) 0x7fde20071f80 con 0x7fde2014de80 2023-07-19T20:45:05.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde1e59c700 1 --2- 172.21.15.117:0/2697565257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde20144b90 0x7fde200b9c90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fde20070f40 tx=0x7fde14009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6582fd855f9a07d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:05.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde1d59a700 1 -- 172.21.15.117:0/2697565257 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde14011830 con 0x7fde20144b90 2023-07-19T20:45:05.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde1d59a700 1 -- 172.21.15.117:0/2697565257 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde14011990 con 0x7fde20144b90 2023-07-19T20:45:05.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.991+0000 7fde1d59a700 1 -- 172.21.15.117:0/2697565257 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde14011d20 con 0x7fde20144b90 2023-07-19T20:45:05.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.992+0000 7fde24fa2700 1 -- 172.21.15.117:0/2697565257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde20144b90 msgr2=0x7fde200b9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:05.990 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.992+0000 7fde24fa2700 1 --2- 172.21.15.117:0/2697565257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde20144b90 0x7fde200b9c90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fde20070f40 tx=0x7fde14009b20 comp rx=0 tx=0).stop 2023-07-19T20:45:05.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.992+0000 7fde24fa2700 1 -- 172.21.15.117:0/2697565257 shutdown_connections 2023-07-19T20:45:05.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.992+0000 7fde24fa2700 1 --2- 172.21.15.117:0/2697565257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde20144b90 0x7fde200b9c90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:05.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.992+0000 7fde24fa2700 1 --2- 172.21.15.117:0/2697565257 >> v2:172.21.15.124:3300/0 conn(0x7fde2006fd50 0x7fde2006a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:05.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.992+0000 7fde24fa2700 1 -- 172.21.15.117:0/2697565257 >> 172.21.15.117:0/2697565257 conn(0x7fde200bd8c0 msgr2=0x7fde200bdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:05.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.992+0000 7fde24fa2700 1 -- 172.21.15.117:0/2697565257 shutdown_connections 2023-07-19T20:45:05.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.992+0000 7fde24fa2700 1 -- 172.21.15.117:0/2697565257 wait complete. 2023-07-19T20:45:05.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.993+0000 7fde24fa2700 1 Processor -- start 2023-07-19T20:45:05.992 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.993+0000 7fde24fa2700 1 -- start start 2023-07-19T20:45:05.992 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde24fa2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2006fd50 0x7fde2014cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:05.992 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde24fa2700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde20144b90 0x7fde20148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:05.992 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde24fa2700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fde2014de80 0x7fde201490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:05.992 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde24fa2700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2014d500 con 0x7fde2006fd50 2023-07-19T20:45:05.992 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde24fa2700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2014a690 con 0x7fde20144b90 2023-07-19T20:45:05.992 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde24fa2700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2014adc0 con 0x7fde2014de80 2023-07-19T20:45:05.992 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde1e59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2006fd50 0x7fde2014cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:05.993 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde1e59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2006fd50 0x7fde2014cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51716/0 (socket says 172.21.15.117:51716) 2023-07-19T20:45:05.993 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde1e59c700 1 -- 172.21.15.117:0/3964156185 learned_addr learned my addr 172.21.15.117:0/3964156185 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:05.993 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde1dd9b700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde20144b90 0x7fde20148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:05.993 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde1ed9d700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fde2014de80 0x7fde201490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:05.993 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde1e59c700 1 -- 172.21.15.117:0/3964156185 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fde2014de80 msgr2=0x7fde201490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:05.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde1e59c700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fde2014de80 0x7fde201490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:05.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde1e59c700 1 -- 172.21.15.117:0/3964156185 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde20144b90 msgr2=0x7fde20148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:05.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde1e59c700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde20144b90 0x7fde20148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:05.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde1e59c700 1 -- 172.21.15.117:0/3964156185 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde140094a0 con 0x7fde2006fd50 2023-07-19T20:45:05.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde1ed9d700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fde2014de80 0x7fde201490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:05.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.994+0000 7fde1e59c700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2006fd50 0x7fde2014cfc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fde140090b0 tx=0x7fde14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:05.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.995+0000 7fde0effd700 1 -- 172.21.15.117:0/3964156185 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde140036a0 con 0x7fde2006fd50 2023-07-19T20:45:05.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.995+0000 7fde0effd700 1 -- 172.21.15.117:0/3964156185 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1401f070 con 0x7fde2006fd50 2023-07-19T20:45:05.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.995+0000 7fde0effd700 1 -- 172.21.15.117:0/3964156185 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde14003a00 con 0x7fde2006fd50 2023-07-19T20:45:05.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.995+0000 7fde24fa2700 1 -- 172.21.15.117:0/3964156185 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2014b0a0 con 0x7fde2006fd50 2023-07-19T20:45:05.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.995+0000 7fde24fa2700 1 -- 172.21.15.117:0/3964156185 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2014aab0 con 0x7fde2006fd50 2023-07-19T20:45:05.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.995+0000 7fde24fa2700 1 -- 172.21.15.117:0/3964156185 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde20074890 con 0x7fde2006fd50 2023-07-19T20:45:05.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.996+0000 7fde0effd700 1 -- 172.21.15.117:0/3964156185 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fde14003b60 con 0x7fde2006fd50 2023-07-19T20:45:05.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.996+0000 7fde0effd700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fde0006a660 0x7fde0006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:05.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.997+0000 7fde1dd9b700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fde0006a660 0x7fde0006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:05.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.997+0000 7fde0effd700 1 -- 172.21.15.117:0/3964156185 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde14021070 con 0x7fde2006fd50 2023-07-19T20:45:05.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:05.997+0000 7fde1dd9b700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fde0006a660 0x7fde0006cb10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fde20140080 tx=0x7fde10009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:05.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.001+0000 7fde0effd700 1 -- 172.21.15.117:0/3964156185 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fde140558c0 con 0x7fde2006fd50 2023-07-19T20:45:06.182 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.188+0000 7fde24fa2700 1 -- 172.21.15.117:0/3964156185 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fde20071910 con 0x7fde2006fd50 2023-07-19T20:45:06.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.192+0000 7fde0effd700 1 -- 172.21.15.117:0/3964156185 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fde20071910 con 0x7fde2006fd50 2023-07-19T20:45:06.188 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.194+0000 7fde24fa2700 1 -- 172.21.15.117:0/3964156185 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fde0006a660 msgr2=0x7fde0006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:06.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.194+0000 7fde24fa2700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fde0006a660 0x7fde0006cb10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fde20140080 tx=0x7fde10009210 comp rx=0 tx=0).stop 2023-07-19T20:45:06.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.194+0000 7fde24fa2700 1 -- 172.21.15.117:0/3964156185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2006fd50 msgr2=0x7fde2014cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:06.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.194+0000 7fde24fa2700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2006fd50 0x7fde2014cfc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fde140090b0 tx=0x7fde14004750 comp rx=0 tx=0).stop 2023-07-19T20:45:06.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.194+0000 7fde24fa2700 1 -- 172.21.15.117:0/3964156185 shutdown_connections 2023-07-19T20:45:06.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.194+0000 7fde24fa2700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fde0006a660 0x7fde0006cb10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:06.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.194+0000 7fde24fa2700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fde2014de80 0x7fde201490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:06.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.194+0000 7fde24fa2700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2006fd50 0x7fde2014cfc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:06.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.194+0000 7fde24fa2700 1 --2- 172.21.15.117:0/3964156185 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fde20144b90 0x7fde20148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:06.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.194+0000 7fde24fa2700 1 -- 172.21.15.117:0/3964156185 >> 172.21.15.117:0/3964156185 conn(0x7fde200bd8c0 msgr2=0x7fde200b85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:06.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.194+0000 7fde24fa2700 1 -- 172.21.15.117:0/3964156185 shutdown_connections 2023-07-19T20:45:06.191 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.194+0000 7fde24fa2700 1 -- 172.21.15.117:0/3964156185 wait complete. 2023-07-19T20:45:06.200 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-19T20:45:06.202 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-19T20:45:06.296 DEBUG:teuthology.orchestra.run.smithi124:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-19T20:45:06.382 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-19T20:45:06.489 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-19T20:45:06.490 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:45:06.491 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-19T20:45:06.539 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:45:06.540 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-19T20:45:06.628 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:45:06.629 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-19T20:45:06.721 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:45:06.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.856+0000 7fe16948e700 1 Processor -- start 2023-07-19T20:45:06.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.856+0000 7fe16948e700 1 -- start start 2023-07-19T20:45:06.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.856+0000 7fe16948e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1640ba850 0x7fe16414a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:06.851 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.856+0000 7fe16948e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe1640bac20 0x7fe1640b8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:06.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.856+0000 7fe16948e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1640b44f0 con 0x7fe1640b8ca0 2023-07-19T20:45:06.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.856+0000 7fe16948e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16414e750 con 0x7fe1640ba850 2023-07-19T20:45:06.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.856+0000 7fe16948e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16414de40 con 0x7fe1640bac20 2023-07-19T20:45:06.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.856+0000 7fe162ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1640ba850 0x7fe16414a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:06.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.856+0000 7fe162ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1640ba850 0x7fe16414a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51726/0 (socket says 172.21.15.117:51726) 2023-07-19T20:45:06.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.856+0000 7fe162ffd700 1 -- 172.21.15.117:0/2146800715 learned_addr learned my addr 172.21.15.117:0/2146800715 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:06.852 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.857+0000 7fe162ffd700 1 -- 172.21.15.117:0/2146800715 >> v2:172.21.15.124:3300/0 conn(0x7fe1640bac20 msgr2=0x7fe1640b8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:06.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.857+0000 7fe1627fc700 1 --2- 172.21.15.117:0/2146800715 >> v2:172.21.15.124:3300/0 conn(0x7fe1640bac20 0x7fe1640b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:06.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.857+0000 7fe162ffd700 1 --2- 172.21.15.117:0/2146800715 >> v2:172.21.15.124:3300/0 conn(0x7fe1640bac20 0x7fe1640b8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:06.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.857+0000 7fe161ffb700 1 -- 172.21.15.117:0/2146800715 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580034433 0 0) 0x7fe1640b44f0 con 0x7fe1640b8ca0 2023-07-19T20:45:06.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.857+0000 7fe162ffd700 1 -- 172.21.15.117:0/2146800715 >> v1:172.21.15.117:6789/0 conn(0x7fe1640b8ca0 legacy=0x7fe1640bb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:06.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.857+0000 7fe162ffd700 1 -- 172.21.15.117:0/2146800715 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1640b9100 con 0x7fe1640ba850 2023-07-19T20:45:06.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.857+0000 7fe1627fc700 1 --2- 172.21.15.117:0/2146800715 >> v2:172.21.15.124:3300/0 conn(0x7fe1640bac20 0x7fe1640b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:06.853 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.857+0000 7fe162ffd700 1 --2- 172.21.15.117:0/2146800715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1640ba850 0x7fe16414a870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe1640bb170 tx=0x7fe158009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4d37da8fea6a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:06.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.857+0000 7fe161ffb700 1 -- 172.21.15.117:0/2146800715 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15800b870 con 0x7fe1640ba850 2023-07-19T20:45:06.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.857+0000 7fe161ffb700 1 -- 172.21.15.117:0/2146800715 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15800b9d0 con 0x7fe1640ba850 2023-07-19T20:45:06.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.857+0000 7fe161ffb700 1 -- 172.21.15.117:0/2146800715 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15800bd60 con 0x7fe1640ba850 2023-07-19T20:45:06.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.857+0000 7fe16948e700 1 -- 172.21.15.117:0/2146800715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1640ba850 msgr2=0x7fe16414a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:06.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.857+0000 7fe16948e700 1 --2- 172.21.15.117:0/2146800715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1640ba850 0x7fe16414a870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe1640bb170 tx=0x7fe158009bd0 comp rx=0 tx=0).stop 2023-07-19T20:45:06.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.858+0000 7fe16948e700 1 -- 172.21.15.117:0/2146800715 shutdown_connections 2023-07-19T20:45:06.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.858+0000 7fe16948e700 1 --2- 172.21.15.117:0/2146800715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1640ba850 0x7fe16414a870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:06.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.858+0000 7fe16948e700 1 --2- 172.21.15.117:0/2146800715 >> v2:172.21.15.124:3300/0 conn(0x7fe1640bac20 0x7fe1640b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:06.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.858+0000 7fe16948e700 1 -- 172.21.15.117:0/2146800715 >> 172.21.15.117:0/2146800715 conn(0x7fe164071c90 msgr2=0x7fe164072060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:06.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.858+0000 7fe16948e700 1 -- 172.21.15.117:0/2146800715 shutdown_connections 2023-07-19T20:45:06.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.858+0000 7fe16948e700 1 -- 172.21.15.117:0/2146800715 wait complete. 2023-07-19T20:45:06.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.859+0000 7fe16948e700 1 Processor -- start 2023-07-19T20:45:06.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.859+0000 7fe16948e700 1 -- start start 2023-07-19T20:45:06.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.859+0000 7fe16948e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1640b8ca0 0x7fe164146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:06.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.859+0000 7fe16948e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1640ba850 0x7fe164144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:06.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.859+0000 7fe16948e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1640bac20 0x7fe164141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:06.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.859+0000 7fe16948e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1641423f0 con 0x7fe1640bac20 2023-07-19T20:45:06.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.859+0000 7fe16948e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe164144370 con 0x7fe1640ba850 2023-07-19T20:45:06.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.859+0000 7fe16948e700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe164143d60 con 0x7fe1640b8ca0 2023-07-19T20:45:06.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.859+0000 7fe1637fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1640bac20 0x7fe164141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:06.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe1637fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1640bac20 0x7fe164141eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51742/0 (socket says 172.21.15.117:51742) 2023-07-19T20:45:06.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe1637fe700 1 -- 172.21.15.117:0/3033257879 learned_addr learned my addr 172.21.15.117:0/3033257879 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:06.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe1627fc700 1 --2- 172.21.15.117:0/3033257879 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1640ba850 0x7fe164144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:06.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe162ffd700 1 --2- 172.21.15.117:0/3033257879 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1640b8ca0 0x7fe164146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:06.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe1637fe700 1 -- 172.21.15.117:0/3033257879 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1640b8ca0 msgr2=0x7fe164146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:06.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe1637fe700 1 --2- 172.21.15.117:0/3033257879 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1640b8ca0 0x7fe164146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:06.859 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe1637fe700 1 -- 172.21.15.117:0/3033257879 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1640ba850 msgr2=0x7fe164144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:06.860 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe1637fe700 1 --2- 172.21.15.117:0/3033257879 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1640ba850 0x7fe164144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:06.860 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe1637fe700 1 -- 172.21.15.117:0/3033257879 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe158009550 con 0x7fe1640bac20 2023-07-19T20:45:06.860 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe1637fe700 1 --2- 172.21.15.117:0/3033257879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1640bac20 0x7fe164141eb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe15c001560 tx=0x7fe15c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:06.860 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe14b7fe700 1 -- 172.21.15.117:0/3033257879 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c003e30 con 0x7fe1640bac20 2023-07-19T20:45:06.861 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe14b7fe700 1 -- 172.21.15.117:0/3033257879 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15c005070 con 0x7fe1640bac20 2023-07-19T20:45:06.861 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe14b7fe700 1 -- 172.21.15.117:0/3033257879 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c005420 con 0x7fe1640bac20 2023-07-19T20:45:06.861 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe16948e700 1 -- 172.21.15.117:0/3033257879 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe164143630 con 0x7fe1640bac20 2023-07-19T20:45:06.861 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.860+0000 7fe16948e700 1 -- 172.21.15.117:0/3033257879 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe164143a50 con 0x7fe1640bac20 2023-07-19T20:45:06.861 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.861+0000 7fe16948e700 1 -- 172.21.15.117:0/3033257879 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe164144520 con 0x7fe1640bac20 2023-07-19T20:45:06.861 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.861+0000 7fe14b7fe700 1 -- 172.21.15.117:0/3033257879 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fe15c005580 con 0x7fe1640bac20 2023-07-19T20:45:06.861 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.862+0000 7fe14b7fe700 1 --2- 172.21.15.117:0/3033257879 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe15006a660 0x7fe15006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:06.862 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.862+0000 7fe162ffd700 1 --2- 172.21.15.117:0/3033257879 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe15006a660 0x7fe15006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:06.862 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.862+0000 7fe14b7fe700 1 -- 172.21.15.117:0/3033257879 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe15c0881b0 con 0x7fe1640bac20 2023-07-19T20:45:06.862 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.862+0000 7fe162ffd700 1 --2- 172.21.15.117:0/3033257879 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe15006a660 0x7fe15006cb10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe158000c00 tx=0x7fe158008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:06.862 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:06.866+0000 7fe14b7fe700 1 -- 172.21.15.117:0/3033257879 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fe164144520 con 0x7fe1640bac20 2023-07-19T20:45:07.047 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.053+0000 7fe16948e700 1 -- 172.21.15.117:0/3033257879 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1641444e0 con 0x7fe1640bac20 2023-07-19T20:45:07.048 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.054+0000 7fe14b7fe700 1 -- 172.21.15.117:0/3033257879 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17897 (secure 0 0 0) 0x7fe15c053640 con 0x7fe1640bac20 2023-07-19T20:45:07.048 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:07.048 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:39.549566+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:45:07.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.056+0000 7fe16948e700 1 -- 172.21.15.117:0/3033257879 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe15006a660 msgr2=0x7fe15006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.056+0000 7fe16948e700 1 --2- 172.21.15.117:0/3033257879 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe15006a660 0x7fe15006cb10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe158000c00 tx=0x7fe158008030 comp rx=0 tx=0).stop 2023-07-19T20:45:07.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.056+0000 7fe16948e700 1 -- 172.21.15.117:0/3033257879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1640bac20 msgr2=0x7fe164141eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.056+0000 7fe16948e700 1 --2- 172.21.15.117:0/3033257879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1640bac20 0x7fe164141eb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe15c001560 tx=0x7fe15c00cc00 comp rx=0 tx=0).stop 2023-07-19T20:45:07.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.056+0000 7fe16948e700 1 -- 172.21.15.117:0/3033257879 shutdown_connections 2023-07-19T20:45:07.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.056+0000 7fe16948e700 1 --2- 172.21.15.117:0/3033257879 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe15006a660 0x7fe15006cb10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.051 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.056+0000 7fe16948e700 1 --2- 172.21.15.117:0/3033257879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1640bac20 0x7fe164141eb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.051 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.056+0000 7fe16948e700 1 --2- 172.21.15.117:0/3033257879 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe1640b8ca0 0x7fe164146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.051 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.056+0000 7fe16948e700 1 --2- 172.21.15.117:0/3033257879 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1640ba850 0x7fe164144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.051 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.056+0000 7fe16948e700 1 -- 172.21.15.117:0/3033257879 >> 172.21.15.117:0/3033257879 conn(0x7fe164071c90 msgr2=0x7fe1640bef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:07.051 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.056+0000 7fe16948e700 1 -- 172.21.15.117:0/3033257879 shutdown_connections 2023-07-19T20:45:07.051 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.056+0000 7fe16948e700 1 -- 172.21.15.117:0/3033257879 wait complete. 2023-07-19T20:45:07.062 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-19T20:44:31.325778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-19T20:44:31.728215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-19T20:44:36.280405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-19T20:44:37.509195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-19T20:45:07.063 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-19T20:45:07.187 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.193+0000 7ffaff3e8700 1 Processor -- start 2023-07-19T20:45:07.187 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.193+0000 7ffaff3e8700 1 -- start start 2023-07-19T20:45:07.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.194+0000 7ffaff3e8700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffaf806c580 0x7ffaf81561b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.194+0000 7ffaff3e8700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf8070ef0 con 0x7ffaf80b9800 2023-07-19T20:45:07.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.194+0000 7ffaff3e8700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf806ee80 con 0x7ffaf8144cf0 2023-07-19T20:45:07.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.194+0000 7ffaff3e8700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf806d260 con 0x7ffaf806c580 2023-07-19T20:45:07.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.194+0000 7ffafd985700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffaf806c580 0x7ffaf81561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.194+0000 7ffafd985700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffaf806c580 0x7ffaf81561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51756/0 (socket says 172.21.15.117:51756) 2023-07-19T20:45:07.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.194+0000 7ffafc983700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ffaf80b9800 0x7ffaf814af50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:34404/0 (socket says 172.21.15.117:34404) 2023-07-19T20:45:07.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.194+0000 7ffafd985700 1 -- 172.21.15.117:0/1586766316 learned_addr learned my addr 172.21.15.117:0/1586766316 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:07.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.194+0000 7ffafd985700 1 -- 172.21.15.117:0/1586766316 >> v1:172.21.15.124:6789/0 conn(0x7ffaf8144cf0 legacy=0x7ffaf806e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.194+0000 7ffafd985700 1 -- 172.21.15.117:0/1586766316 >> v1:172.21.15.117:6789/0 conn(0x7ffaf80b9800 legacy=0x7ffaf814af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.194+0000 7ffafd985700 1 -- 172.21.15.117:0/1586766316 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf806cca0 con 0x7ffaf806c580 2023-07-19T20:45:07.191 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.194+0000 7ffafd985700 1 --2- 172.21.15.117:0/1586766316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf806c580 0x7ffaf81561b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0009e50 tx=0x7ffaf000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d609505aa2eee96 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:07.192 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.194+0000 7ffaeffff700 1 -- 172.21.15.117:0/1586766316 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf000e070 con 0x7ffaf806c580 2023-07-19T20:45:07.192 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.195+0000 7ffaeffff700 1 -- 172.21.15.117:0/1586766316 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf000b9c0 con 0x7ffaf806c580 2023-07-19T20:45:07.192 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.195+0000 7ffaeffff700 1 -- 172.21.15.117:0/1586766316 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf000bd70 con 0x7ffaf806c580 2023-07-19T20:45:07.192 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.195+0000 7ffaff3e8700 1 -- 172.21.15.117:0/1586766316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf806c580 msgr2=0x7ffaf81561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.192 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.195+0000 7ffaff3e8700 1 --2- 172.21.15.117:0/1586766316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf806c580 0x7ffaf81561b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0009e50 tx=0x7ffaf000b330 comp rx=0 tx=0).stop 2023-07-19T20:45:07.192 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.195+0000 7ffaff3e8700 1 -- 172.21.15.117:0/1586766316 shutdown_connections 2023-07-19T20:45:07.192 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.195+0000 7ffaff3e8700 1 --2- 172.21.15.117:0/1586766316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf806c580 0x7ffaf81561b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.195+0000 7ffaff3e8700 1 -- 172.21.15.117:0/1586766316 >> 172.21.15.117:0/1586766316 conn(0x7ffaf80be9c0 msgr2=0x7ffaf80bed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:07.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.195+0000 7ffaff3e8700 1 -- 172.21.15.117:0/1586766316 shutdown_connections 2023-07-19T20:45:07.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.195+0000 7ffaff3e8700 1 -- 172.21.15.117:0/1586766316 wait complete. 2023-07-19T20:45:07.195 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.196+0000 7ffaff3e8700 1 Processor -- start 2023-07-19T20:45:07.195 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.196+0000 7ffaff3e8700 1 -- start start 2023-07-19T20:45:07.195 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffaff3e8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf806c580 0x7ffaf81d6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.196 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffaff3e8700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffaf80b9800 0x7ffaf80bc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.196 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffaff3e8700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaf8144cf0 0x7ffaf80bcf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.196 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffaff3e8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf813f780 con 0x7ffaf806c580 2023-07-19T20:45:07.196 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffaff3e8700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf81d6c90 con 0x7ffaf8144cf0 2023-07-19T20:45:07.196 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffaff3e8700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80be3f0 con 0x7ffaf80b9800 2023-07-19T20:45:07.196 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffafd184700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf806c580 0x7ffaf81d6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.196 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffafd184700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf806c580 0x7ffaf81d6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51770/0 (socket says 172.21.15.117:51770) 2023-07-19T20:45:07.197 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffafd184700 1 -- 172.21.15.117:0/571945246 learned_addr learned my addr 172.21.15.117:0/571945246 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:07.197 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffafd985700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaf8144cf0 0x7ffaf80bcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.197 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffafc983700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffaf80b9800 0x7ffaf80bc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.197 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffafd184700 1 -- 172.21.15.117:0/571945246 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffaf80b9800 msgr2=0x7ffaf80bc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.197 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffafd184700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffaf80b9800 0x7ffaf80bc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.197 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffafd184700 1 -- 172.21.15.117:0/571945246 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaf8144cf0 msgr2=0x7ffaf80bcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.197 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffafd184700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaf8144cf0 0x7ffaf80bcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.197 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffafd184700 1 -- 172.21.15.117:0/571945246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf0009b30 con 0x7ffaf806c580 2023-07-19T20:45:07.198 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffafc983700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffaf80b9800 0x7ffaf80bc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:07.198 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffafd184700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf806c580 0x7ffaf81d6750 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffae800c480 tx=0x7ffae800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:07.198 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffaedffb700 1 -- 172.21.15.117:0/571945246 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae800cea0 con 0x7ffaf806c580 2023-07-19T20:45:07.198 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffaedffb700 1 -- 172.21.15.117:0/571945246 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae80052d0 con 0x7ffaf806c580 2023-07-19T20:45:07.198 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffaff3e8700 1 -- 172.21.15.117:0/571945246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf8140970 con 0x7ffaf806c580 2023-07-19T20:45:07.198 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.197+0000 7ffaedffb700 1 -- 172.21.15.117:0/571945246 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae8003680 con 0x7ffaf806c580 2023-07-19T20:45:07.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.198+0000 7ffaff3e8700 1 -- 172.21.15.117:0/571945246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf813f3a0 con 0x7ffaf806c580 2023-07-19T20:45:07.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.198+0000 7ffaff3e8700 1 -- 172.21.15.117:0/571945246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf8074890 con 0x7ffaf806c580 2023-07-19T20:45:07.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.199+0000 7ffaedffb700 1 -- 172.21.15.117:0/571945246 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7ffae80037e0 con 0x7ffaf806c580 2023-07-19T20:45:07.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.199+0000 7ffaedffb700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ffadc06a690 0x7ffadc06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.199+0000 7ffaedffb700 1 -- 172.21.15.117:0/571945246 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffae8087d20 con 0x7ffaf806c580 2023-07-19T20:45:07.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.200+0000 7ffafc983700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ffadc06a690 0x7ffadc06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.200+0000 7ffafc983700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ffadc06a690 0x7ffadc06cb40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffaf81d5340 tx=0x7ffaf4007dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:07.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.204+0000 7ffaedffb700 1 -- 172.21.15.117:0/571945246 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ffae80531b0 con 0x7ffaf806c580 2023-07-19T20:45:07.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.388+0000 7ffaff3e8700 1 -- 172.21.15.117:0/571945246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffaf80b8df0 con 0x7ffaf806c580 2023-07-19T20:45:07.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.388+0000 7ffaedffb700 1 -- 172.21.15.117:0/571945246 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffae80170a0 con 0x7ffaf806c580 2023-07-19T20:45:07.382 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 8 2023-07-19T20:45:07.384 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.390+0000 7ffaff3e8700 1 -- 172.21.15.117:0/571945246 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ffadc06a690 msgr2=0x7ffadc06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.390+0000 7ffaff3e8700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ffadc06a690 0x7ffadc06cb40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffaf81d5340 tx=0x7ffaf4007dd0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.390+0000 7ffaff3e8700 1 -- 172.21.15.117:0/571945246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf806c580 msgr2=0x7ffaf81d6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.390+0000 7ffaff3e8700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf806c580 0x7ffaf81d6750 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffae800c480 tx=0x7ffae800c790 comp rx=0 tx=0).stop 2023-07-19T20:45:07.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.390+0000 7ffaff3e8700 1 -- 172.21.15.117:0/571945246 shutdown_connections 2023-07-19T20:45:07.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.390+0000 7ffaff3e8700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ffadc06a690 0x7ffadc06cb40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.390+0000 7ffaff3e8700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaf8144cf0 0x7ffaf80bcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.390+0000 7ffaff3e8700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf806c580 0x7ffaf81d6750 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.390+0000 7ffaff3e8700 1 --2- 172.21.15.117:0/571945246 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffaf80b9800 0x7ffaf80bc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.387 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.390+0000 7ffaff3e8700 1 -- 172.21.15.117:0/571945246 >> 172.21.15.117:0/571945246 conn(0x7ffaf80be9c0 msgr2=0x7ffaf80ba980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:07.387 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.390+0000 7ffaff3e8700 1 -- 172.21.15.117:0/571945246 shutdown_connections 2023-07-19T20:45:07.387 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.391+0000 7ffaff3e8700 1 -- 172.21.15.117:0/571945246 wait complete. 2023-07-19T20:45:07.396 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-19T20:45:07.521 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.526+0000 7fdbbe635700 1 Processor -- start 2023-07-19T20:45:07.522 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.527+0000 7fdbbe635700 1 -- start start 2023-07-19T20:45:07.522 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.527+0000 7fdbbe635700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbb806a560 0x7fdbb80a0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.522 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.527+0000 7fdbbe635700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdbb80a2b60 0x7fdbb80ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.522 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.527+0000 7fdbbe635700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdbb80a0eb0 0x7fdbb80ba830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.522 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.527+0000 7fdbbe635700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb80bcda0 con 0x7fdbb80a0eb0 2023-07-19T20:45:07.522 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.527+0000 7fdbbe635700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb80b8490 con 0x7fdbb80a2b60 2023-07-19T20:45:07.523 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.527+0000 7fdbbe635700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb80b9ab0 con 0x7fdbb806a560 2023-07-19T20:45:07.523 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.527+0000 7fdbbcbd2700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdbb80a0eb0 0x7fdbb80ba830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.523 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.527+0000 7fdbbcbd2700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdbb80a0eb0 0x7fdbb80ba830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51782/0 (socket says 172.21.15.117:51782) 2023-07-19T20:45:07.523 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.527+0000 7fdbbcbd2700 1 -- 172.21.15.117:0/2237240887 learned_addr learned my addr 172.21.15.117:0/2237240887 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:07.523 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.527+0000 7fdbb7fff700 1 --2- 172.21.15.117:0/2237240887 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbb806a560 0x7fdbb80a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.527+0000 7fdbb77fe700 1 --2- 172.21.15.117:0/2237240887 >> v2:172.21.15.124:3300/0 conn(0x7fdbb80a2b60 0x7fdbb80ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbcbd2700 1 -- 172.21.15.117:0/2237240887 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbb806a560 msgr2=0x7fdbb80a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbcbd2700 1 --2- 172.21.15.117:0/2237240887 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbb806a560 0x7fdbb80a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbcbd2700 1 -- 172.21.15.117:0/2237240887 >> v2:172.21.15.124:3300/0 conn(0x7fdbb80a2b60 msgr2=0x7fdbb80ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbcbd2700 1 --2- 172.21.15.117:0/2237240887 >> v2:172.21.15.124:3300/0 conn(0x7fdbb80a2b60 0x7fdbb80ba2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbcbd2700 1 -- 172.21.15.117:0/2237240887 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb80b9560 con 0x7fdbb80a0eb0 2023-07-19T20:45:07.525 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbcbd2700 1 --2- 172.21.15.117:0/2237240887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbb80a0eb0 0x7fdbb80ba830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80bb370 tx=0x7fdbb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0dca7e349b558fe server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:07.525 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbb6ffd700 1 -- 172.21.15.117:0/2237240887 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb000e070 con 0x7fdbb80a0eb0 2023-07-19T20:45:07.525 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbb6ffd700 1 -- 172.21.15.117:0/2237240887 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb000b9c0 con 0x7fdbb80a0eb0 2023-07-19T20:45:07.525 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbb6ffd700 1 -- 172.21.15.117:0/2237240887 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb000bd70 con 0x7fdbb80a0eb0 2023-07-19T20:45:07.527 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbe635700 1 -- 172.21.15.117:0/2237240887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbb80a0eb0 msgr2=0x7fdbb80ba830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.528 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbe635700 1 --2- 172.21.15.117:0/2237240887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbb80a0eb0 0x7fdbb80ba830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80bb370 tx=0x7fdbb000b330 comp rx=0 tx=0).stop 2023-07-19T20:45:07.528 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbe635700 1 -- 172.21.15.117:0/2237240887 shutdown_connections 2023-07-19T20:45:07.528 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbe635700 1 --2- 172.21.15.117:0/2237240887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbb80a0eb0 0x7fdbb80ba830 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.528 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbe635700 1 --2- 172.21.15.117:0/2237240887 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbb806a560 0x7fdbb80a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.528 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbe635700 1 --2- 172.21.15.117:0/2237240887 >> v2:172.21.15.124:3300/0 conn(0x7fdbb80a2b60 0x7fdbb80ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.528 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbe635700 1 -- 172.21.15.117:0/2237240887 >> 172.21.15.117:0/2237240887 conn(0x7fdbb809f570 msgr2=0x7fdbb809f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:07.529 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbe635700 1 -- 172.21.15.117:0/2237240887 shutdown_connections 2023-07-19T20:45:07.529 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.528+0000 7fdbbe635700 1 -- 172.21.15.117:0/2237240887 wait complete. 2023-07-19T20:45:07.529 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.529+0000 7fdbbe635700 1 Processor -- start 2023-07-19T20:45:07.530 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.530+0000 7fdbbe635700 1 -- start start 2023-07-19T20:45:07.530 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.530+0000 7fdbbe635700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbb806a560 0x7fdbb81cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.530 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.530+0000 7fdbbe635700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbb80a0eb0 0x7fdbb81d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.530 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.530+0000 7fdbbe635700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb80a2b60 0x7fdbb81c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.530 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.530+0000 7fdbbe635700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb81ce530 con 0x7fdbb806a560 2023-07-19T20:45:07.531 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.530+0000 7fdbbe635700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb81cad90 con 0x7fdbb80a2b60 2023-07-19T20:45:07.531 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.530+0000 7fdbbe635700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb81cb070 con 0x7fdbb80a0eb0 2023-07-19T20:45:07.532 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.530+0000 7fdbb7fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbb806a560 0x7fdbb81cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.532 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.530+0000 7fdbb7fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbb806a560 0x7fdbb81cdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51792/0 (socket says 172.21.15.117:51792) 2023-07-19T20:45:07.532 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.530+0000 7fdbb7fff700 1 -- 172.21.15.117:0/3588579213 learned_addr learned my addr 172.21.15.117:0/3588579213 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:07.532 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.530+0000 7fdbb77fe700 1 --2- 172.21.15.117:0/3588579213 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbb80a0eb0 0x7fdbb81d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.532 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.530+0000 7fdbbcbd2700 1 --2- 172.21.15.117:0/3588579213 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb80a2b60 0x7fdbb81c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.532 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.531+0000 7fdbb7fff700 1 -- 172.21.15.117:0/3588579213 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbb80a0eb0 msgr2=0x7fdbb81d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.532 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.531+0000 7fdbb7fff700 1 --2- 172.21.15.117:0/3588579213 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbb80a0eb0 0x7fdbb81d49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.533 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.531+0000 7fdbb7fff700 1 -- 172.21.15.117:0/3588579213 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb80a2b60 msgr2=0x7fdbb81c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.533 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.531+0000 7fdbb7fff700 1 --2- 172.21.15.117:0/3588579213 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb80a2b60 0x7fdbb81c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.533 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.531+0000 7fdbb7fff700 1 -- 172.21.15.117:0/3588579213 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb0009b30 con 0x7fdbb806a560 2023-07-19T20:45:07.533 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.531+0000 7fdbb7fff700 1 --2- 172.21.15.117:0/3588579213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbb806a560 0x7fdbb81cdff0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdba800d800 tx=0x7fdba800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:07.533 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.531+0000 7fdbb4ff9700 1 -- 172.21.15.117:0/3588579213 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba80125f0 con 0x7fdbb806a560 2023-07-19T20:45:07.534 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.531+0000 7fdbb4ff9700 1 -- 172.21.15.117:0/3588579213 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba8012750 con 0x7fdbb806a560 2023-07-19T20:45:07.534 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.531+0000 7fdbbe635700 1 -- 172.21.15.117:0/3588579213 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb81d41f0 con 0x7fdbb806a560 2023-07-19T20:45:07.534 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.531+0000 7fdbb4ff9700 1 -- 172.21.15.117:0/3588579213 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8012ae0 con 0x7fdbb806a560 2023-07-19T20:45:07.534 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.531+0000 7fdbbe635700 1 -- 172.21.15.117:0/3588579213 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb81d3dd0 con 0x7fdbb806a560 2023-07-19T20:45:07.534 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.532+0000 7fdbbe635700 1 -- 172.21.15.117:0/3588579213 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb8067940 con 0x7fdbb806a560 2023-07-19T20:45:07.534 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.532+0000 7fdbb4ff9700 1 -- 172.21.15.117:0/3588579213 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fdba8012c40 con 0x7fdbb806a560 2023-07-19T20:45:07.534 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.533+0000 7fdbb4ff9700 1 --2- 172.21.15.117:0/3588579213 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdba406a660 0x7fdba406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.535 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.533+0000 7fdbb4ff9700 1 -- 172.21.15.117:0/3588579213 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdba80889f0 con 0x7fdbb806a560 2023-07-19T20:45:07.535 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.533+0000 7fdbb77fe700 1 --2- 172.21.15.117:0/3588579213 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdba406a660 0x7fdba406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.535 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.533+0000 7fdbb77fe700 1 --2- 172.21.15.117:0/3588579213 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdba406a660 0x7fdba406cb10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdbb81e45a0 tx=0x7fdbac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:07.536 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.537+0000 7fdbb4ff9700 1 -- 172.21.15.117:0/3588579213 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fdba8053e80 con 0x7fdbb806a560 2023-07-19T20:45:07.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.723+0000 7fdbbe635700 1 -- 172.21.15.117:0/3588579213 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdbb81cb1e0 con 0x7fdbb806a560 2023-07-19T20:45:07.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.723+0000 7fdbb4ff9700 1 -- 172.21.15.117:0/3588579213 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdba80574a0 con 0x7fdbb806a560 2023-07-19T20:45:07.717 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2023-07-19T20:45:07.720 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.725+0000 7fdbbe635700 1 -- 172.21.15.117:0/3588579213 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdba406a660 msgr2=0x7fdba406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.725+0000 7fdbbe635700 1 --2- 172.21.15.117:0/3588579213 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdba406a660 0x7fdba406cb10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdbb81e45a0 tx=0x7fdbac008040 comp rx=0 tx=0).stop 2023-07-19T20:45:07.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.725+0000 7fdbbe635700 1 -- 172.21.15.117:0/3588579213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbb806a560 msgr2=0x7fdbb81cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.726+0000 7fdbbe635700 1 --2- 172.21.15.117:0/3588579213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbb806a560 0x7fdbb81cdff0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdba800d800 tx=0x7fdba800db10 comp rx=0 tx=0).stop 2023-07-19T20:45:07.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.726+0000 7fdbbe635700 1 -- 172.21.15.117:0/3588579213 shutdown_connections 2023-07-19T20:45:07.722 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.726+0000 7fdbbe635700 1 --2- 172.21.15.117:0/3588579213 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdba406a660 0x7fdba406cb10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.722 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.726+0000 7fdbbe635700 1 --2- 172.21.15.117:0/3588579213 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb80a2b60 0x7fdbb81c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.722 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.726+0000 7fdbbe635700 1 --2- 172.21.15.117:0/3588579213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbb806a560 0x7fdbb81cdff0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.722 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.726+0000 7fdbbe635700 1 --2- 172.21.15.117:0/3588579213 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbb80a0eb0 0x7fdbb81d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.723 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.726+0000 7fdbbe635700 1 -- 172.21.15.117:0/3588579213 >> 172.21.15.117:0/3588579213 conn(0x7fdbb809f570 msgr2=0x7fdbb81cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:07.723 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.726+0000 7fdbbe635700 1 -- 172.21.15.117:0/3588579213 shutdown_connections 2023-07-19T20:45:07.723 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.726+0000 7fdbbe635700 1 -- 172.21.15.117:0/3588579213 wait complete. 2023-07-19T20:45:07.732 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-19T20:45:07.866 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.866+0000 7f7c50cda700 1 Processor -- start 2023-07-19T20:45:07.867 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.866+0000 7f7c50cda700 1 -- start start 2023-07-19T20:45:07.867 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c50cda700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7c4c0baa60 0x7f7c4c0b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.867 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c50cda700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7c4c0bca00 0x7f7c4c0bd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.867 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c50cda700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c4c14ddd0 0x7f7c4c144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.868 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c50cda700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4c0bdf10 con 0x7f7c4c0baa60 2023-07-19T20:45:07.868 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c50cda700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4c0bd540 con 0x7f7c4c0bca00 2023-07-19T20:45:07.868 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c50cda700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0b8d70 con 0x7f7c4c14ddd0 2023-07-19T20:45:07.868 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c4a59c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7c4c0baa60 0x7f7c4c0b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.868 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c4a59c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7c4c0baa60 0x7f7c4c0b7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51800/0 (socket says 172.21.15.117:51800) 2023-07-19T20:45:07.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c4a59c700 1 -- 172.21.15.117:0/3463832951 learned_addr learned my addr 172.21.15.117:0/3463832951 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:07.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c49d9b700 1 --2- 172.21.15.117:0/3463832951 >> v2:172.21.15.124:3300/0 conn(0x7f7c4c0bca00 0x7f7c4c0bd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c4ad9d700 1 --2- 172.21.15.117:0/3463832951 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c4c14ddd0 0x7f7c4c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c4a59c700 1 -- 172.21.15.117:0/3463832951 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c4c14ddd0 msgr2=0x7f7c4c144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:07.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c4a59c700 1 --2- 172.21.15.117:0/3463832951 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c4c14ddd0 0x7f7c4c144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c4a59c700 1 -- 172.21.15.117:0/3463832951 >> v2:172.21.15.124:3300/0 conn(0x7f7c4c0bca00 msgr2=0x7f7c4c0bd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:07.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c4a59c700 1 --2- 172.21.15.117:0/3463832951 >> v2:172.21.15.124:3300/0 conn(0x7f7c4c0bca00 0x7f7c4c0bd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.867+0000 7f7c4a59c700 1 -- 172.21.15.117:0/3463832951 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c0b8fe0 con 0x7f7c4c0baa60 2023-07-19T20:45:07.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.868+0000 7f7c4a59c700 1 --2- 172.21.15.117:0/3463832951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c4c0baa60 0x7f7c4c0b7f30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0b7b90 tx=0x7f7c3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c8ccd6e2dfafb8 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:07.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.868+0000 7f7c4959a700 1 -- 172.21.15.117:0/3463832951 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c011830 con 0x7f7c4c0baa60 2023-07-19T20:45:07.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.868+0000 7f7c4959a700 1 -- 172.21.15.117:0/3463832951 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c011990 con 0x7f7c4c0baa60 2023-07-19T20:45:07.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.868+0000 7f7c4959a700 1 -- 172.21.15.117:0/3463832951 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c011d20 con 0x7f7c4c0baa60 2023-07-19T20:45:07.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.868+0000 7f7c50cda700 1 -- 172.21.15.117:0/3463832951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c4c0baa60 msgr2=0x7f7c4c0b7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.868+0000 7f7c50cda700 1 --2- 172.21.15.117:0/3463832951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c4c0baa60 0x7f7c4c0b7f30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0b7b90 tx=0x7f7c3c009bd0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.868+0000 7f7c50cda700 1 -- 172.21.15.117:0/3463832951 shutdown_connections 2023-07-19T20:45:07.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.868+0000 7f7c50cda700 1 --2- 172.21.15.117:0/3463832951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c4c0baa60 0x7f7c4c0b7f30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.868+0000 7f7c50cda700 1 --2- 172.21.15.117:0/3463832951 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c4c14ddd0 0x7f7c4c144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.868+0000 7f7c50cda700 1 --2- 172.21.15.117:0/3463832951 >> v2:172.21.15.124:3300/0 conn(0x7f7c4c0bca00 0x7f7c4c0bd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.868+0000 7f7c50cda700 1 -- 172.21.15.117:0/3463832951 >> 172.21.15.117:0/3463832951 conn(0x7f7c4c071c90 msgr2=0x7f7c4c072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:07.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.868+0000 7f7c50cda700 1 -- 172.21.15.117:0/3463832951 shutdown_connections 2023-07-19T20:45:07.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.868+0000 7f7c50cda700 1 -- 172.21.15.117:0/3463832951 wait complete. 2023-07-19T20:45:07.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.870+0000 7f7c50cda700 1 Processor -- start 2023-07-19T20:45:07.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.870+0000 7f7c50cda700 1 -- start start 2023-07-19T20:45:07.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.870+0000 7f7c50cda700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c4c0baa60 0x7f7c4c147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.870+0000 7f7c50cda700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c4c0bca00 0x7f7c4c1d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.870+0000 7f7c50cda700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c4c14ddd0 0x7f7c4c1450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.870+0000 7f7c50cda700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c1d62d0 con 0x7f7c4c0baa60 2023-07-19T20:45:07.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.870+0000 7f7c50cda700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c1e4a90 con 0x7f7c4c14ddd0 2023-07-19T20:45:07.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.870+0000 7f7c50cda700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c1e4600 con 0x7f7c4c0bca00 2023-07-19T20:45:07.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.870+0000 7f7c4a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c4c0baa60 0x7f7c4c147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.870+0000 7f7c4a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c4c0baa60 0x7f7c4c147b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51808/0 (socket says 172.21.15.117:51808) 2023-07-19T20:45:07.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.870+0000 7f7c4a59c700 1 -- 172.21.15.117:0/1414051838 learned_addr learned my addr 172.21.15.117:0/1414051838 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:07.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.870+0000 7f7c49d9b700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c4c0bca00 0x7f7c4c1d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.870+0000 7f7c4ad9d700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c4c14ddd0 0x7f7c4c1450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.870+0000 7f7c4a59c700 1 -- 172.21.15.117:0/1414051838 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c4c0bca00 msgr2=0x7f7c4c1d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.871+0000 7f7c4a59c700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c4c0bca00 0x7f7c4c1d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.871+0000 7f7c4a59c700 1 -- 172.21.15.117:0/1414051838 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c4c14ddd0 msgr2=0x7f7c4c1450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:07.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.871+0000 7f7c4a59c700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c4c14ddd0 0x7f7c4c1450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:07.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.871+0000 7f7c4a59c700 1 -- 172.21.15.117:0/1414051838 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c009550 con 0x7f7c4c0baa60 2023-07-19T20:45:07.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.871+0000 7f7c49d9b700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c4c0bca00 0x7f7c4c1d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:07.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.871+0000 7f7c4ad9d700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c4c14ddd0 0x7f7c4c1450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:07.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.871+0000 7f7c4a59c700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c4c0baa60 0x7f7c4c147b70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c014040 tx=0x7f7c3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:07.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.871+0000 7f7c3affd700 1 -- 172.21.15.117:0/1414051838 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c004510 con 0x7f7c4c0baa60 2023-07-19T20:45:07.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.871+0000 7f7c3affd700 1 -- 172.21.15.117:0/1414051838 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c01e070 con 0x7f7c4c0baa60 2023-07-19T20:45:07.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.871+0000 7f7c50cda700 1 -- 172.21.15.117:0/1414051838 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4c1e3cd0 con 0x7f7c4c0baa60 2023-07-19T20:45:07.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.871+0000 7f7c3affd700 1 -- 172.21.15.117:0/1414051838 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0038e0 con 0x7f7c4c0baa60 2023-07-19T20:45:07.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.871+0000 7f7c50cda700 1 -- 172.21.15.117:0/1414051838 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4c1e4290 con 0x7f7c4c0baa60 2023-07-19T20:45:07.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.872+0000 7f7c50cda700 1 -- 172.21.15.117:0/1414051838 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4c1e48e0 con 0x7f7c4c0baa60 2023-07-19T20:45:07.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.872+0000 7f7c3affd700 1 -- 172.21.15.117:0/1414051838 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f7c3c003a40 con 0x7f7c4c0baa60 2023-07-19T20:45:07.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.873+0000 7f7c3affd700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7c2c06a660 0x7f7c2c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:07.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.873+0000 7f7c3affd700 1 -- 172.21.15.117:0/1414051838 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7c3c0899f0 con 0x7f7c4c0baa60 2023-07-19T20:45:07.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.873+0000 7f7c49d9b700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7c2c06a660 0x7f7c2c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:07.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.873+0000 7f7c49d9b700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7c2c06a660 0x7f7c2c06cb10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c1d5af0 tx=0x7f7c40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:07.877 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:07.877+0000 7f7c3affd700 1 -- 172.21.15.117:0/1414051838 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7c3c054e80 con 0x7f7c4c0baa60 2023-07-19T20:45:08.055 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.061+0000 7f7c50cda700 1 -- 172.21.15.117:0/1414051838 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c4c0b9800 con 0x7f7c4c0baa60 2023-07-19T20:45:08.056 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.061+0000 7f7c3affd700 1 -- 172.21.15.117:0/1414051838 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c3c020020 con 0x7f7c4c0baa60 2023-07-19T20:45:08.056 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2023-07-19T20:45:08.057 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.063+0000 7f7c50cda700 1 -- 172.21.15.117:0/1414051838 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7c2c06a660 msgr2=0x7f7c2c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:08.057 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.063+0000 7f7c50cda700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7c2c06a660 0x7f7c2c06cb10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c1d5af0 tx=0x7f7c40008040 comp rx=0 tx=0).stop 2023-07-19T20:45:08.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.063+0000 7f7c50cda700 1 -- 172.21.15.117:0/1414051838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c4c0baa60 msgr2=0x7f7c4c147b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:08.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.063+0000 7f7c50cda700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c4c0baa60 0x7f7c4c147b70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c014040 tx=0x7f7c3c004750 comp rx=0 tx=0).stop 2023-07-19T20:45:08.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.064+0000 7f7c50cda700 1 -- 172.21.15.117:0/1414051838 shutdown_connections 2023-07-19T20:45:08.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.064+0000 7f7c50cda700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7c2c06a660 0x7f7c2c06cb10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.064+0000 7f7c50cda700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c4c14ddd0 0x7f7c4c1450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.064+0000 7f7c50cda700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c4c0baa60 0x7f7c4c147b70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.064+0000 7f7c50cda700 1 --2- 172.21.15.117:0/1414051838 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c4c0bca00 0x7f7c4c1d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.059 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.064+0000 7f7c50cda700 1 -- 172.21.15.117:0/1414051838 >> 172.21.15.117:0/1414051838 conn(0x7f7c4c071c90 msgr2=0x7f7c4c0a67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:08.059 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.064+0000 7f7c50cda700 1 -- 172.21.15.117:0/1414051838 shutdown_connections 2023-07-19T20:45:08.059 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.064+0000 7f7c50cda700 1 -- 172.21.15.117:0/1414051838 wait complete. 2023-07-19T20:45:08.069 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-19T20:45:08.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.200+0000 7f0cda1d9700 1 Processor -- start 2023-07-19T20:45:08.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.200+0000 7f0cda1d9700 1 -- start start 2023-07-19T20:45:08.197 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.201+0000 7f0cda1d9700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0cd406a560 0x7f0cd40a0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.197 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.201+0000 7f0cda1d9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0cd40a0eb0 0x7f0cd40baa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.197 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.201+0000 7f0cda1d9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd40b8490 con 0x7f0cd40a2b60 2023-07-19T20:45:08.197 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.201+0000 7f0cda1d9700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd40bcda0 con 0x7f0cd406a560 2023-07-19T20:45:08.197 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.201+0000 7f0cda1d9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd40b9ab0 con 0x7f0cd40a0eb0 2023-07-19T20:45:08.198 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.201+0000 7f0cd2ffd700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f0cd40a2b60 0x7f0cd40ba2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:34410/0 (socket says 172.21.15.117:34410) 2023-07-19T20:45:08.198 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.201+0000 7f0cd2ffd700 1 -- 172.21.15.117:0/1704480445 learned_addr learned my addr 172.21.15.117:0/1704480445 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:08.198 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd3fff700 1 --2- 172.21.15.117:0/1704480445 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0cd40a0eb0 0x7f0cd40baa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.198 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 -- 172.21.15.117:0/1704480445 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100178352 0 0) 0x7f0cd40b8490 con 0x7f0cd40a2b60 2023-07-19T20:45:08.198 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd37fe700 1 --2- 172.21.15.117:0/1704480445 >> v2:172.21.15.124:3300/0 conn(0x7f0cd406a560 0x7f0cd40a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.198 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 -- 172.21.15.117:0/1704480445 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cbc0035b0 con 0x7f0cd40a2b60 2023-07-19T20:45:08.198 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 -- 172.21.15.117:0/1704480445 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 80257940 0 0) 0x7f0cbc0035b0 con 0x7f0cd40a2b60 2023-07-19T20:45:08.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 -- 172.21.15.117:0/1704480445 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0cd40a0eb0 msgr2=0x7f0cd40baa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:08.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 --2- 172.21.15.117:0/1704480445 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0cd40a0eb0 0x7f0cd40baa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 -- 172.21.15.117:0/1704480445 >> v2:172.21.15.124:3300/0 conn(0x7f0cd406a560 msgr2=0x7f0cd40a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:08.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 --2- 172.21.15.117:0/1704480445 >> v2:172.21.15.124:3300/0 conn(0x7f0cd406a560 0x7f0cd40a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 -- 172.21.15.117:0/1704480445 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd40b9560 con 0x7f0cd40a2b60 2023-07-19T20:45:08.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 -- 172.21.15.117:0/1704480445 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f0cc8001670 con 0x7f0cd40a2b60 2023-07-19T20:45:08.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 -- 172.21.15.117:0/1704480445 >> v1:172.21.15.117:6789/0 conn(0x7f0cd40a2b60 legacy=0x7f0cd40ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:08.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 --2- 172.21.15.117:0/1704480445 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0cd40a0eb0 0x7f0cbc003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 --2- 172.21.15.117:0/1704480445 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cbc003ff0 0x7f0cbc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 --2- 172.21.15.117:0/1704480445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cbc004d90 0x7f0cbc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 -- 172.21.15.117:0/1704480445 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd40bcda0 con 0x7f0cbc004d90 2023-07-19T20:45:08.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 -- 172.21.15.117:0/1704480445 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd40b9ab0 con 0x7f0cbc003ff0 2023-07-19T20:45:08.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd27fc700 1 -- 172.21.15.117:0/1704480445 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc00ba10 con 0x7f0cd40a0eb0 2023-07-19T20:45:08.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd3fff700 1 --2- 172.21.15.117:0/1704480445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cbc004d90 0x7f0cbc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd2ffd700 1 --2- 172.21.15.117:0/1704480445 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cbc003ff0 0x7f0cbc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.201 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd37fe700 1 --2- 172.21.15.117:0/1704480445 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0cd40a0eb0 0x7f0cbc003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.201 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd3fff700 1 -- 172.21.15.117:0/1704480445 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0cd40a0eb0 msgr2=0x7f0cbc003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:08.201 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd3fff700 1 --2- 172.21.15.117:0/1704480445 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0cd40a0eb0 0x7f0cbc003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.201 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd3fff700 1 -- 172.21.15.117:0/1704480445 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cbc003ff0 msgr2=0x7f0cbc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:08.201 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd3fff700 1 --2- 172.21.15.117:0/1704480445 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cbc003ff0 0x7f0cbc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.201 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd3fff700 1 -- 172.21.15.117:0/1704480445 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc0035b0 con 0x7f0cbc004d90 2023-07-19T20:45:08.201 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.202+0000 7f0cd3fff700 1 --2- 172.21.15.117:0/1704480445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cbc004d90 0x7f0cbc005200 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009b30 tx=0x7f0cbc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6187607a7af904 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:08.201 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.203+0000 7f0cd27fc700 1 -- 172.21.15.117:0/1704480445 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc00e6c0 con 0x7f0cbc004d90 2023-07-19T20:45:08.202 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.203+0000 7f0cd27fc700 1 -- 172.21.15.117:0/1704480445 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc00e820 con 0x7f0cbc004d90 2023-07-19T20:45:08.202 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.203+0000 7f0cd27fc700 1 -- 172.21.15.117:0/1704480445 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc00eb90 con 0x7f0cbc004d90 2023-07-19T20:45:08.202 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.203+0000 7f0cda1d9700 1 -- 172.21.15.117:0/1704480445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cbc004d90 msgr2=0x7f0cbc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:08.202 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.203+0000 7f0cda1d9700 1 --2- 172.21.15.117:0/1704480445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cbc004d90 0x7f0cbc005200 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009b30 tx=0x7f0cbc005880 comp rx=0 tx=0).stop 2023-07-19T20:45:08.202 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.203+0000 7f0cd3fff700 1 -- 172.21.15.117:0/1704480445 reap_dead start 2023-07-19T20:45:08.202 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.203+0000 7f0cda1d9700 1 -- 172.21.15.117:0/1704480445 shutdown_connections 2023-07-19T20:45:08.202 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.203+0000 7f0cda1d9700 1 -- 172.21.15.117:0/1704480445 >> 172.21.15.117:0/1704480445 conn(0x7f0cd409f570 msgr2=0x7f0cd409f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:08.203 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.203+0000 7f0cda1d9700 1 -- 172.21.15.117:0/1704480445 shutdown_connections 2023-07-19T20:45:08.203 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.203+0000 7f0cda1d9700 1 -- 172.21.15.117:0/1704480445 wait complete. 2023-07-19T20:45:08.205 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.205+0000 7f0cda1d9700 1 Processor -- start 2023-07-19T20:45:08.205 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.205+0000 7f0cda1d9700 1 -- start start 2023-07-19T20:45:08.205 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cda1d9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cbc004d90 0x7f0cd41d2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.205 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cda1d9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0cd406db70 0x7f0cd406c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.206 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cda1d9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cd406cc70 0x7f0cd41c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.206 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cda1d9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd41d2770 con 0x7f0cbc004d90 2023-07-19T20:45:08.206 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cda1d9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd41d4e00 con 0x7f0cd406cc70 2023-07-19T20:45:08.206 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cda1d9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd406e030 con 0x7f0cd406db70 2023-07-19T20:45:08.206 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cd37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cbc004d90 0x7f0cd41d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.206 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cd37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cbc004d90 0x7f0cd41d2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51830/0 (socket says 172.21.15.117:51830) 2023-07-19T20:45:08.206 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cd37fe700 1 -- 172.21.15.117:0/4287428399 learned_addr learned my addr 172.21.15.117:0/4287428399 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:08.206 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cd37fe700 1 -- 172.21.15.117:0/4287428399 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0cd406db70 msgr2=0x7f0cd406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:08.207 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cd3fff700 1 --2- 172.21.15.117:0/4287428399 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cd406cc70 0x7f0cd41c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.207 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cd2ffd700 1 --2- 172.21.15.117:0/4287428399 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0cd406db70 0x7f0cd406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.207 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cd37fe700 1 --2- 172.21.15.117:0/4287428399 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0cd406db70 0x7f0cd406c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.207 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cd37fe700 1 -- 172.21.15.117:0/4287428399 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cd406cc70 msgr2=0x7f0cd41c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:08.207 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cd37fe700 1 --2- 172.21.15.117:0/4287428399 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cd406cc70 0x7f0cd41c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.207 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cd37fe700 1 -- 172.21.15.117:0/4287428399 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd41d2aa0 con 0x7f0cbc004d90 2023-07-19T20:45:08.207 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cd37fe700 1 --2- 172.21.15.117:0/4287428399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cbc004d90 0x7f0cd41d2230 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4011e60 tx=0x7f0cc400f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:08.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cbbfff700 1 -- 172.21.15.117:0/4287428399 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc400e040 con 0x7f0cbc004d90 2023-07-19T20:45:08.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cbbfff700 1 -- 172.21.15.117:0/4287428399 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc400f040 con 0x7f0cbc004d90 2023-07-19T20:45:08.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cda1d9700 1 -- 172.21.15.117:0/4287428399 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd41d5050 con 0x7f0cbc004d90 2023-07-19T20:45:08.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cbbfff700 1 -- 172.21.15.117:0/4287428399 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4015650 con 0x7f0cbc004d90 2023-07-19T20:45:08.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.206+0000 7f0cda1d9700 1 -- 172.21.15.117:0/4287428399 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd41d2e60 con 0x7f0cbc004d90 2023-07-19T20:45:08.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.207+0000 7f0cda1d9700 1 -- 172.21.15.117:0/4287428399 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd41d5290 con 0x7f0cbc004d90 2023-07-19T20:45:08.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.208+0000 7f0cbbfff700 1 -- 172.21.15.117:0/4287428399 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f0cc40157b0 con 0x7f0cbc004d90 2023-07-19T20:45:08.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.208+0000 7f0cbbfff700 1 --2- 172.21.15.117:0/4287428399 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f0cc006a690 0x7f0cc006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.209 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.208+0000 7f0cbbfff700 1 -- 172.21.15.117:0/4287428399 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0cc4089710 con 0x7f0cbc004d90 2023-07-19T20:45:08.209 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.208+0000 7f0cd2ffd700 1 --2- 172.21.15.117:0/4287428399 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f0cc006a690 0x7f0cc006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.209 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.208+0000 7f0cd2ffd700 1 --2- 172.21.15.117:0/4287428399 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f0cc006a690 0x7f0cc006cb40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0cd409f240 tx=0x7f0cc8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:08.209 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.212+0000 7f0cbbfff700 1 -- 172.21.15.117:0/4287428399 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f0cc4054b10 con 0x7f0cbc004d90 2023-07-19T20:45:08.390 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.397+0000 7f0cda1d9700 1 -- 172.21.15.117:0/4287428399 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0cd406b040 con 0x7f0cbc004d90 2023-07-19T20:45:08.391 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.397+0000 7f0cbbfff700 1 -- 172.21.15.117:0/4287428399 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0cc4058130 con 0x7f0cbc004d90 2023-07-19T20:45:08.391 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 64 2023-07-19T20:45:08.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.399+0000 7f0cda1d9700 1 -- 172.21.15.117:0/4287428399 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f0cc006a690 msgr2=0x7f0cc006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:08.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.399+0000 7f0cda1d9700 1 --2- 172.21.15.117:0/4287428399 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f0cc006a690 0x7f0cc006cb40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0cd409f240 tx=0x7f0cc8009040 comp rx=0 tx=0).stop 2023-07-19T20:45:08.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.399+0000 7f0cda1d9700 1 -- 172.21.15.117:0/4287428399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cbc004d90 msgr2=0x7f0cd41d2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:08.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.399+0000 7f0cda1d9700 1 --2- 172.21.15.117:0/4287428399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cbc004d90 0x7f0cd41d2230 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4011e60 tx=0x7f0cc400f490 comp rx=0 tx=0).stop 2023-07-19T20:45:08.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.399+0000 7f0cda1d9700 1 -- 172.21.15.117:0/4287428399 shutdown_connections 2023-07-19T20:45:08.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.399+0000 7f0cda1d9700 1 --2- 172.21.15.117:0/4287428399 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f0cc006a690 0x7f0cc006cb40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.393 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.399+0000 7f0cda1d9700 1 --2- 172.21.15.117:0/4287428399 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cd406cc70 0x7f0cd41c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.399+0000 7f0cda1d9700 1 --2- 172.21.15.117:0/4287428399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cbc004d90 0x7f0cd41d2230 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.399+0000 7f0cda1d9700 1 --2- 172.21.15.117:0/4287428399 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0cd406db70 0x7f0cd406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.399+0000 7f0cda1d9700 1 -- 172.21.15.117:0/4287428399 >> 172.21.15.117:0/4287428399 conn(0x7f0cd409f570 msgr2=0x7f0cd406a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:08.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.399+0000 7f0cda1d9700 1 -- 172.21.15.117:0/4287428399 shutdown_connections 2023-07-19T20:45:08.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.399+0000 7f0cda1d9700 1 -- 172.21.15.117:0/4287428399 wait complete. 2023-07-19T20:45:08.405 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-19T20:45:08.528 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.533+0000 7f1200d17700 1 Processor -- start 2023-07-19T20:45:08.528 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.533+0000 7f1200d17700 1 -- start start 2023-07-19T20:45:08.529 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f1200d17700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f11fc0bb470 0x7f11fc14af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.529 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f1200d17700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11fc0bc7f0 0x7f11fc14b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.529 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f1200d17700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc0ba1f0 con 0x7f11fc0a3c90 2023-07-19T20:45:08.529 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f1200d17700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11fc0ba430 con 0x7f11fc0bb470 2023-07-19T20:45:08.529 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f1200d17700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0ba710 con 0x7f11fc0bc7f0 2023-07-19T20:45:08.529 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f11fa59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f11fc0bb470 0x7f11fc14af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.529 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f11fad9d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11fc0bc7f0 0x7f11fc14b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.530 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f11fa59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f11fc0bb470 0x7f11fc14af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:55876/0 (socket says 172.21.15.117:55876) 2023-07-19T20:45:08.530 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f11f9d9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f11fc0a3c90 0x7f11fc14df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.117:39158/0 (socket says 172.21.15.117:39158) 2023-07-19T20:45:08.530 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f11fa59c700 1 -- 172.21.15.117:0/1063790819 learned_addr learned my addr 172.21.15.117:0/1063790819 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:08.530 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f11fa59c700 1 -- 172.21.15.117:0/1063790819 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11fc0bc7f0 msgr2=0x7f11fc14b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:08.530 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f11fa59c700 1 --2- 172.21.15.117:0/1063790819 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11fc0bc7f0 0x7f11fc14b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.530 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f11fa59c700 1 -- 172.21.15.117:0/1063790819 >> v1:172.21.15.124:6789/0 conn(0x7f11fc0a3c90 legacy=0x7f11fc14df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:08.531 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f11fa59c700 1 -- 172.21.15.117:0/1063790819 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0ba9f0 con 0x7f11fc0bb470 2023-07-19T20:45:08.531 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f11f959a700 1 -- 172.21.15.117:0/1063790819 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773761022 0 0) 0x7f11f0001110 con 0x7f11fc0a3c90 2023-07-19T20:45:08.531 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.534+0000 7f11fad9d700 1 --2- 172.21.15.117:0/1063790819 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11fc0bc7f0 0x7f11fc14b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:45:08.531 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.535+0000 7f11fa59c700 1 --2- 172.21.15.117:0/1063790819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11fc0bb470 0x7f11fc14af70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0098f0 tx=0x7f11ec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b3d7028b0297f93 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:08.531 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.535+0000 7f11f959a700 1 -- 172.21.15.117:0/1063790819 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec011830 con 0x7f11fc0bb470 2023-07-19T20:45:08.531 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.535+0000 7f11f959a700 1 -- 172.21.15.117:0/1063790819 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec011990 con 0x7f11fc0bb470 2023-07-19T20:45:08.531 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.535+0000 7f11f959a700 1 -- 172.21.15.117:0/1063790819 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec011d20 con 0x7f11fc0bb470 2023-07-19T20:45:08.534 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.535+0000 7f1200d17700 1 -- 172.21.15.117:0/1063790819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11fc0bb470 msgr2=0x7f11fc14af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:08.534 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.535+0000 7f1200d17700 1 --2- 172.21.15.117:0/1063790819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11fc0bb470 0x7f11fc14af70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0098f0 tx=0x7f11ec009c00 comp rx=0 tx=0).stop 2023-07-19T20:45:08.534 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.535+0000 7f1200d17700 1 -- 172.21.15.117:0/1063790819 shutdown_connections 2023-07-19T20:45:08.535 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.535+0000 7f1200d17700 1 --2- 172.21.15.117:0/1063790819 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11fc0bc7f0 0x7f11fc14b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.535 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.535+0000 7f1200d17700 1 --2- 172.21.15.117:0/1063790819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11fc0bb470 0x7f11fc14af70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.535 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.535+0000 7f1200d17700 1 -- 172.21.15.117:0/1063790819 >> 172.21.15.117:0/1063790819 conn(0x7f11fc0a0660 msgr2=0x7f11fc0a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:08.535 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.535+0000 7f1200d17700 1 -- 172.21.15.117:0/1063790819 shutdown_connections 2023-07-19T20:45:08.535 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.535+0000 7f1200d17700 1 -- 172.21.15.117:0/1063790819 wait complete. 2023-07-19T20:45:08.535 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.536+0000 7f1200d17700 1 Processor -- start 2023-07-19T20:45:08.536 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.537+0000 7f1200d17700 1 -- start start 2023-07-19T20:45:08.536 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.537+0000 7f1200d17700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11fc0a3c90 0x7f11fc09f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.536 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.537+0000 7f1200d17700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11fc0bb470 0x7f11fc1e3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.536 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.537+0000 7f1200d17700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11fc0bc7f0 0x7f11fc138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.536 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.537+0000 7f1200d17700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc09f930 con 0x7f11fc0bc7f0 2023-07-19T20:45:08.536 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.537+0000 7f1200d17700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc146bd0 con 0x7f11fc0bb470 2023-07-19T20:45:08.536 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.537+0000 7f1200d17700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc147a00 con 0x7f11fc0a3c90 2023-07-19T20:45:08.537 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.537+0000 7f11fad9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11fc0bc7f0 0x7f11fc138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.537 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.537+0000 7f11fad9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11fc0bc7f0 0x7f11fc138d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51838/0 (socket says 172.21.15.117:51838) 2023-07-19T20:45:08.537 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.537+0000 7f11fad9d700 1 -- 172.21.15.117:0/2206330349 learned_addr learned my addr 172.21.15.117:0/2206330349 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:08.537 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.537+0000 7f11f9d9b700 1 --2- 172.21.15.117:0/2206330349 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11fc0bb470 0x7f11fc1e3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.537 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.537+0000 7f11fa59c700 1 --2- 172.21.15.117:0/2206330349 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11fc0a3c90 0x7f11fc09f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.537 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.538+0000 7f11fad9d700 1 -- 172.21.15.117:0/2206330349 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11fc0a3c90 msgr2=0x7f11fc09f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:08.537 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.538+0000 7f11fad9d700 1 --2- 172.21.15.117:0/2206330349 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11fc0a3c90 0x7f11fc09f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.538 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.538+0000 7f11fad9d700 1 -- 172.21.15.117:0/2206330349 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11fc0bb470 msgr2=0x7f11fc1e3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:08.538 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.538+0000 7f11fad9d700 1 --2- 172.21.15.117:0/2206330349 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11fc0bb470 0x7f11fc1e3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.538 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.538+0000 7f11fad9d700 1 -- 172.21.15.117:0/2206330349 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f4009a70 con 0x7f11fc0bc7f0 2023-07-19T20:45:08.538 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.538+0000 7f11fad9d700 1 --2- 172.21.15.117:0/2206330349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11fc0bc7f0 0x7f11fc138d60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f11f400efc0 tx=0x7f11f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:08.538 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.538+0000 7f11eaffd700 1 -- 172.21.15.117:0/2206330349 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f400ca90 con 0x7f11fc0bc7f0 2023-07-19T20:45:08.538 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.538+0000 7f11eaffd700 1 -- 172.21.15.117:0/2206330349 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f400f040 con 0x7f11fc0bc7f0 2023-07-19T20:45:08.538 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.538+0000 7f1200d17700 1 -- 172.21.15.117:0/2206330349 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ec009550 con 0x7f11fc0bc7f0 2023-07-19T20:45:08.539 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.538+0000 7f11eaffd700 1 -- 172.21.15.117:0/2206330349 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f400ce30 con 0x7f11fc0bc7f0 2023-07-19T20:45:08.539 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.538+0000 7f1200d17700 1 -- 172.21.15.117:0/2206330349 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11fc14a4e0 con 0x7f11fc0bc7f0 2023-07-19T20:45:08.539 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.539+0000 7f1200d17700 1 -- 172.21.15.117:0/2206330349 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11fc0729d0 con 0x7f11fc0bc7f0 2023-07-19T20:45:08.539 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.539+0000 7f11eaffd700 1 -- 172.21.15.117:0/2206330349 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f11f4014480 con 0x7f11fc0bc7f0 2023-07-19T20:45:08.539 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.540+0000 7f11eaffd700 1 --2- 172.21.15.117:0/2206330349 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f11dc06a660 0x7f11dc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:08.539 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.540+0000 7f11eaffd700 1 -- 172.21.15.117:0/2206330349 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f11f40890e0 con 0x7f11fc0bc7f0 2023-07-19T20:45:08.540 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.540+0000 7f11fa59c700 1 --2- 172.21.15.117:0/2206330349 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f11dc06a660 0x7f11dc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:08.541 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.540+0000 7f11fa59c700 1 --2- 172.21.15.117:0/2206330349 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f11dc06a660 0x7f11dc06cb10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009c40 tx=0x7f11ec008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:08.542 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.544+0000 7f11eaffd700 1 -- 172.21.15.117:0/2206330349 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f11f40544e0 con 0x7f11fc0bc7f0 2023-07-19T20:45:08.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.744+0000 7f1200d17700 1 -- 172.21.15.117:0/2206330349 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f11fc146d40 con 0x7f11fc0bc7f0 2023-07-19T20:45:08.738 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.744+0000 7f11eaffd700 1 -- 172.21.15.117:0/2206330349 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f11f4057b00 con 0x7f11fc0bc7f0 2023-07-19T20:45:08.740 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.746+0000 7f1200d17700 1 -- 172.21.15.117:0/2206330349 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f11dc06a660 msgr2=0x7f11dc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:08.740 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.746+0000 7f1200d17700 1 --2- 172.21.15.117:0/2206330349 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f11dc06a660 0x7f11dc06cb10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009c40 tx=0x7f11ec008030 comp rx=0 tx=0).stop 2023-07-19T20:45:08.741 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.746+0000 7f1200d17700 1 -- 172.21.15.117:0/2206330349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11fc0bc7f0 msgr2=0x7f11fc138d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:08.741 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.746+0000 7f1200d17700 1 --2- 172.21.15.117:0/2206330349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11fc0bc7f0 0x7f11fc138d60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f11f400efc0 tx=0x7f11f400c3a0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.741 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.746+0000 7f1200d17700 1 -- 172.21.15.117:0/2206330349 shutdown_connections 2023-07-19T20:45:08.741 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.746+0000 7f1200d17700 1 --2- 172.21.15.117:0/2206330349 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f11dc06a660 0x7f11dc06cb10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.741 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.746+0000 7f1200d17700 1 --2- 172.21.15.117:0/2206330349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11fc0bc7f0 0x7f11fc138d60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.741 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.746+0000 7f1200d17700 1 --2- 172.21.15.117:0/2206330349 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f11fc0a3c90 0x7f11fc09f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.741 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.746+0000 7f1200d17700 1 --2- 172.21.15.117:0/2206330349 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f11fc0bb470 0x7f11fc1e3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:08.742 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.746+0000 7f1200d17700 1 -- 172.21.15.117:0/2206330349 >> 172.21.15.117:0/2206330349 conn(0x7f11fc0a0660 msgr2=0x7f11fc0bd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:08.742 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.746+0000 7f1200d17700 1 -- 172.21.15.117:0/2206330349 shutdown_connections 2023-07-19T20:45:08.742 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:08.746+0000 7f1200d17700 1 -- 172.21.15.117:0/2206330349 wait complete. 2023-07-19T20:45:08.742 INFO:teuthology.orchestra.run.smithi117.stderr:listed 0 entries 2023-07-19T20:45:08.754 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-19T20:45:08.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:08.755 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-19T20:45:08.850 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-07-19T20:45:08.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:08.851 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-19T20:45:08.912 INFO:tasks.cephfs.cephfs_test_case:[] 2023-07-19T20:45:08.913 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-19T20:45:09.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.040+0000 7f6b37494700 1 Processor -- start 2023-07-19T20:45:09.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.040+0000 7f6b37494700 1 -- start start 2023-07-19T20:45:09.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.041+0000 7f6b37494700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b3006baf0 0x7f6b30070110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.041+0000 7f6b37494700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b3006f560 0x7f6b301518c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.041+0000 7f6b37494700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b300b8a70 con 0x7f6b301447e0 2023-07-19T20:45:09.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.041+0000 7f6b37494700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b30070db0 con 0x7f6b3006baf0 2023-07-19T20:45:09.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.041+0000 7f6b37494700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3006b6a0 con 0x7f6b3006f560 2023-07-19T20:45:09.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.042+0000 7f6b34a2f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b3006baf0 0x7f6b30070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.042+0000 7f6b34a2f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b3006baf0 0x7f6b30070110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51848/0 (socket says 172.21.15.117:51848) 2023-07-19T20:45:09.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.042+0000 7f6b34a2f700 1 -- 172.21.15.117:0/2915910420 learned_addr learned my addr 172.21.15.117:0/2915910420 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:09.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.042+0000 7f6b35a31700 1 --2- 172.21.15.117:0/2915910420 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b3006f560 0x7f6b301518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.042+0000 7f6b34a2f700 1 -- 172.21.15.117:0/2915910420 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b3006f560 msgr2=0x7f6b301518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:09.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.042+0000 7f6b34a2f700 1 --2- 172.21.15.117:0/2915910420 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b3006f560 0x7f6b301518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.042+0000 7f6b34a2f700 1 -- 172.21.15.117:0/2915910420 >> v1:172.21.15.124:6789/0 conn(0x7f6b301447e0 legacy=0x7f6b300b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.042+0000 7f6b34a2f700 1 -- 172.21.15.117:0/2915910420 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b30072210 con 0x7f6b3006baf0 2023-07-19T20:45:09.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.042+0000 7f6b34a2f700 1 --2- 172.21.15.117:0/2915910420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b3006baf0 0x7f6b30070110 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6b200098f0 tx=0x7f6b20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9d0c5100b67846 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:09.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.042+0000 7f6b27fff700 1 -- 172.21.15.117:0/2915910420 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20011830 con 0x7f6b3006baf0 2023-07-19T20:45:09.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.042+0000 7f6b27fff700 1 -- 172.21.15.117:0/2915910420 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b20011990 con 0x7f6b3006baf0 2023-07-19T20:45:09.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.042+0000 7f6b27fff700 1 -- 172.21.15.117:0/2915910420 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20011d20 con 0x7f6b3006baf0 2023-07-19T20:45:09.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.043+0000 7f6b37494700 1 -- 172.21.15.117:0/2915910420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b3006baf0 msgr2=0x7f6b30070110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.043+0000 7f6b37494700 1 --2- 172.21.15.117:0/2915910420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b3006baf0 0x7f6b30070110 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6b200098f0 tx=0x7f6b20009c00 comp rx=0 tx=0).stop 2023-07-19T20:45:09.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.043+0000 7f6b37494700 1 -- 172.21.15.117:0/2915910420 shutdown_connections 2023-07-19T20:45:09.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.043+0000 7f6b37494700 1 --2- 172.21.15.117:0/2915910420 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b3006f560 0x7f6b301518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.043+0000 7f6b37494700 1 --2- 172.21.15.117:0/2915910420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b3006baf0 0x7f6b30070110 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.043+0000 7f6b37494700 1 -- 172.21.15.117:0/2915910420 >> 172.21.15.117:0/2915910420 conn(0x7f6b300bdc00 msgr2=0x7f6b300b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:09.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.043+0000 7f6b37494700 1 -- 172.21.15.117:0/2915910420 shutdown_connections 2023-07-19T20:45:09.041 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.043+0000 7f6b37494700 1 -- 172.21.15.117:0/2915910420 wait complete. 2023-07-19T20:45:09.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.044+0000 7f6b37494700 1 Processor -- start 2023-07-19T20:45:09.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.044+0000 7f6b37494700 1 -- start start 2023-07-19T20:45:09.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b37494700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b3006baf0 0x7f6b30145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b37494700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b3006f560 0x7f6b301e0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b37494700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b301447e0 0x7f6b301e14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b37494700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b30147b40 con 0x7f6b3006f560 2023-07-19T20:45:09.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b37494700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b30140410 con 0x7f6b301447e0 2023-07-19T20:45:09.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b37494700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3014a210 con 0x7f6b3006baf0 2023-07-19T20:45:09.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b34a2f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b3006f560 0x7f6b301e0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b34a2f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b3006f560 0x7f6b301e0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51864/0 (socket says 172.21.15.117:51864) 2023-07-19T20:45:09.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b34a2f700 1 -- 172.21.15.117:0/2376657537 learned_addr learned my addr 172.21.15.117:0/2376657537 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:09.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b35230700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b3006baf0 0x7f6b30145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b35a31700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b301447e0 0x7f6b301e14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b34a2f700 1 -- 172.21.15.117:0/2376657537 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b3006baf0 msgr2=0x7f6b30145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b34a2f700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b3006baf0 0x7f6b30145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b34a2f700 1 -- 172.21.15.117:0/2376657537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b301447e0 msgr2=0x7f6b301e14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b34a2f700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b301447e0 0x7f6b301e14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b34a2f700 1 -- 172.21.15.117:0/2376657537 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b20009550 con 0x7f6b3006f560 2023-07-19T20:45:09.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.045+0000 7f6b35a31700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b301447e0 0x7f6b301e14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:09.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.046+0000 7f6b34a2f700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b3006f560 0x7f6b301e0fa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6b20000c00 tx=0x7f6b20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:09.047 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.046+0000 7f6b25ffb700 1 -- 172.21.15.117:0/2376657537 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20004480 con 0x7f6b3006f560 2023-07-19T20:45:09.047 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.046+0000 7f6b25ffb700 1 -- 172.21.15.117:0/2376657537 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2001f070 con 0x7f6b3006f560 2023-07-19T20:45:09.047 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.046+0000 7f6b37494700 1 -- 172.21.15.117:0/2376657537 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b30152500 con 0x7f6b3006f560 2023-07-19T20:45:09.047 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.046+0000 7f6b25ffb700 1 -- 172.21.15.117:0/2376657537 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b200038e0 con 0x7f6b3006f560 2023-07-19T20:45:09.047 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.046+0000 7f6b37494700 1 -- 172.21.15.117:0/2376657537 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b301e1a20 con 0x7f6b3006f560 2023-07-19T20:45:09.047 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.047+0000 7f6b37494700 1 -- 172.21.15.117:0/2376657537 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b30067940 con 0x7f6b3006f560 2023-07-19T20:45:09.047 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.047+0000 7f6b25ffb700 1 -- 172.21.15.117:0/2376657537 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f6b20021030 con 0x7f6b3006f560 2023-07-19T20:45:09.047 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.048+0000 7f6b25ffb700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f6b1406a660 0x7f6b1406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.048 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.048+0000 7f6b25ffb700 1 -- 172.21.15.117:0/2376657537 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b20089e20 con 0x7f6b3006f560 2023-07-19T20:45:09.048 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.048+0000 7f6b35230700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f6b1406a660 0x7f6b1406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.048 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.048+0000 7f6b35230700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f6b1406a660 0x7f6b1406cb10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c007fd0 tx=0x7f6b2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:09.049 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.052+0000 7f6b25ffb700 1 -- 172.21.15.117:0/2376657537 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f6b200552b0 con 0x7f6b3006f560 2023-07-19T20:45:09.275 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.282+0000 7f6b37494700 1 -- 172.21.15.117:0/2376657537 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b301431b0 con 0x7f6b3006f560 2023-07-19T20:45:09.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.282+0000 7f6b25ffb700 1 -- 172.21.15.117:0/2376657537 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3892 (secure 0 0 0) 0x7f6b20015020 con 0x7f6b3006f560 2023-07-19T20:45:09.276 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:09.277 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6833/1121968339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":1121968339},{"type":"v1","addr":"172.21.15.124:6833","nonce":1121968339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3740070710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3740070710},{"type":"v1","addr":"172.21.15.117:6835","nonce":3740070710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-19T20:44:38.547955+0000","modified":"2023-07-19T20:44:41.558655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/479216080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":479216080},{"type":"v1","addr":"172.21.15.117:6837","nonce":479216080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-19T20:45:09.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.284+0000 7f6b37494700 1 -- 172.21.15.117:0/2376657537 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f6b1406a660 msgr2=0x7f6b1406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.284+0000 7f6b37494700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f6b1406a660 0x7f6b1406cb10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c007fd0 tx=0x7f6b2c009040 comp rx=0 tx=0).stop 2023-07-19T20:45:09.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.284+0000 7f6b37494700 1 -- 172.21.15.117:0/2376657537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b3006f560 msgr2=0x7f6b301e0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.284+0000 7f6b37494700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b3006f560 0x7f6b301e0fa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6b20000c00 tx=0x7f6b20004750 comp rx=0 tx=0).stop 2023-07-19T20:45:09.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.284+0000 7f6b37494700 1 -- 172.21.15.117:0/2376657537 shutdown_connections 2023-07-19T20:45:09.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.284+0000 7f6b37494700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f6b1406a660 0x7f6b1406cb10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.284+0000 7f6b37494700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b301447e0 0x7f6b301e14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.284+0000 7f6b37494700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b3006baf0 0x7f6b30145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.284+0000 7f6b37494700 1 --2- 172.21.15.117:0/2376657537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b3006f560 0x7f6b301e0fa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.284+0000 7f6b37494700 1 -- 172.21.15.117:0/2376657537 >> 172.21.15.117:0/2376657537 conn(0x7f6b300bdc00 msgr2=0x7f6b301436d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:09.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.284+0000 7f6b37494700 1 -- 172.21.15.117:0/2376657537 shutdown_connections 2023-07-19T20:45:09.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.284+0000 7f6b37494700 1 -- 172.21.15.117:0/2376657537 wait complete. 2023-07-19T20:45:09.286 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 8 2023-07-19T20:45:09.290 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:45:09.411 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.418+0000 7f0e584b0700 1 Processor -- start 2023-07-19T20:45:09.412 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.418+0000 7f0e584b0700 1 -- start start 2023-07-19T20:45:09.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.419+0000 7f0e584b0700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e5014e0a0 0x7f0e5009edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.419+0000 7f0e584b0700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0e500bc0f0 0x7f0e500bc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.415 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.419+0000 7f0e584b0700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5009ff20 con 0x7f0e5006a8d0 2023-07-19T20:45:09.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.419+0000 7f0e584b0700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e500bcab0 con 0x7f0e500bc0f0 2023-07-19T20:45:09.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.419+0000 7f0e584b0700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5009f680 con 0x7f0e5014e0a0 2023-07-19T20:45:09.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.419+0000 7f0e55a4b700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f0e5006a8d0 0x7f0e5006ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:34416/0 (socket says 172.21.15.117:34416) 2023-07-19T20:45:09.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.419+0000 7f0e55a4b700 1 -- 172.21.15.117:0/2693858866 learned_addr learned my addr 172.21.15.117:0/2693858866 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:09.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.419+0000 7f0e56a4d700 1 --2- 172.21.15.117:0/2693858866 >> v2:172.21.15.124:3300/0 conn(0x7f0e500bc0f0 0x7f0e500bc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.419+0000 7f0e5624c700 1 --2- 172.21.15.117:0/2693858866 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e5014e0a0 0x7f0e5009edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.416 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.419+0000 7f0e5524a700 1 -- 172.21.15.117:0/2693858866 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810946468 0 0) 0x7f0e5009ff20 con 0x7f0e5006a8d0 2023-07-19T20:45:09.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.419+0000 7f0e5524a700 1 -- 172.21.15.117:0/2693858866 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e3c0035b0 con 0x7f0e5006a8d0 2023-07-19T20:45:09.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.420+0000 7f0e5624c700 1 -- 172.21.15.117:0/2693858866 >> v2:172.21.15.124:3300/0 conn(0x7f0e500bc0f0 msgr2=0x7f0e500bc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:09.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.420+0000 7f0e5624c700 1 --2- 172.21.15.117:0/2693858866 >> v2:172.21.15.124:3300/0 conn(0x7f0e500bc0f0 0x7f0e500bc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.420+0000 7f0e5624c700 1 -- 172.21.15.117:0/2693858866 >> v1:172.21.15.117:6789/0 conn(0x7f0e5006a8d0 legacy=0x7f0e5006ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.420+0000 7f0e5624c700 1 -- 172.21.15.117:0/2693858866 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5009f960 con 0x7f0e5014e0a0 2023-07-19T20:45:09.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.420+0000 7f0e56a4d700 1 --2- 172.21.15.117:0/2693858866 >> v2:172.21.15.124:3300/0 conn(0x7f0e500bc0f0 0x7f0e500bc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:45:09.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.420+0000 7f0e5624c700 1 --2- 172.21.15.117:0/2693858866 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e5014e0a0 0x7f0e5009edf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c009840 tx=0x7f0e4c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ae5fd71972e0d34 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:09.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.420+0000 7f0e5524a700 1 -- 172.21.15.117:0/2693858866 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c011830 con 0x7f0e5014e0a0 2023-07-19T20:45:09.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.420+0000 7f0e5524a700 1 -- 172.21.15.117:0/2693858866 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c011990 con 0x7f0e5014e0a0 2023-07-19T20:45:09.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.420+0000 7f0e5524a700 1 -- 172.21.15.117:0/2693858866 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c011d00 con 0x7f0e5014e0a0 2023-07-19T20:45:09.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.420+0000 7f0e584b0700 1 -- 172.21.15.117:0/2693858866 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e5014e0a0 msgr2=0x7f0e5009edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.420+0000 7f0e584b0700 1 --2- 172.21.15.117:0/2693858866 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e5014e0a0 0x7f0e5009edf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c009840 tx=0x7f0e4c009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:09.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.421+0000 7f0e584b0700 1 -- 172.21.15.117:0/2693858866 shutdown_connections 2023-07-19T20:45:09.419 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.421+0000 7f0e584b0700 1 --2- 172.21.15.117:0/2693858866 >> v2:172.21.15.124:3300/0 conn(0x7f0e500bc0f0 0x7f0e500bc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.421+0000 7f0e584b0700 1 --2- 172.21.15.117:0/2693858866 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e5014e0a0 0x7f0e5009edf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.421+0000 7f0e584b0700 1 -- 172.21.15.117:0/2693858866 >> 172.21.15.117:0/2693858866 conn(0x7f0e500bd040 msgr2=0x7f0e500bd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:09.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.421+0000 7f0e584b0700 1 -- 172.21.15.117:0/2693858866 shutdown_connections 2023-07-19T20:45:09.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.421+0000 7f0e584b0700 1 -- 172.21.15.117:0/2693858866 wait complete. 2023-07-19T20:45:09.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.422+0000 7f0e584b0700 1 Processor -- start 2023-07-19T20:45:09.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.422+0000 7f0e584b0700 1 -- start start 2023-07-19T20:45:09.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e584b0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5006a8d0 0x7f0e500b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e584b0700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e500bc0f0 0x7f0e500b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e584b0700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e5014e0a0 0x7f0e500b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e584b0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e500b3c50 con 0x7f0e5006a8d0 2023-07-19T20:45:09.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e584b0700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e500a1680 con 0x7f0e5014e0a0 2023-07-19T20:45:09.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e584b0700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e500b60d0 con 0x7f0e500bc0f0 2023-07-19T20:45:09.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e5624c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5006a8d0 0x7f0e500b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e5624c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5006a8d0 0x7f0e500b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51876/0 (socket says 172.21.15.117:51876) 2023-07-19T20:45:09.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e5624c700 1 -- 172.21.15.117:0/2367900491 learned_addr learned my addr 172.21.15.117:0/2367900491 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:09.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e55a4b700 1 --2- 172.21.15.117:0/2367900491 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e500bc0f0 0x7f0e500b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e56a4d700 1 --2- 172.21.15.117:0/2367900491 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e5014e0a0 0x7f0e500b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e5624c700 1 -- 172.21.15.117:0/2367900491 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e500bc0f0 msgr2=0x7f0e500b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e5624c700 1 --2- 172.21.15.117:0/2367900491 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e500bc0f0 0x7f0e500b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e5624c700 1 -- 172.21.15.117:0/2367900491 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e5014e0a0 msgr2=0x7f0e500b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e5624c700 1 --2- 172.21.15.117:0/2367900491 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e5014e0a0 0x7f0e500b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e5624c700 1 -- 172.21.15.117:0/2367900491 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e48009a70 con 0x7f0e5006a8d0 2023-07-19T20:45:09.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.423+0000 7f0e5624c700 1 --2- 172.21.15.117:0/2367900491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5006a8d0 0x7f0e500b3710 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c000c00 tx=0x7f0e4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:09.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.424+0000 7f0e46ffd700 1 -- 172.21.15.117:0/2367900491 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c004550 con 0x7f0e5006a8d0 2023-07-19T20:45:09.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.424+0000 7f0e46ffd700 1 -- 172.21.15.117:0/2367900491 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c01e070 con 0x7f0e5006a8d0 2023-07-19T20:45:09.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.424+0000 7f0e584b0700 1 -- 172.21.15.117:0/2367900491 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c0094a0 con 0x7f0e5006a8d0 2023-07-19T20:45:09.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.424+0000 7f0e46ffd700 1 -- 172.21.15.117:0/2367900491 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c0038c0 con 0x7f0e5006a8d0 2023-07-19T20:45:09.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.424+0000 7f0e584b0700 1 -- 172.21.15.117:0/2367900491 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5006f670 con 0x7f0e5006a8d0 2023-07-19T20:45:09.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.424+0000 7f0e584b0700 1 -- 172.21.15.117:0/2367900491 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e50067940 con 0x7f0e5006a8d0 2023-07-19T20:45:09.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.425+0000 7f0e46ffd700 1 -- 172.21.15.117:0/2367900491 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f0e4c003a20 con 0x7f0e5006a8d0 2023-07-19T20:45:09.427 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.425+0000 7f0e46ffd700 1 --2- 172.21.15.117:0/2367900491 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f0e3406a660 0x7f0e3406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.427 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.425+0000 7f0e46ffd700 1 -- 172.21.15.117:0/2367900491 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e4c089b10 con 0x7f0e5006a8d0 2023-07-19T20:45:09.427 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.425+0000 7f0e55a4b700 1 --2- 172.21.15.117:0/2367900491 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f0e3406a660 0x7f0e3406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.427 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.426+0000 7f0e55a4b700 1 --2- 172.21.15.117:0/2367900491 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f0e3406a660 0x7f0e3406cb10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0e500b7f30 tx=0x7f0e40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:09.427 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.429+0000 7f0e46ffd700 1 -- 172.21.15.117:0/2367900491 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f0e4c054e80 con 0x7f0e5006a8d0 2023-07-19T20:45:09.608 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.615+0000 7f0e584b0700 1 -- 172.21.15.117:0/2367900491 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e500b7f60 con 0x7f0e5006a8d0 2023-07-19T20:45:09.609 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.616+0000 7f0e46ffd700 1 -- 172.21.15.117:0/2367900491 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17897 (secure 0 0 0) 0x7f0e4c020090 con 0x7f0e5006a8d0 2023-07-19T20:45:09.610 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:09.610 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:39.549566+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:45:09.612 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.618+0000 7f0e584b0700 1 -- 172.21.15.117:0/2367900491 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f0e3406a660 msgr2=0x7f0e3406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.612 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.618+0000 7f0e584b0700 1 --2- 172.21.15.117:0/2367900491 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f0e3406a660 0x7f0e3406cb10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0e500b7f30 tx=0x7f0e40009040 comp rx=0 tx=0).stop 2023-07-19T20:45:09.612 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.618+0000 7f0e584b0700 1 -- 172.21.15.117:0/2367900491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5006a8d0 msgr2=0x7f0e500b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.612 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.618+0000 7f0e584b0700 1 --2- 172.21.15.117:0/2367900491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5006a8d0 0x7f0e500b3710 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c000c00 tx=0x7f0e4c004750 comp rx=0 tx=0).stop 2023-07-19T20:45:09.612 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.618+0000 7f0e584b0700 1 -- 172.21.15.117:0/2367900491 shutdown_connections 2023-07-19T20:45:09.612 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.618+0000 7f0e584b0700 1 --2- 172.21.15.117:0/2367900491 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f0e3406a660 0x7f0e3406cb10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.613 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.618+0000 7f0e584b0700 1 --2- 172.21.15.117:0/2367900491 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e5014e0a0 0x7f0e500b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.613 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.618+0000 7f0e584b0700 1 --2- 172.21.15.117:0/2367900491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5006a8d0 0x7f0e500b3710 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.613 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.618+0000 7f0e584b0700 1 --2- 172.21.15.117:0/2367900491 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e500bc0f0 0x7f0e500b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.613 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.618+0000 7f0e584b0700 1 -- 172.21.15.117:0/2367900491 >> 172.21.15.117:0/2367900491 conn(0x7f0e500bd040 msgr2=0x7f0e50144380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:09.613 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.618+0000 7f0e584b0700 1 -- 172.21.15.117:0/2367900491 shutdown_connections 2023-07-19T20:45:09.613 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.618+0000 7f0e584b0700 1 -- 172.21.15.117:0/2367900491 wait complete. 2023-07-19T20:45:09.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-19T20:44:31.325778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-19T20:44:31.728215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-19T20:44:36.280405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-19T20:44:37.509195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-19T20:45:09.624 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-19T20:45:09.753 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.759+0000 7f7dec6f9700 1 Processor -- start 2023-07-19T20:45:09.753 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.759+0000 7f7dec6f9700 1 -- start start 2023-07-19T20:45:09.754 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.760+0000 7f7dec6f9700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7de406a560 0x7f7de40a0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.755 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.760+0000 7f7dec6f9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de40b8490 con 0x7f7de40a2b60 2023-07-19T20:45:09.755 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.760+0000 7f7dec6f9700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de40b9ab0 con 0x7f7de40a0eb0 2023-07-19T20:45:09.755 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.760+0000 7f7dec6f9700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de40bcda0 con 0x7f7de406a560 2023-07-19T20:45:09.755 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.760+0000 7f7dea495700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7de406a560 0x7f7de40a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.755 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.760+0000 7f7de9c94700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7de40a2b60 0x7f7de40ba2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:34422/0 (socket says 172.21.15.117:34422) 2023-07-19T20:45:09.755 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.760+0000 7f7de9c94700 1 -- 172.21.15.117:0/3730750896 learned_addr learned my addr 172.21.15.117:0/3730750896 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:09.755 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.760+0000 7f7dea495700 1 -- 172.21.15.117:0/3730750896 >> v1:172.21.15.124:6789/0 conn(0x7f7de40a0eb0 legacy=0x7f7de40baa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.756 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.760+0000 7f7dea495700 1 -- 172.21.15.117:0/3730750896 >> v1:172.21.15.117:6789/0 conn(0x7f7de40a2b60 legacy=0x7f7de40ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.756 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.760+0000 7f7de9493700 1 -- 172.21.15.117:0/3730750896 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766376378 0 0) 0x7f7de40b9ab0 con 0x7f7de40a0eb0 2023-07-19T20:45:09.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.760+0000 7f7dea495700 1 -- 172.21.15.117:0/3730750896 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de40b9560 con 0x7f7de406a560 2023-07-19T20:45:09.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.760+0000 7f7dea495700 1 --2- 172.21.15.117:0/3730750896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7de406a560 0x7f7de40a0970 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009840 tx=0x7f7dd4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0312f2ff979cbe server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:09.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.761+0000 7f7de9493700 1 -- 172.21.15.117:0/3730750896 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4011830 con 0x7f7de406a560 2023-07-19T20:45:09.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.761+0000 7f7de9493700 1 -- 172.21.15.117:0/3730750896 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd4011990 con 0x7f7de406a560 2023-07-19T20:45:09.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.761+0000 7f7de9493700 1 -- 172.21.15.117:0/3730750896 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4011d20 con 0x7f7de406a560 2023-07-19T20:45:09.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.761+0000 7f7dec6f9700 1 -- 172.21.15.117:0/3730750896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7de406a560 msgr2=0x7f7de40a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.761+0000 7f7dec6f9700 1 --2- 172.21.15.117:0/3730750896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7de406a560 0x7f7de40a0970 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009840 tx=0x7f7dd4009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:09.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.761+0000 7f7dec6f9700 1 -- 172.21.15.117:0/3730750896 shutdown_connections 2023-07-19T20:45:09.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.761+0000 7f7dec6f9700 1 --2- 172.21.15.117:0/3730750896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7de406a560 0x7f7de40a0970 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.761+0000 7f7dec6f9700 1 -- 172.21.15.117:0/3730750896 >> 172.21.15.117:0/3730750896 conn(0x7f7de409f570 msgr2=0x7f7de409f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:09.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.761+0000 7f7dec6f9700 1 -- 172.21.15.117:0/3730750896 shutdown_connections 2023-07-19T20:45:09.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.761+0000 7f7dec6f9700 1 -- 172.21.15.117:0/3730750896 wait complete. 2023-07-19T20:45:09.760 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.762+0000 7f7dec6f9700 1 Processor -- start 2023-07-19T20:45:09.760 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.762+0000 7f7dec6f9700 1 -- start start 2023-07-19T20:45:09.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dec6f9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7de406a560 0x7f7de41d5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dec6f9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7de40a0eb0 0x7f7de41d4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dec6f9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7de40a2b60 0x7f7de41e3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dec6f9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de41d6330 con 0x7f7de406a560 2023-07-19T20:45:09.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dec6f9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de41d3f90 con 0x7f7de40a0eb0 2023-07-19T20:45:09.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dec6f9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de41cb130 con 0x7f7de40a2b60 2023-07-19T20:45:09.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dea495700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7de406a560 0x7f7de41d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dea495700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7de406a560 0x7f7de41d5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51884/0 (socket says 172.21.15.117:51884) 2023-07-19T20:45:09.762 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dea495700 1 -- 172.21.15.117:0/578447421 learned_addr learned my addr 172.21.15.117:0/578447421 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:09.762 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7de9c94700 1 --2- 172.21.15.117:0/578447421 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7de40a0eb0 0x7f7de41d4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.762 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7deac96700 1 --2- 172.21.15.117:0/578447421 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7de40a2b60 0x7f7de41e3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.762 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dea495700 1 -- 172.21.15.117:0/578447421 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7de40a2b60 msgr2=0x7f7de41e3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.762 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dea495700 1 --2- 172.21.15.117:0/578447421 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7de40a2b60 0x7f7de41e3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.762 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dea495700 1 -- 172.21.15.117:0/578447421 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7de40a0eb0 msgr2=0x7f7de41d4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.762 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dea495700 1 --2- 172.21.15.117:0/578447421 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7de40a0eb0 0x7f7de41d4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dea495700 1 -- 172.21.15.117:0/578447421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40094a0 con 0x7f7de406a560 2023-07-19T20:45:09.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.763+0000 7f7dea495700 1 --2- 172.21.15.117:0/578447421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7de406a560 0x7f7de41d5df0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009b90 tx=0x7f7dd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:09.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.764+0000 7f7ddaffd700 1 -- 172.21.15.117:0/578447421 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40036a0 con 0x7f7de406a560 2023-07-19T20:45:09.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.764+0000 7f7ddaffd700 1 -- 172.21.15.117:0/578447421 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd401e070 con 0x7f7de406a560 2023-07-19T20:45:09.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.764+0000 7f7dec6f9700 1 -- 172.21.15.117:0/578447421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de41cb410 con 0x7f7de406a560 2023-07-19T20:45:09.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.764+0000 7f7ddaffd700 1 -- 172.21.15.117:0/578447421 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4003a00 con 0x7f7de406a560 2023-07-19T20:45:09.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.764+0000 7f7dec6f9700 1 -- 172.21.15.117:0/578447421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de41cb9d0 con 0x7f7de406a560 2023-07-19T20:45:09.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.765+0000 7f7dec6f9700 1 -- 172.21.15.117:0/578447421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de41cbb60 con 0x7f7de406a560 2023-07-19T20:45:09.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.765+0000 7f7ddaffd700 1 -- 172.21.15.117:0/578447421 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f7dd4003b60 con 0x7f7de406a560 2023-07-19T20:45:09.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.765+0000 7f7ddaffd700 1 --2- 172.21.15.117:0/578447421 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7dc806a690 0x7f7dc806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:09.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.765+0000 7f7ddaffd700 1 -- 172.21.15.117:0/578447421 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7dd4089cb0 con 0x7f7de406a560 2023-07-19T20:45:09.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.765+0000 7f7de9c94700 1 --2- 172.21.15.117:0/578447421 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7dc806a690 0x7f7dc806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:09.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.766+0000 7f7de9c94700 1 --2- 172.21.15.117:0/578447421 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7dc806a690 0x7f7dc806cb40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7de41d6580 tx=0x7f7de0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:09.765 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.770+0000 7f7ddaffd700 1 -- 172.21.15.117:0/578447421 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7dd4055140 con 0x7f7de406a560 2023-07-19T20:45:09.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.955+0000 7f7dec6f9700 1 -- 172.21.15.117:0/578447421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7de40b8900 con 0x7f7de406a560 2023-07-19T20:45:09.949 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.955+0000 7f7ddaffd700 1 -- 172.21.15.117:0/578447421 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7de40b8900 con 0x7f7de406a560 2023-07-19T20:45:09.949 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 8 2023-07-19T20:45:09.951 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.957+0000 7f7dec6f9700 1 -- 172.21.15.117:0/578447421 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7dc806a690 msgr2=0x7f7dc806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.951 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.957+0000 7f7dec6f9700 1 --2- 172.21.15.117:0/578447421 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7dc806a690 0x7f7dc806cb40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7de41d6580 tx=0x7f7de0009040 comp rx=0 tx=0).stop 2023-07-19T20:45:09.951 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.957+0000 7f7dec6f9700 1 -- 172.21.15.117:0/578447421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7de406a560 msgr2=0x7f7de41d5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:09.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.957+0000 7f7dec6f9700 1 --2- 172.21.15.117:0/578447421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7de406a560 0x7f7de41d5df0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009b90 tx=0x7f7dd4004750 comp rx=0 tx=0).stop 2023-07-19T20:45:09.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.957+0000 7f7dec6f9700 1 -- 172.21.15.117:0/578447421 shutdown_connections 2023-07-19T20:45:09.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.957+0000 7f7dec6f9700 1 --2- 172.21.15.117:0/578447421 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7dc806a690 0x7f7dc806cb40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.957+0000 7f7dec6f9700 1 --2- 172.21.15.117:0/578447421 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7de40a2b60 0x7f7de41e3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.957+0000 7f7dec6f9700 1 --2- 172.21.15.117:0/578447421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7de406a560 0x7f7de41d5df0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.957+0000 7f7dec6f9700 1 --2- 172.21.15.117:0/578447421 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7de40a0eb0 0x7f7de41d4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:09.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.957+0000 7f7dec6f9700 1 -- 172.21.15.117:0/578447421 >> 172.21.15.117:0/578447421 conn(0x7f7de409f570 msgr2=0x7f7de409d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:09.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.958+0000 7f7dec6f9700 1 -- 172.21.15.117:0/578447421 shutdown_connections 2023-07-19T20:45:09.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:09.958+0000 7f7dec6f9700 1 -- 172.21.15.117:0/578447421 wait complete. 2023-07-19T20:45:09.965 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-19T20:45:10.090 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.096+0000 7fcdb24e0700 1 Processor -- start 2023-07-19T20:45:10.090 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.096+0000 7fcdb24e0700 1 -- start start 2023-07-19T20:45:10.092 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdb24e0700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcdac06a560 0x7fcdac0a0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.092 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdb24e0700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcdac0a2b60 0x7fcdac0ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.092 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdb24e0700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac0b8490 con 0x7fcdac0a0eb0 2023-07-19T20:45:10.092 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdb24e0700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac0bcda0 con 0x7fcdac06a560 2023-07-19T20:45:10.092 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdb24e0700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0b9ab0 con 0x7fcdac0a2b60 2023-07-19T20:45:10.093 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdabfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcdac06a560 0x7fcdac0a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.093 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdb0a7d700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcdac0a0eb0 0x7fcdac0ba830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:34426/0 (socket says 172.21.15.117:34426) 2023-07-19T20:45:10.093 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdb0a7d700 1 -- 172.21.15.117:0/2871281140 learned_addr learned my addr 172.21.15.117:0/2871281140 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:10.093 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdab7fe700 1 --2- 172.21.15.117:0/2871281140 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcdac0a2b60 0x7fcdac0ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.093 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdabfff700 1 -- 172.21.15.117:0/2871281140 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcdac0a2b60 msgr2=0x7fcdac0ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:10.093 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdabfff700 1 --2- 172.21.15.117:0/2871281140 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcdac0a2b60 0x7fcdac0ba2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.093 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdabfff700 1 -- 172.21.15.117:0/2871281140 >> v1:172.21.15.117:6789/0 conn(0x7fcdac0a0eb0 legacy=0x7fcdac0ba830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdaaffd700 1 -- 172.21.15.117:0/2871281140 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123814142 0 0) 0x7fcdac0b8490 con 0x7fcdac0a0eb0 2023-07-19T20:45:10.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdabfff700 1 -- 172.21.15.117:0/2871281140 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac0b9560 con 0x7fcdac06a560 2023-07-19T20:45:10.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.097+0000 7fcdab7fe700 1 --2- 172.21.15.117:0/2871281140 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcdac0a2b60 0x7fcdac0ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:10.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.098+0000 7fcdabfff700 1 --2- 172.21.15.117:0/2871281140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdac06a560 0x7fcdac0a0970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009840 tx=0x7fcd9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d953f5c2c926f4d server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:10.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.098+0000 7fcdaaffd700 1 -- 172.21.15.117:0/2871281140 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c011830 con 0x7fcdac06a560 2023-07-19T20:45:10.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.098+0000 7fcdaaffd700 1 -- 172.21.15.117:0/2871281140 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c011990 con 0x7fcdac06a560 2023-07-19T20:45:10.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.098+0000 7fcdaaffd700 1 -- 172.21.15.117:0/2871281140 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c011d20 con 0x7fcdac06a560 2023-07-19T20:45:10.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.098+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2871281140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdac06a560 msgr2=0x7fcdac0a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.095 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.098+0000 7fcdb24e0700 1 --2- 172.21.15.117:0/2871281140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdac06a560 0x7fcdac0a0970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009840 tx=0x7fcd9c009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:10.095 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.098+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2871281140 shutdown_connections 2023-07-19T20:45:10.095 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.098+0000 7fcdb24e0700 1 --2- 172.21.15.117:0/2871281140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdac06a560 0x7fcdac0a0970 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.095 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.098+0000 7fcdb24e0700 1 --2- 172.21.15.117:0/2871281140 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcdac0a2b60 0x7fcdac0ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.095 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.098+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2871281140 >> 172.21.15.117:0/2871281140 conn(0x7fcdac09f570 msgr2=0x7fcdac09f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:10.095 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.098+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2871281140 shutdown_connections 2023-07-19T20:45:10.095 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.098+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2871281140 wait complete. 2023-07-19T20:45:10.098 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.099+0000 7fcdb24e0700 1 Processor -- start 2023-07-19T20:45:10.098 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.100+0000 7fcdb24e0700 1 -- start start 2023-07-19T20:45:10.098 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.100+0000 7fcdb24e0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdac06a560 0x7fcdac1d1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.098 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.100+0000 7fcdb24e0700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcdac0a0eb0 0x7fcdac1dff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.098 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.100+0000 7fcdb24e0700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcdac0a2b60 0x7fcdac1c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.098 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.100+0000 7fcdb24e0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac1d1850 con 0x7fcdac06a560 2023-07-19T20:45:10.099 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.100+0000 7fcdb24e0700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac06dae0 con 0x7fcdac0a2b60 2023-07-19T20:45:10.099 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.100+0000 7fcdb24e0700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac06e020 con 0x7fcdac0a0eb0 2023-07-19T20:45:10.099 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.100+0000 7fcdabfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdac06a560 0x7fcdac1d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.099 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.100+0000 7fcdabfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdac06a560 0x7fcdac1d1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51898/0 (socket says 172.21.15.117:51898) 2023-07-19T20:45:10.099 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.100+0000 7fcdabfff700 1 -- 172.21.15.117:0/2861999919 learned_addr learned my addr 172.21.15.117:0/2861999919 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:10.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.101+0000 7fcdb0a7d700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcdac0a2b60 0x7fcdac1c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.101+0000 7fcdab7fe700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcdac0a0eb0 0x7fcdac1dff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.101+0000 7fcdabfff700 1 -- 172.21.15.117:0/2861999919 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcdac0a0eb0 msgr2=0x7fcdac1dff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.101+0000 7fcdabfff700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcdac0a0eb0 0x7fcdac1dff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.101+0000 7fcdabfff700 1 -- 172.21.15.117:0/2861999919 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcdac0a2b60 msgr2=0x7fcdac1c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.101+0000 7fcdabfff700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcdac0a2b60 0x7fcdac1c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.101+0000 7fcdabfff700 1 -- 172.21.15.117:0/2861999919 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c0094a0 con 0x7fcdac06a560 2023-07-19T20:45:10.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.101+0000 7fcdb0a7d700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcdac0a2b60 0x7fcdac1c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:10.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.101+0000 7fcdabfff700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdac06a560 0x7fcdac1d1310 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c014040 tx=0x7fcd9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:10.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.101+0000 7fcda8ff9700 1 -- 172.21.15.117:0/2861999919 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0038a0 con 0x7fcdac06a560 2023-07-19T20:45:10.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.101+0000 7fcda8ff9700 1 -- 172.21.15.117:0/2861999919 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c01e070 con 0x7fcdac06a560 2023-07-19T20:45:10.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.101+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2861999919 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac1d3960 con 0x7fcdac06a560 2023-07-19T20:45:10.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.101+0000 7fcda8ff9700 1 -- 172.21.15.117:0/2861999919 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c003c20 con 0x7fcdac06a560 2023-07-19T20:45:10.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.101+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2861999919 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac0720f0 con 0x7fcdac06a560 2023-07-19T20:45:10.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.102+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2861999919 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac067940 con 0x7fcdac06a560 2023-07-19T20:45:10.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.102+0000 7fcda8ff9700 1 -- 172.21.15.117:0/2861999919 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fcd9c01a420 con 0x7fcdac06a560 2023-07-19T20:45:10.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.103+0000 7fcda8ff9700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcd9806a660 0x7fcd9806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.103+0000 7fcdab7fe700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcd9806a660 0x7fcd9806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.103+0000 7fcda8ff9700 1 -- 172.21.15.117:0/2861999919 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd9c089d40 con 0x7fcdac06a560 2023-07-19T20:45:10.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.103+0000 7fcdab7fe700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcd9806a660 0x7fcd9806cb10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcdac1cd5e0 tx=0x7fcda0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:10.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.107+0000 7fcda8ff9700 1 -- 172.21.15.117:0/2861999919 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fcd9c0551d0 con 0x7fcdac06a560 2023-07-19T20:45:10.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.296+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2861999919 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcdac0b8900 con 0x7fcdac06a560 2023-07-19T20:45:10.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.297+0000 7fcda8ff9700 1 -- 172.21.15.117:0/2861999919 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcdac0b8900 con 0x7fcdac06a560 2023-07-19T20:45:10.291 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2023-07-19T20:45:10.292 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.299+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2861999919 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcd9806a660 msgr2=0x7fcd9806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.299+0000 7fcdb24e0700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcd9806a660 0x7fcd9806cb10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcdac1cd5e0 tx=0x7fcda0008040 comp rx=0 tx=0).stop 2023-07-19T20:45:10.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.299+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2861999919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdac06a560 msgr2=0x7fcdac1d1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.299+0000 7fcdb24e0700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdac06a560 0x7fcdac1d1310 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c014040 tx=0x7fcd9c004750 comp rx=0 tx=0).stop 2023-07-19T20:45:10.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.299+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2861999919 shutdown_connections 2023-07-19T20:45:10.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.299+0000 7fcdb24e0700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcd9806a660 0x7fcd9806cb10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.299+0000 7fcdb24e0700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcdac0a2b60 0x7fcdac1c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.299+0000 7fcdb24e0700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdac06a560 0x7fcdac1d1310 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.299+0000 7fcdb24e0700 1 --2- 172.21.15.117:0/2861999919 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcdac0a0eb0 0x7fcdac1dff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.299+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2861999919 >> 172.21.15.117:0/2861999919 conn(0x7fcdac09f570 msgr2=0x7fcdac09eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:10.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.299+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2861999919 shutdown_connections 2023-07-19T20:45:10.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.299+0000 7fcdb24e0700 1 -- 172.21.15.117:0/2861999919 wait complete. 2023-07-19T20:45:10.305 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-19T20:45:10.429 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.435+0000 7f3fb4f3f700 1 Processor -- start 2023-07-19T20:45:10.429 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.435+0000 7f3fb4f3f700 1 -- start start 2023-07-19T20:45:10.431 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fb4f3f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3fb0144b90 0x7f3fb00b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.431 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fb4f3f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3fb006fd50 0x7f3fb006a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.431 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fb4f3f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fb014de80 0x7f3fb014e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fb4f3f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb00ba1d0 con 0x7f3fb006fd50 2023-07-19T20:45:10.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fb4f3f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb0071f80 con 0x7f3fb0144b90 2023-07-19T20:45:10.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fb4f3f700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb014e840 con 0x7f3fb014de80 2023-07-19T20:45:10.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fadd9b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3fb006fd50 0x7f3fb006a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fadd9b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3fb006fd50 0x7f3fb006a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51908/0 (socket says 172.21.15.117:51908) 2023-07-19T20:45:10.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fadd9b700 1 -- 172.21.15.117:0/3562494734 learned_addr learned my addr 172.21.15.117:0/3562494734 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:10.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fae59c700 1 --2- 172.21.15.117:0/3562494734 >> v2:172.21.15.124:3300/0 conn(0x7f3fb0144b90 0x7f3fb00b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3faed9d700 1 --2- 172.21.15.117:0/3562494734 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fb014de80 0x7f3fb014e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fadd9b700 1 -- 172.21.15.117:0/3562494734 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fb014de80 msgr2=0x7f3fb014e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:10.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fadd9b700 1 --2- 172.21.15.117:0/3562494734 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fb014de80 0x7f3fb014e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fadd9b700 1 -- 172.21.15.117:0/3562494734 >> v2:172.21.15.124:3300/0 conn(0x7f3fb0144b90 msgr2=0x7f3fb00b9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:10.434 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fadd9b700 1 --2- 172.21.15.117:0/3562494734 >> v2:172.21.15.124:3300/0 conn(0x7f3fb0144b90 0x7f3fb00b9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fadd9b700 1 -- 172.21.15.117:0/3562494734 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb0071ca0 con 0x7f3fb006fd50 2023-07-19T20:45:10.435 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.436+0000 7f3fadd9b700 1 --2- 172.21.15.117:0/3562494734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fb006fd50 0x7f3fb006a560 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3fb006ea00 tx=0x7f3fa0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369c1a4caa95bc93 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:10.436 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.437+0000 7f3fad59a700 1 -- 172.21.15.117:0/3562494734 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0011830 con 0x7f3fb006fd50 2023-07-19T20:45:10.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.437+0000 7f3fad59a700 1 -- 172.21.15.117:0/3562494734 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa0011990 con 0x7f3fb006fd50 2023-07-19T20:45:10.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.437+0000 7f3fad59a700 1 -- 172.21.15.117:0/3562494734 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0011d20 con 0x7f3fb006fd50 2023-07-19T20:45:10.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.437+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/3562494734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fb006fd50 msgr2=0x7f3fb006a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.437+0000 7f3fb4f3f700 1 --2- 172.21.15.117:0/3562494734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fb006fd50 0x7f3fb006a560 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3fb006ea00 tx=0x7f3fa0009bd0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.437+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/3562494734 shutdown_connections 2023-07-19T20:45:10.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.437+0000 7f3fb4f3f700 1 --2- 172.21.15.117:0/3562494734 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fb014de80 0x7f3fb014e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.437+0000 7f3fb4f3f700 1 --2- 172.21.15.117:0/3562494734 >> v2:172.21.15.124:3300/0 conn(0x7f3fb0144b90 0x7f3fb00b9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.437+0000 7f3fb4f3f700 1 --2- 172.21.15.117:0/3562494734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fb006fd50 0x7f3fb006a560 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.437+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/3562494734 >> 172.21.15.117:0/3562494734 conn(0x7f3fb00bd8c0 msgr2=0x7f3fb00bdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:10.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.437+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/3562494734 shutdown_connections 2023-07-19T20:45:10.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.437+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/3562494734 wait complete. 2023-07-19T20:45:10.440 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.438+0000 7f3fb4f3f700 1 Processor -- start 2023-07-19T20:45:10.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.438+0000 7f3fb4f3f700 1 -- start start 2023-07-19T20:45:10.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fb4f3f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fb006fd50 0x7f3fb00ba580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fb4f3f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fb0144b90 0x7f3fb00b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fb4f3f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fb014de80 0x7f3fb014bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fb4f3f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00baac0 con 0x7f3fb006fd50 2023-07-19T20:45:10.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fb4f3f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb014da30 con 0x7f3fb0144b90 2023-07-19T20:45:10.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fb4f3f700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00b7180 con 0x7f3fb014de80 2023-07-19T20:45:10.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fae59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fb006fd50 0x7f3fb00ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fae59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fb006fd50 0x7f3fb00ba580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51918/0 (socket says 172.21.15.117:51918) 2023-07-19T20:45:10.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fae59c700 1 -- 172.21.15.117:0/504476835 learned_addr learned my addr 172.21.15.117:0/504476835 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:10.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fadd9b700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fb0144b90 0x7f3fb00b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3faed9d700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fb014de80 0x7f3fb014bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fae59c700 1 -- 172.21.15.117:0/504476835 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fb014de80 msgr2=0x7f3fb014bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fae59c700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fb014de80 0x7f3fb014bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fae59c700 1 -- 172.21.15.117:0/504476835 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fb0144b90 msgr2=0x7f3fb00b67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fae59c700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fb0144b90 0x7f3fb00b67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3fae59c700 1 -- 172.21.15.117:0/504476835 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa0009550 con 0x7f3fb006fd50 2023-07-19T20:45:10.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.439+0000 7f3faed9d700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fb014de80 0x7f3fb014bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:10.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.440+0000 7f3fae59c700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fb006fd50 0x7f3fb00ba580 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400e9b0 tx=0x7f3fa400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:10.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.440+0000 7f3f9effd700 1 -- 172.21.15.117:0/504476835 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4009710 con 0x7f3fb006fd50 2023-07-19T20:45:10.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.440+0000 7f3f9effd700 1 -- 172.21.15.117:0/504476835 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa400c850 con 0x7f3fb006fd50 2023-07-19T20:45:10.443 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.440+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/504476835 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb014d100 con 0x7f3fb006fd50 2023-07-19T20:45:10.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.440+0000 7f3f9effd700 1 -- 172.21.15.117:0/504476835 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa400cbc0 con 0x7f3fb006fd50 2023-07-19T20:45:10.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.440+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/504476835 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb014d490 con 0x7f3fb006fd50 2023-07-19T20:45:10.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.441+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/504476835 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb0074890 con 0x7f3fb006fd50 2023-07-19T20:45:10.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.441+0000 7f3f9effd700 1 -- 172.21.15.117:0/504476835 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f3fa400cd20 con 0x7f3fb006fd50 2023-07-19T20:45:10.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.442+0000 7f3f9effd700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3f9006a660 0x7f3f9006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.442+0000 7f3fadd9b700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3f9006a660 0x7f3f9006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.442+0000 7f3f9effd700 1 -- 172.21.15.117:0/504476835 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3fa4088b40 con 0x7f3fb006fd50 2023-07-19T20:45:10.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.442+0000 7f3fadd9b700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3f9006a660 0x7f3f9006cb10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009c10 tx=0x7f3fa0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:10.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.446+0000 7f3f9effd700 1 -- 172.21.15.117:0/504476835 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3fa4053f30 con 0x7f3fb006fd50 2023-07-19T20:45:10.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.632+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/504476835 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3fb00bc8c0 con 0x7f3fb006fd50 2023-07-19T20:45:10.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.633+0000 7f3f9effd700 1 -- 172.21.15.117:0/504476835 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3fa4057550 con 0x7f3fb006fd50 2023-07-19T20:45:10.627 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2023-07-19T20:45:10.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.635+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/504476835 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3f9006a660 msgr2=0x7f3f9006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.635+0000 7f3fb4f3f700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3f9006a660 0x7f3f9006cb10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009c10 tx=0x7f3fa0008030 comp rx=0 tx=0).stop 2023-07-19T20:45:10.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.635+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/504476835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fb006fd50 msgr2=0x7f3fb00ba580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.635+0000 7f3fb4f3f700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fb006fd50 0x7f3fb00ba580 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400e9b0 tx=0x7f3fa400ecc0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.635+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/504476835 shutdown_connections 2023-07-19T20:45:10.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.635+0000 7f3fb4f3f700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3f9006a660 0x7f3f9006cb10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.635+0000 7f3fb4f3f700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fb014de80 0x7f3fb014bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.635+0000 7f3fb4f3f700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fb006fd50 0x7f3fb00ba580 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.635+0000 7f3fb4f3f700 1 --2- 172.21.15.117:0/504476835 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fb0144b90 0x7f3fb00b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.635+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/504476835 >> 172.21.15.117:0/504476835 conn(0x7f3fb00bd8c0 msgr2=0x7f3fb00b9490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:10.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.635+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/504476835 shutdown_connections 2023-07-19T20:45:10.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.635+0000 7f3fb4f3f700 1 -- 172.21.15.117:0/504476835 wait complete. 2023-07-19T20:45:10.641 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-19T20:45:10.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.772+0000 7fb99f7e2700 1 Processor -- start 2023-07-19T20:45:10.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.772+0000 7fb99f7e2700 1 -- start start 2023-07-19T20:45:10.767 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.773+0000 7fb99f7e2700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb9980bb390 0x7fb998153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.767 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.773+0000 7fb99f7e2700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9980b8fd0 con 0x7fb9980b0180 2023-07-19T20:45:10.768 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.773+0000 7fb99f7e2700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99809c170 con 0x7fb99806ac70 2023-07-19T20:45:10.768 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.773+0000 7fb99f7e2700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9980b8cf0 con 0x7fb9980bb390 2023-07-19T20:45:10.768 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.773+0000 7fb99dd7f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb9980bb390 0x7fb998153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.768 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.773+0000 7fb99cd7d700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb9980b0180 0x7fb9980bac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:34440/0 (socket says 172.21.15.117:34440) 2023-07-19T20:45:10.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.773+0000 7fb99cd7d700 1 -- 172.21.15.117:0/3272358775 learned_addr learned my addr 172.21.15.117:0/3272358775 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:10.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.774+0000 7fb99dd7f700 1 -- 172.21.15.117:0/3272358775 >> v1:172.21.15.124:6789/0 conn(0x7fb99806ac70 legacy=0x7fb99809ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:10.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.774+0000 7fb99dd7f700 1 -- 172.21.15.117:0/3272358775 >> v1:172.21.15.117:6789/0 conn(0x7fb9980b0180 legacy=0x7fb9980bac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.774+0000 7fb98ffff700 1 -- 172.21.15.117:0/3272358775 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538050820 0 0) 0x7fb9980b8fd0 con 0x7fb9980b0180 2023-07-19T20:45:10.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.774+0000 7fb99dd7f700 1 -- 172.21.15.117:0/3272358775 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980b71b0 con 0x7fb9980bb390 2023-07-19T20:45:10.769 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.774+0000 7fb99dd7f700 1 --2- 172.21.15.117:0/3272358775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9980bb390 0x7fb998153290 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb990009d90 tx=0x7fb99000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7e5b341935bfcd server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:10.770 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.774+0000 7fb98ffff700 1 -- 172.21.15.117:0/3272358775 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99000e070 con 0x7fb9980bb390 2023-07-19T20:45:10.770 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.774+0000 7fb98ffff700 1 -- 172.21.15.117:0/3272358775 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99000bb90 con 0x7fb9980bb390 2023-07-19T20:45:10.770 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.774+0000 7fb98ffff700 1 -- 172.21.15.117:0/3272358775 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb990003a20 con 0x7fb9980bb390 2023-07-19T20:45:10.773 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.774+0000 7fb99f7e2700 1 -- 172.21.15.117:0/3272358775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9980bb390 msgr2=0x7fb998153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.773 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.774+0000 7fb99f7e2700 1 --2- 172.21.15.117:0/3272358775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9980bb390 0x7fb998153290 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb990009d90 tx=0x7fb99000b330 comp rx=0 tx=0).stop 2023-07-19T20:45:10.773 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.774+0000 7fb99f7e2700 1 -- 172.21.15.117:0/3272358775 shutdown_connections 2023-07-19T20:45:10.773 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.774+0000 7fb99f7e2700 1 --2- 172.21.15.117:0/3272358775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9980bb390 0x7fb998153290 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.774 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.774+0000 7fb99f7e2700 1 -- 172.21.15.117:0/3272358775 >> 172.21.15.117:0/3272358775 conn(0x7fb99809f150 msgr2=0x7fb99806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:10.774 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.775+0000 7fb99f7e2700 1 -- 172.21.15.117:0/3272358775 shutdown_connections 2023-07-19T20:45:10.774 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.775+0000 7fb99f7e2700 1 -- 172.21.15.117:0/3272358775 wait complete. 2023-07-19T20:45:10.774 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.776+0000 7fb99f7e2700 1 Processor -- start 2023-07-19T20:45:10.774 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.776+0000 7fb99f7e2700 1 -- start start 2023-07-19T20:45:10.774 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.776+0000 7fb99f7e2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb99806ac70 0x7fb9981e1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.774 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.776+0000 7fb99f7e2700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb9980b0180 0x7fb9980b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.775 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.776+0000 7fb99f7e2700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb9980bb390 0x7fb9980b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.775 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.776+0000 7fb99f7e2700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980720b0 con 0x7fb99806ac70 2023-07-19T20:45:10.775 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.776+0000 7fb99f7e2700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980710a0 con 0x7fb9980b0180 2023-07-19T20:45:10.775 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.776+0000 7fb99f7e2700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb998071310 con 0x7fb9980bb390 2023-07-19T20:45:10.775 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.776+0000 7fb99d57e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb99806ac70 0x7fb9981e1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.775 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.776+0000 7fb99d57e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb99806ac70 0x7fb9981e1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51936/0 (socket says 172.21.15.117:51936) 2023-07-19T20:45:10.775 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.776+0000 7fb99d57e700 1 -- 172.21.15.117:0/4172871539 learned_addr learned my addr 172.21.15.117:0/4172871539 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:10.775 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.777+0000 7fb99cd7d700 1 --2- 172.21.15.117:0/4172871539 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb9980b0180 0x7fb9980b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.777+0000 7fb99d57e700 1 -- 172.21.15.117:0/4172871539 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb9980bb390 msgr2=0x7fb9980b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.777+0000 7fb99d57e700 1 --2- 172.21.15.117:0/4172871539 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb9980bb390 0x7fb9980b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.777+0000 7fb99d57e700 1 -- 172.21.15.117:0/4172871539 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb9980b0180 msgr2=0x7fb9980b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.777+0000 7fb99d57e700 1 --2- 172.21.15.117:0/4172871539 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb9980b0180 0x7fb9980b6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.777+0000 7fb99d57e700 1 -- 172.21.15.117:0/4172871539 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990009a70 con 0x7fb99806ac70 2023-07-19T20:45:10.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.777+0000 7fb99d57e700 1 --2- 172.21.15.117:0/4172871539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb99806ac70 0x7fb9981e1420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb98800b4d0 tx=0x7fb98800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:10.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.777+0000 7fb98dffb700 1 -- 172.21.15.117:0/4172871539 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988011830 con 0x7fb99806ac70 2023-07-19T20:45:10.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.777+0000 7fb98dffb700 1 -- 172.21.15.117:0/4172871539 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb988011990 con 0x7fb99806ac70 2023-07-19T20:45:10.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.777+0000 7fb99f7e2700 1 -- 172.21.15.117:0/4172871539 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb998071dd0 con 0x7fb99806ac70 2023-07-19T20:45:10.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.777+0000 7fb98dffb700 1 -- 172.21.15.117:0/4172871539 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988011d40 con 0x7fb99806ac70 2023-07-19T20:45:10.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.777+0000 7fb99f7e2700 1 -- 172.21.15.117:0/4172871539 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9980715f0 con 0x7fb99806ac70 2023-07-19T20:45:10.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.778+0000 7fb99f7e2700 1 -- 172.21.15.117:0/4172871539 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb998074890 con 0x7fb99806ac70 2023-07-19T20:45:10.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.778+0000 7fb98dffb700 1 -- 172.21.15.117:0/4172871539 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fb98801a400 con 0x7fb99806ac70 2023-07-19T20:45:10.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.779+0000 7fb98dffb700 1 --2- 172.21.15.117:0/4172871539 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb97c06a660 0x7fb97c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:10.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.779+0000 7fb98dffb700 1 -- 172.21.15.117:0/4172871539 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb988088700 con 0x7fb99806ac70 2023-07-19T20:45:10.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.779+0000 7fb99cd7d700 1 --2- 172.21.15.117:0/4172871539 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb97c06a660 0x7fb97c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:10.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.779+0000 7fb99cd7d700 1 --2- 172.21.15.117:0/4172871539 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb97c06a660 0x7fb97c06cb10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb9980a14a0 tx=0x7fb994009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:10.779 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.783+0000 7fb98dffb700 1 -- 172.21.15.117:0/4172871539 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fb988053b90 con 0x7fb99806ac70 2023-07-19T20:45:10.961 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.967+0000 7fb99f7e2700 1 -- 172.21.15.117:0/4172871539 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb9980ba8b0 con 0x7fb99806ac70 2023-07-19T20:45:10.961 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.967+0000 7fb98dffb700 1 -- 172.21.15.117:0/4172871539 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb9880571b0 con 0x7fb99806ac70 2023-07-19T20:45:10.961 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 64 2023-07-19T20:45:10.963 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.969+0000 7fb99f7e2700 1 -- 172.21.15.117:0/4172871539 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb97c06a660 msgr2=0x7fb97c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.963 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.969+0000 7fb99f7e2700 1 --2- 172.21.15.117:0/4172871539 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb97c06a660 0x7fb97c06cb10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb9980a14a0 tx=0x7fb994009040 comp rx=0 tx=0).stop 2023-07-19T20:45:10.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.969+0000 7fb99f7e2700 1 -- 172.21.15.117:0/4172871539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb99806ac70 msgr2=0x7fb9981e1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:10.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.969+0000 7fb99f7e2700 1 --2- 172.21.15.117:0/4172871539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb99806ac70 0x7fb9981e1420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb98800b4d0 tx=0x7fb98800b890 comp rx=0 tx=0).stop 2023-07-19T20:45:10.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.969+0000 7fb99f7e2700 1 -- 172.21.15.117:0/4172871539 shutdown_connections 2023-07-19T20:45:10.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.969+0000 7fb99f7e2700 1 --2- 172.21.15.117:0/4172871539 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fb97c06a660 0x7fb97c06cb10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.969+0000 7fb99f7e2700 1 --2- 172.21.15.117:0/4172871539 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb9980bb390 0x7fb9980b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.969+0000 7fb99f7e2700 1 --2- 172.21.15.117:0/4172871539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb99806ac70 0x7fb9981e1420 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.969+0000 7fb99f7e2700 1 --2- 172.21.15.117:0/4172871539 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb9980b0180 0x7fb9980b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:10.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.969+0000 7fb99f7e2700 1 -- 172.21.15.117:0/4172871539 >> 172.21.15.117:0/4172871539 conn(0x7fb99809f150 msgr2=0x7fb9981d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:10.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.969+0000 7fb99f7e2700 1 -- 172.21.15.117:0/4172871539 shutdown_connections 2023-07-19T20:45:10.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:10.969+0000 7fb99f7e2700 1 -- 172.21.15.117:0/4172871539 wait complete. 2023-07-19T20:45:10.977 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-19T20:45:11.098 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.104+0000 7fdbfa936700 1 Processor -- start 2023-07-19T20:45:11.098 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.104+0000 7fdbfa936700 1 -- start start 2023-07-19T20:45:11.099 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.105+0000 7fdbfa936700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdbf414b7c0 0x7fdbf40bab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.105+0000 7fdbfa936700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbf40bce20 0x7fdbf40b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.105+0000 7fdbfa936700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf40bd340 con 0x7fdbf40c1200 2023-07-19T20:45:11.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.105+0000 7fdbfa936700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf40b9500 con 0x7fdbf414b7c0 2023-07-19T20:45:11.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.105+0000 7fdbfa936700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40b8eb0 con 0x7fdbf40bce20 2023-07-19T20:45:11.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.105+0000 7fdbf8ed3700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fdbf40c1200 0x7fdbf414e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:34444/0 (socket says 172.21.15.117:34444) 2023-07-19T20:45:11.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.105+0000 7fdbf8ed3700 1 -- 172.21.15.117:0/1958102285 learned_addr learned my addr 172.21.15.117:0/1958102285 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:11.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.105+0000 7fdbf3fff700 1 --2- 172.21.15.117:0/1958102285 >> v2:172.21.15.124:3300/0 conn(0x7fdbf414b7c0 0x7fdbf40bab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.105+0000 7fdbf37fe700 1 --2- 172.21.15.117:0/1958102285 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbf40bce20 0x7fdbf40b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.105+0000 7fdbf2ffd700 1 -- 172.21.15.117:0/1958102285 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972713945 0 0) 0x7fdbf40bd340 con 0x7fdbf40c1200 2023-07-19T20:45:11.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.105+0000 7fdbf2ffd700 1 -- 172.21.15.117:0/1958102285 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbdc0035b0 con 0x7fdbf40c1200 2023-07-19T20:45:11.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.105+0000 7fdbf3fff700 1 -- 172.21.15.117:0/1958102285 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbf40bce20 msgr2=0x7fdbf40b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:11.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbf3fff700 1 --2- 172.21.15.117:0/1958102285 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbf40bce20 0x7fdbf40b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbf3fff700 1 -- 172.21.15.117:0/1958102285 >> v1:172.21.15.117:6789/0 conn(0x7fdbf40c1200 legacy=0x7fdbf414e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbf3fff700 1 -- 172.21.15.117:0/1958102285 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf40b9190 con 0x7fdbf414b7c0 2023-07-19T20:45:11.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbf3fff700 1 --2- 172.21.15.117:0/1958102285 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbf414b7c0 0x7fdbf40bab50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009840 tx=0x7fdbe4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cddda1266b8aac49 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:11.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbf2ffd700 1 -- 172.21.15.117:0/1958102285 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4011830 con 0x7fdbf414b7c0 2023-07-19T20:45:11.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbf2ffd700 1 -- 172.21.15.117:0/1958102285 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe4011990 con 0x7fdbf414b7c0 2023-07-19T20:45:11.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbf2ffd700 1 -- 172.21.15.117:0/1958102285 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4011d00 con 0x7fdbf414b7c0 2023-07-19T20:45:11.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbfa936700 1 -- 172.21.15.117:0/1958102285 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbf414b7c0 msgr2=0x7fdbf40bab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.107 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbfa936700 1 --2- 172.21.15.117:0/1958102285 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbf414b7c0 0x7fdbf40bab50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009840 tx=0x7fdbe4009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:11.108 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbfa936700 1 -- 172.21.15.117:0/1958102285 shutdown_connections 2023-07-19T20:45:11.108 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbfa936700 1 --2- 172.21.15.117:0/1958102285 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbf414b7c0 0x7fdbf40bab50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbfa936700 1 --2- 172.21.15.117:0/1958102285 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbf40bce20 0x7fdbf40b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbfa936700 1 -- 172.21.15.117:0/1958102285 >> 172.21.15.117:0/1958102285 conn(0x7fdbf4072920 msgr2=0x7fdbf40c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:11.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbfa936700 1 -- 172.21.15.117:0/1958102285 shutdown_connections 2023-07-19T20:45:11.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.106+0000 7fdbfa936700 1 -- 172.21.15.117:0/1958102285 wait complete. 2023-07-19T20:45:11.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.107+0000 7fdbfa936700 1 Processor -- start 2023-07-19T20:45:11.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.108+0000 7fdbfa936700 1 -- start start 2023-07-19T20:45:11.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.108+0000 7fdbfa936700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbf40bce20 0x7fdbf41462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.108+0000 7fdbfa936700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbf40c1200 0x7fdbf41e3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.108+0000 7fdbfa936700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbf414b7c0 0x7fdbf4149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.108+0000 7fdbfa936700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf41e32e0 con 0x7fdbf40c1200 2023-07-19T20:45:11.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.108+0000 7fdbfa936700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf41e3cb0 con 0x7fdbf414b7c0 2023-07-19T20:45:11.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.108+0000 7fdbfa936700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf4146930 con 0x7fdbf40bce20 2023-07-19T20:45:11.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.108+0000 7fdbf37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbf40c1200 0x7fdbf41e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.108+0000 7fdbf37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbf40c1200 0x7fdbf41e3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51940/0 (socket says 172.21.15.117:51940) 2023-07-19T20:45:11.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.108+0000 7fdbf37fe700 1 -- 172.21.15.117:0/842248589 learned_addr learned my addr 172.21.15.117:0/842248589 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:11.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.109+0000 7fdbf8ed3700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbf414b7c0 0x7fdbf4149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.109+0000 7fdbf3fff700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbf40bce20 0x7fdbf41462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.109+0000 7fdbf37fe700 1 -- 172.21.15.117:0/842248589 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbf40bce20 msgr2=0x7fdbf41462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.109+0000 7fdbf37fe700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbf40bce20 0x7fdbf41462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.109+0000 7fdbf37fe700 1 -- 172.21.15.117:0/842248589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbf414b7c0 msgr2=0x7fdbf4149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.109+0000 7fdbf37fe700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbf414b7c0 0x7fdbf4149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.109+0000 7fdbf37fe700 1 -- 172.21.15.117:0/842248589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe40094a0 con 0x7fdbf40c1200 2023-07-19T20:45:11.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.109+0000 7fdbf8ed3700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbf414b7c0 0x7fdbf4149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:11.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.109+0000 7fdbf37fe700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbf40c1200 0x7fdbf41e3770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800e980 tx=0x7fdbe800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:11.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.109+0000 7fdbf0ff9700 1 -- 172.21.15.117:0/842248589 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8009710 con 0x7fdbf40c1200 2023-07-19T20:45:11.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.109+0000 7fdbf0ff9700 1 -- 172.21.15.117:0/842248589 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe800c850 con 0x7fdbf40c1200 2023-07-19T20:45:11.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.109+0000 7fdbfa936700 1 -- 172.21.15.117:0/842248589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf4146c10 con 0x7fdbf40c1200 2023-07-19T20:45:11.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.109+0000 7fdbf0ff9700 1 -- 172.21.15.117:0/842248589 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe800cbe0 con 0x7fdbf40c1200 2023-07-19T20:45:11.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.109+0000 7fdbfa936700 1 -- 172.21.15.117:0/842248589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf41d49d0 con 0x7fdbf40c1200 2023-07-19T20:45:11.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.110+0000 7fdbfa936700 1 -- 172.21.15.117:0/842248589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf41e2dd0 con 0x7fdbf40c1200 2023-07-19T20:45:11.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.111+0000 7fdbf0ff9700 1 -- 172.21.15.117:0/842248589 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fdbe800cd40 con 0x7fdbf40c1200 2023-07-19T20:45:11.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.111+0000 7fdbf0ff9700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdbe006a660 0x7fdbe006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.112+0000 7fdbf0ff9700 1 -- 172.21.15.117:0/842248589 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdbe8089210 con 0x7fdbf40c1200 2023-07-19T20:45:11.115 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.112+0000 7fdbf3fff700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdbe006a660 0x7fdbe006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.115 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.112+0000 7fdbf3fff700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdbe006a660 0x7fdbe006cb10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009fd0 tx=0x7fdbe4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:11.115 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.115+0000 7fdbf0ff9700 1 -- 172.21.15.117:0/842248589 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fdbe80581d0 con 0x7fdbf40c1200 2023-07-19T20:45:11.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.342+0000 7fdbfa936700 1 -- 172.21.15.117:0/842248589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbf41e2dd0 con 0x7fdbf40c1200 2023-07-19T20:45:11.336 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.342+0000 7fdbf0ff9700 1 -- 172.21.15.117:0/842248589 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3892 (secure 0 0 0) 0x7fdbf41e2dd0 con 0x7fdbf40c1200 2023-07-19T20:45:11.336 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:11.336 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6833/1121968339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":1121968339},{"type":"v1","addr":"172.21.15.124:6833","nonce":1121968339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3740070710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3740070710},{"type":"v1","addr":"172.21.15.117:6835","nonce":3740070710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-19T20:44:38.547955+0000","modified":"2023-07-19T20:44:41.558655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/479216080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":479216080},{"type":"v1","addr":"172.21.15.117:6837","nonce":479216080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-19T20:45:11.338 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.344+0000 7fdbfa936700 1 -- 172.21.15.117:0/842248589 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdbe006a660 msgr2=0x7fdbe006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.338 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.344+0000 7fdbfa936700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdbe006a660 0x7fdbe006cb10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009fd0 tx=0x7fdbe4008030 comp rx=0 tx=0).stop 2023-07-19T20:45:11.338 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.344+0000 7fdbfa936700 1 -- 172.21.15.117:0/842248589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbf40c1200 msgr2=0x7fdbf41e3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.338 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.344+0000 7fdbfa936700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbf40c1200 0x7fdbf41e3770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800e980 tx=0x7fdbe800ed40 comp rx=0 tx=0).stop 2023-07-19T20:45:11.338 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.344+0000 7fdbfa936700 1 -- 172.21.15.117:0/842248589 shutdown_connections 2023-07-19T20:45:11.338 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.344+0000 7fdbfa936700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdbe006a660 0x7fdbe006cb10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.344+0000 7fdbfa936700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbf414b7c0 0x7fdbf4149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.344+0000 7fdbfa936700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdbf40bce20 0x7fdbf41462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.344+0000 7fdbfa936700 1 --2- 172.21.15.117:0/842248589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbf40c1200 0x7fdbf41e3770 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.344+0000 7fdbfa936700 1 -- 172.21.15.117:0/842248589 >> 172.21.15.117:0/842248589 conn(0x7fdbf4072920 msgr2=0x7fdbf40bbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:11.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.344+0000 7fdbfa936700 1 -- 172.21.15.117:0/842248589 shutdown_connections 2023-07-19T20:45:11.339 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.344+0000 7fdbfa936700 1 -- 172.21.15.117:0/842248589 wait complete. 2023-07-19T20:45:11.340 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 8 2023-07-19T20:45:11.350 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:45:11.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.477+0000 7fd402c7f700 1 Processor -- start 2023-07-19T20:45:11.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.477+0000 7fd402c7f700 1 -- start start 2023-07-19T20:45:11.476 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd402c7f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3fc0baa40 0x7fd3fc0b8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.477 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd402c7f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3fc0b7900 con 0x7fd3fc1475e0 2023-07-19T20:45:11.477 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd402c7f700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3fc14b980 con 0x7fd3fc0bae10 2023-07-19T20:45:11.477 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd402c7f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3fc147a70 con 0x7fd3fc0baa40 2023-07-19T20:45:11.477 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd400a1b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3fc0baa40 0x7fd3fc0b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.478 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd400a1b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3fc0baa40 0x7fd3fc0b8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51956/0 (socket says 172.21.15.117:51956) 2023-07-19T20:45:11.478 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd400a1b700 1 -- 172.21.15.117:0/177457035 learned_addr learned my addr 172.21.15.117:0/177457035 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:11.478 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd3fbfff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd3fc1475e0 0x7fd3fc14ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:34448/0 (socket says 172.21.15.117:34448) 2023-07-19T20:45:11.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd400a1b700 1 -- 172.21.15.117:0/177457035 >> v1:172.21.15.124:6789/0 conn(0x7fd3fc0bae10 legacy=0x7fd3fc14b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd400a1b700 1 -- 172.21.15.117:0/177457035 >> v1:172.21.15.117:6789/0 conn(0x7fd3fc1475e0 legacy=0x7fd3fc14ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd400a1b700 1 -- 172.21.15.117:0/177457035 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc147d50 con 0x7fd3fc0baa40 2023-07-19T20:45:11.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd3fb7fe700 1 -- 172.21.15.117:0/177457035 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972525324 0 0) 0x7fd3fc0b7900 con 0x7fd3fc1475e0 2023-07-19T20:45:11.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd400a1b700 1 --2- 172.21.15.117:0/177457035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3fc0baa40 0x7fd3fc0b8310 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00098f0 tx=0x7fd3f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0548a759b4ddeb5 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:11.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd3fb7fe700 1 -- 172.21.15.117:0/177457035 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f000b8a0 con 0x7fd3fc0baa40 2023-07-19T20:45:11.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd3fb7fe700 1 -- 172.21.15.117:0/177457035 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f000ba00 con 0x7fd3fc0baa40 2023-07-19T20:45:11.479 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.478+0000 7fd3fb7fe700 1 -- 172.21.15.117:0/177457035 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f000bd90 con 0x7fd3fc0baa40 2023-07-19T20:45:11.480 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.479+0000 7fd402c7f700 1 -- 172.21.15.117:0/177457035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3fc0baa40 msgr2=0x7fd3fc0b8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.480 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.479+0000 7fd402c7f700 1 --2- 172.21.15.117:0/177457035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3fc0baa40 0x7fd3fc0b8310 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00098f0 tx=0x7fd3f0009c00 comp rx=0 tx=0).stop 2023-07-19T20:45:11.480 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.479+0000 7fd402c7f700 1 -- 172.21.15.117:0/177457035 shutdown_connections 2023-07-19T20:45:11.480 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.479+0000 7fd402c7f700 1 --2- 172.21.15.117:0/177457035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3fc0baa40 0x7fd3fc0b8310 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.480 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.479+0000 7fd402c7f700 1 -- 172.21.15.117:0/177457035 >> 172.21.15.117:0/177457035 conn(0x7fd3fc0be4b0 msgr2=0x7fd3fc0ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:11.480 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.479+0000 7fd402c7f700 1 -- 172.21.15.117:0/177457035 shutdown_connections 2023-07-19T20:45:11.480 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.479+0000 7fd402c7f700 1 -- 172.21.15.117:0/177457035 wait complete. 2023-07-19T20:45:11.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.480+0000 7fd402c7f700 1 Processor -- start 2023-07-19T20:45:11.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.480+0000 7fd402c7f700 1 -- start start 2023-07-19T20:45:11.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.481+0000 7fd402c7f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd3fc0baa40 0x7fd3fc0bb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.481+0000 7fd402c7f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd3fc0bae10 0x7fd3fc0b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.481+0000 7fd402c7f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3fc1475e0 0x7fd3fc13ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.481+0000 7fd402c7f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc1488e0 con 0x7fd3fc1475e0 2023-07-19T20:45:11.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.481+0000 7fd402c7f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc0bbe40 con 0x7fd3fc0baa40 2023-07-19T20:45:11.481 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.481+0000 7fd402c7f700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc14b5d0 con 0x7fd3fc0bae10 2023-07-19T20:45:11.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.481+0000 7fd40121c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3fc1475e0 0x7fd3fc13ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.481+0000 7fd40121c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3fc1475e0 0x7fd3fc13ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51972/0 (socket says 172.21.15.117:51972) 2023-07-19T20:45:11.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.481+0000 7fd40121c700 1 -- 172.21.15.117:0/3426824801 learned_addr learned my addr 172.21.15.117:0/3426824801 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:11.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.481+0000 7fd400a1b700 1 --2- 172.21.15.117:0/3426824801 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd3fc0baa40 0x7fd3fc0bb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.481+0000 7fd3fbfff700 1 --2- 172.21.15.117:0/3426824801 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd3fc0bae10 0x7fd3fc0b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.482 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.482+0000 7fd40121c700 1 -- 172.21.15.117:0/3426824801 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd3fc0bae10 msgr2=0x7fd3fc0b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.483 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.482+0000 7fd40121c700 1 --2- 172.21.15.117:0/3426824801 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd3fc0bae10 0x7fd3fc0b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.483 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.482+0000 7fd40121c700 1 -- 172.21.15.117:0/3426824801 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd3fc0baa40 msgr2=0x7fd3fc0bb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.483 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.482+0000 7fd40121c700 1 --2- 172.21.15.117:0/3426824801 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd3fc0baa40 0x7fd3fc0bb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.484 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.482+0000 7fd40121c700 1 -- 172.21.15.117:0/3426824801 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0009550 con 0x7fd3fc1475e0 2023-07-19T20:45:11.484 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.482+0000 7fd40121c700 1 --2- 172.21.15.117:0/3426824801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3fc1475e0 0x7fd3fc13ca00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400cc50 tx=0x7fd3f400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:11.484 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.482+0000 7fd3f97fa700 1 -- 172.21.15.117:0/3426824801 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4003c00 con 0x7fd3fc1475e0 2023-07-19T20:45:11.484 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.482+0000 7fd3f97fa700 1 -- 172.21.15.117:0/3426824801 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f4003d60 con 0x7fd3fc1475e0 2023-07-19T20:45:11.484 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.482+0000 7fd402c7f700 1 -- 172.21.15.117:0/3426824801 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3fc0b5340 con 0x7fd3fc1475e0 2023-07-19T20:45:11.484 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.482+0000 7fd3f97fa700 1 -- 172.21.15.117:0/3426824801 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f400aab0 con 0x7fd3fc1475e0 2023-07-19T20:45:11.485 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.482+0000 7fd402c7f700 1 -- 172.21.15.117:0/3426824801 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3fc1410d0 con 0x7fd3fc1475e0 2023-07-19T20:45:11.485 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.483+0000 7fd402c7f700 1 -- 172.21.15.117:0/3426824801 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3fc14b790 con 0x7fd3fc1475e0 2023-07-19T20:45:11.486 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.483+0000 7fd3f97fa700 1 -- 172.21.15.117:0/3426824801 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fd3f400ac10 con 0x7fd3fc1475e0 2023-07-19T20:45:11.486 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.484+0000 7fd3f97fa700 1 --2- 172.21.15.117:0/3426824801 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd3e006a690 0x7fd3e006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.486 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.484+0000 7fd3f97fa700 1 -- 172.21.15.117:0/3426824801 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd3f4088a30 con 0x7fd3fc1475e0 2023-07-19T20:45:11.486 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.484+0000 7fd400a1b700 1 --2- 172.21.15.117:0/3426824801 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd3e006a690 0x7fd3e006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.486 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.484+0000 7fd400a1b700 1 --2- 172.21.15.117:0/3426824801 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd3e006a690 0x7fd3e006cb40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0000c00 tx=0x7fd3f0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:11.486 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.488+0000 7fd3f97fa700 1 -- 172.21.15.117:0/3426824801 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fd3f4053e30 con 0x7fd3fc1475e0 2023-07-19T20:45:11.666 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.673+0000 7fd402c7f700 1 -- 172.21.15.117:0/3426824801 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3fc067940 con 0x7fd3fc1475e0 2023-07-19T20:45:11.667 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.674+0000 7fd3f97fa700 1 -- 172.21.15.117:0/3426824801 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17897 (secure 0 0 0) 0x7fd3f4057450 con 0x7fd3fc1475e0 2023-07-19T20:45:11.668 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:11.668 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:39.549566+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:45:11.670 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.676+0000 7fd402c7f700 1 -- 172.21.15.117:0/3426824801 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd3e006a690 msgr2=0x7fd3e006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.670 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.676+0000 7fd402c7f700 1 --2- 172.21.15.117:0/3426824801 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd3e006a690 0x7fd3e006cb40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0000c00 tx=0x7fd3f0008030 comp rx=0 tx=0).stop 2023-07-19T20:45:11.670 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.676+0000 7fd402c7f700 1 -- 172.21.15.117:0/3426824801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3fc1475e0 msgr2=0x7fd3fc13ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.670 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.676+0000 7fd402c7f700 1 --2- 172.21.15.117:0/3426824801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3fc1475e0 0x7fd3fc13ca00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400cc50 tx=0x7fd3f400cf60 comp rx=0 tx=0).stop 2023-07-19T20:45:11.671 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.676+0000 7fd402c7f700 1 -- 172.21.15.117:0/3426824801 shutdown_connections 2023-07-19T20:45:11.671 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.676+0000 7fd402c7f700 1 --2- 172.21.15.117:0/3426824801 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fd3e006a690 0x7fd3e006cb40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.671 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.676+0000 7fd402c7f700 1 --2- 172.21.15.117:0/3426824801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3fc1475e0 0x7fd3fc13ca00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.671 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.676+0000 7fd402c7f700 1 --2- 172.21.15.117:0/3426824801 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd3fc0baa40 0x7fd3fc0bb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.671 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.676+0000 7fd402c7f700 1 --2- 172.21.15.117:0/3426824801 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd3fc0bae10 0x7fd3fc0b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.671 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.676+0000 7fd402c7f700 1 -- 172.21.15.117:0/3426824801 >> 172.21.15.117:0/3426824801 conn(0x7fd3fc0be4b0 msgr2=0x7fd3fc1451d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:11.671 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.677+0000 7fd402c7f700 1 -- 172.21.15.117:0/3426824801 shutdown_connections 2023-07-19T20:45:11.671 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.677+0000 7fd402c7f700 1 -- 172.21.15.117:0/3426824801 wait complete. 2023-07-19T20:45:11.683 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-19T20:45:11.684 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-19T20:45:11.806 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.812+0000 7f716128b700 1 Processor -- start 2023-07-19T20:45:11.806 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.813+0000 7f716128b700 1 -- start start 2023-07-19T20:45:11.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f716128b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f715c071be0 0x7f715c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f716128b700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f715c0b8da0 0x7f715c0b91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f716128b700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715c0729d0 con 0x7f715c0bacb0 2023-07-19T20:45:11.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f716128b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715c0715e0 con 0x7f715c071be0 2023-07-19T20:45:11.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f716128b700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0717c0 con 0x7f715c0b8da0 2023-07-19T20:45:11.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f715a7fc700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f715c071be0 0x7f715c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f715a7fc700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f715c071be0 0x7f715c0702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51986/0 (socket says 172.21.15.117:51986) 2023-07-19T20:45:11.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f715a7fc700 1 -- 172.21.15.117:0/2291969778 learned_addr learned my addr 172.21.15.117:0/2291969778 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:11.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f715b7fe700 1 --2- 172.21.15.117:0/2291969778 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f715c0b8da0 0x7f715c0b91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f715a7fc700 1 -- 172.21.15.117:0/2291969778 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f715c0b8da0 msgr2=0x7f715c0b91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:11.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f715a7fc700 1 --2- 172.21.15.117:0/2291969778 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f715c0b8da0 0x7f715c0b91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f715a7fc700 1 -- 172.21.15.117:0/2291969778 >> v1:172.21.15.124:6789/0 conn(0x7f715c0bacb0 legacy=0x7f715c1446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:11.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f715a7fc700 1 -- 172.21.15.117:0/2291969778 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c072130 con 0x7f715c071be0 2023-07-19T20:45:11.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f715b7fe700 1 --2- 172.21.15.117:0/2291969778 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f715c0b8da0 0x7f715c0b91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:11.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f715a7fc700 1 --2- 172.21.15.117:0/2291969778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715c071be0 0x7f715c0702f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f71500098f0 tx=0x7f7150009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bdc10510a105ec server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:11.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f7159ffb700 1 -- 172.21.15.117:0/2291969778 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7150004230 con 0x7f715c071be0 2023-07-19T20:45:11.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f7159ffb700 1 -- 172.21.15.117:0/2291969778 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7150004390 con 0x7f715c071be0 2023-07-19T20:45:11.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.814+0000 7f7159ffb700 1 -- 172.21.15.117:0/2291969778 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71500036a0 con 0x7f715c071be0 2023-07-19T20:45:11.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.815+0000 7f716128b700 1 -- 172.21.15.117:0/2291969778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715c071be0 msgr2=0x7f715c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.815+0000 7f716128b700 1 --2- 172.21.15.117:0/2291969778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715c071be0 0x7f715c0702f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f71500098f0 tx=0x7f7150009c00 comp rx=0 tx=0).stop 2023-07-19T20:45:11.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.815+0000 7f716128b700 1 -- 172.21.15.117:0/2291969778 shutdown_connections 2023-07-19T20:45:11.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.815+0000 7f716128b700 1 --2- 172.21.15.117:0/2291969778 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f715c0b8da0 0x7f715c0b91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.815+0000 7f716128b700 1 --2- 172.21.15.117:0/2291969778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715c071be0 0x7f715c0702f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.815+0000 7f716128b700 1 -- 172.21.15.117:0/2291969778 >> 172.21.15.117:0/2291969778 conn(0x7f715c0be4b0 msgr2=0x7f715c0ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:11.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.815+0000 7f716128b700 1 -- 172.21.15.117:0/2291969778 shutdown_connections 2023-07-19T20:45:11.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.815+0000 7f716128b700 1 -- 172.21.15.117:0/2291969778 wait complete. 2023-07-19T20:45:11.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.817+0000 7f716128b700 1 Processor -- start 2023-07-19T20:45:11.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.817+0000 7f716128b700 1 -- start start 2023-07-19T20:45:11.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.817+0000 7f716128b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715c071be0 0x7f715c13ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.817+0000 7f716128b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f715c0b8da0 0x7f715c0b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.817+0000 7f716128b700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f715c0bacb0 0x7f715c0b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.817+0000 7f716128b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c13f360 con 0x7f715c071be0 2023-07-19T20:45:11.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.817+0000 7f716128b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0b5670 con 0x7f715c0b8da0 2023-07-19T20:45:11.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.817+0000 7f716128b700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0b61e0 con 0x7f715c0bacb0 2023-07-19T20:45:11.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.817+0000 7f715affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715c071be0 0x7f715c13ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f715affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715c071be0 0x7f715c13ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51994/0 (socket says 172.21.15.117:51994) 2023-07-19T20:45:11.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f715affd700 1 -- 172.21.15.117:0/2743907561 learned_addr learned my addr 172.21.15.117:0/2743907561 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:11.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f715a7fc700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f715c0b8da0 0x7f715c0b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f715b7fe700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f715c0bacb0 0x7f715c0b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f715affd700 1 -- 172.21.15.117:0/2743907561 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f715c0bacb0 msgr2=0x7f715c0b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f715affd700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f715c0bacb0 0x7f715c0b6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f715affd700 1 -- 172.21.15.117:0/2743907561 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f715c0b8da0 msgr2=0x7f715c0b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:11.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f715affd700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f715c0b8da0 0x7f715c0b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:11.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f715affd700 1 -- 172.21.15.117:0/2743907561 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7150009550 con 0x7f715c071be0 2023-07-19T20:45:11.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f715a7fc700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f715c0b8da0 0x7f715c0b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:11.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f715b7fe700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f715c0bacb0 0x7f715c0b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:11.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f715affd700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715c071be0 0x7f715c13ee20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f714c00b4a0 tx=0x7f714c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:11.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f71437fe700 1 -- 172.21.15.117:0/2743907561 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c011830 con 0x7f715c071be0 2023-07-19T20:45:11.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f71437fe700 1 -- 172.21.15.117:0/2743907561 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c011990 con 0x7f715c071be0 2023-07-19T20:45:11.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f716128b700 1 -- 172.21.15.117:0/2743907561 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715c13da50 con 0x7f715c071be0 2023-07-19T20:45:11.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f71437fe700 1 -- 172.21.15.117:0/2743907561 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c011d40 con 0x7f715c071be0 2023-07-19T20:45:11.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.818+0000 7f716128b700 1 -- 172.21.15.117:0/2743907561 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715c0b58b0 con 0x7f715c071be0 2023-07-19T20:45:11.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.819+0000 7f716128b700 1 -- 172.21.15.117:0/2743907561 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715c0b64c0 con 0x7f715c071be0 2023-07-19T20:45:11.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.820+0000 7f71437fe700 1 -- 172.21.15.117:0/2743907561 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f714c01a400 con 0x7f715c071be0 2023-07-19T20:45:11.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.820+0000 7f71437fe700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f714806a660 0x7f714806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:11.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.820+0000 7f71437fe700 1 -- 172.21.15.117:0/2743907561 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f714c088780 con 0x7f715c071be0 2023-07-19T20:45:11.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.820+0000 7f715a7fc700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f714806a660 0x7f714806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:11.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.820+0000 7f715a7fc700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f714806a660 0x7f714806cb10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f71500098f0 tx=0x7f7150008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:11.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:11.824+0000 7f71437fe700 1 -- 172.21.15.117:0/2743907561 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f714c053c30 con 0x7f715c071be0 2023-07-19T20:45:12.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.052+0000 7f716128b700 1 -- 172.21.15.117:0/2743907561 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f715c067940 con 0x7f715c071be0 2023-07-19T20:45:12.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.053+0000 7f71437fe700 1 -- 172.21.15.117:0/2743907561 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3892 (secure 0 0 0) 0x7f714c057250 con 0x7f715c071be0 2023-07-19T20:45:12.047 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:12.047 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6833/1121968339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":1121968339},{"type":"v1","addr":"172.21.15.124:6833","nonce":1121968339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3740070710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3740070710},{"type":"v1","addr":"172.21.15.117:6835","nonce":3740070710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-19T20:44:38.547955+0000","modified":"2023-07-19T20:44:41.558655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/479216080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":479216080},{"type":"v1","addr":"172.21.15.117:6837","nonce":479216080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-19T20:45:12.048 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.055+0000 7f716128b700 1 -- 172.21.15.117:0/2743907561 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f714806a660 msgr2=0x7f714806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.048 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.055+0000 7f716128b700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f714806a660 0x7f714806cb10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f71500098f0 tx=0x7f7150008030 comp rx=0 tx=0).stop 2023-07-19T20:45:12.049 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.055+0000 7f716128b700 1 -- 172.21.15.117:0/2743907561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715c071be0 msgr2=0x7f715c13ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.049 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.055+0000 7f716128b700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715c071be0 0x7f715c13ee20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f714c00b4a0 tx=0x7f714c00b860 comp rx=0 tx=0).stop 2023-07-19T20:45:12.049 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.055+0000 7f716128b700 1 -- 172.21.15.117:0/2743907561 shutdown_connections 2023-07-19T20:45:12.049 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.055+0000 7f716128b700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f714806a660 0x7f714806cb10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.049 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.055+0000 7f716128b700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f715c0bacb0 0x7f715c0b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.049 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.055+0000 7f716128b700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715c071be0 0x7f715c13ee20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.049 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.055+0000 7f716128b700 1 --2- 172.21.15.117:0/2743907561 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f715c0b8da0 0x7f715c0b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.055+0000 7f716128b700 1 -- 172.21.15.117:0/2743907561 >> 172.21.15.117:0/2743907561 conn(0x7f715c0be4b0 msgr2=0x7f715c1422b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:12.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.055+0000 7f716128b700 1 -- 172.21.15.117:0/2743907561 shutdown_connections 2023-07-19T20:45:12.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.055+0000 7f716128b700 1 -- 172.21.15.117:0/2743907561 wait complete. 2023-07-19T20:45:12.050 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 8 2023-07-19T20:45:12.060 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-19T20:45:12.181 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.188+0000 7f992d1e1700 1 Processor -- start 2023-07-19T20:45:12.181 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.188+0000 7f992d1e1700 1 -- start start 2023-07-19T20:45:12.183 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.188+0000 7f992d1e1700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99280b09a0 0x7f992814e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.183 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.188+0000 7f992d1e1700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f992814e6a0 0x7f9928155490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.184 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.188+0000 7f992d1e1700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99280b9320 con 0x7f9928148250 2023-07-19T20:45:12.184 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.188+0000 7f992d1e1700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99280b8da0 con 0x7f992814e6a0 2023-07-19T20:45:12.184 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.188+0000 7f992d1e1700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99280b7f80 con 0x7f99280b09a0 2023-07-19T20:45:12.184 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.188+0000 7f992759e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f992814e6a0 0x7f9928155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.184 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.189+0000 7f992759e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f992814e6a0 0x7f9928155490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38148/0 (socket says 172.21.15.117:38148) 2023-07-19T20:45:12.184 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.189+0000 7f992759e700 1 -- 172.21.15.117:0/1501473819 learned_addr learned my addr 172.21.15.117:0/1501473819 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:12.184 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.189+0000 7f992659c700 1 --2- 172.21.15.117:0/1501473819 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99280b09a0 0x7f992814e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.185 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.189+0000 7f992759e700 1 -- 172.21.15.117:0/1501473819 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99280b09a0 msgr2=0x7f992814e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:12.185 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.189+0000 7f992759e700 1 --2- 172.21.15.117:0/1501473819 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99280b09a0 0x7f992814e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.185 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.189+0000 7f992759e700 1 -- 172.21.15.117:0/1501473819 >> v1:172.21.15.124:6789/0 conn(0x7f9928148250 legacy=0x7f99280bd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.185 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.189+0000 7f992759e700 1 -- 172.21.15.117:0/1501473819 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99280bde20 con 0x7f992814e6a0 2023-07-19T20:45:12.185 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.189+0000 7f992759e700 1 --2- 172.21.15.117:0/1501473819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992814e6a0 0x7f9928155490 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9920009e50 tx=0x7f992000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceef997c6cd0783e server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:12.185 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.189+0000 7f9925d9b700 1 -- 172.21.15.117:0/1501473819 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992000e070 con 0x7f992814e6a0 2023-07-19T20:45:12.185 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.189+0000 7f9925d9b700 1 -- 172.21.15.117:0/1501473819 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992000b9c0 con 0x7f992814e6a0 2023-07-19T20:45:12.185 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.189+0000 7f9925d9b700 1 -- 172.21.15.117:0/1501473819 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992000bd70 con 0x7f992814e6a0 2023-07-19T20:45:12.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.190+0000 7f992d1e1700 1 -- 172.21.15.117:0/1501473819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992814e6a0 msgr2=0x7f9928155490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.190+0000 7f992d1e1700 1 --2- 172.21.15.117:0/1501473819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992814e6a0 0x7f9928155490 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9920009e50 tx=0x7f992000b330 comp rx=0 tx=0).stop 2023-07-19T20:45:12.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.190+0000 7f992d1e1700 1 -- 172.21.15.117:0/1501473819 shutdown_connections 2023-07-19T20:45:12.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.190+0000 7f992d1e1700 1 --2- 172.21.15.117:0/1501473819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f992814e6a0 0x7f9928155490 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.190+0000 7f992d1e1700 1 --2- 172.21.15.117:0/1501473819 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99280b09a0 0x7f992814e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.190+0000 7f992d1e1700 1 -- 172.21.15.117:0/1501473819 >> 172.21.15.117:0/1501473819 conn(0x7f99280ba790 msgr2=0x7f99280bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:12.186 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.190+0000 7f992d1e1700 1 -- 172.21.15.117:0/1501473819 shutdown_connections 2023-07-19T20:45:12.187 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.190+0000 7f992d1e1700 1 -- 172.21.15.117:0/1501473819 wait complete. 2023-07-19T20:45:12.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.191+0000 7f992d1e1700 1 Processor -- start 2023-07-19T20:45:12.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.191+0000 7f992d1e1700 1 -- start start 2023-07-19T20:45:12.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992d1e1700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99280b09a0 0x7f9928148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992d1e1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9928148250 0x7f99280b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992d1e1700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f992814e6a0 0x7f99280b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992d1e1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99280b4930 con 0x7f9928148250 2023-07-19T20:45:12.190 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992d1e1700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99280b6770 con 0x7f992814e6a0 2023-07-19T20:45:12.191 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992d1e1700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99280b6420 con 0x7f99280b09a0 2023-07-19T20:45:12.191 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9928148250 0x7f99280b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.191 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9928148250 0x7f99280b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38154/0 (socket says 172.21.15.117:38154) 2023-07-19T20:45:12.192 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992659c700 1 -- 172.21.15.117:0/2661312218 learned_addr learned my addr 172.21.15.117:0/2661312218 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:12.192 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f9926d9d700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99280b09a0 0x7f9928148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.192 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992759e700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f992814e6a0 0x7f99280b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.192 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992659c700 1 -- 172.21.15.117:0/2661312218 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99280b09a0 msgr2=0x7f9928148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.192 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992659c700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99280b09a0 0x7f9928148830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992659c700 1 -- 172.21.15.117:0/2661312218 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f992814e6a0 msgr2=0x7f99280b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992659c700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f992814e6a0 0x7f99280b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992659c700 1 -- 172.21.15.117:0/2661312218 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920009b30 con 0x7f9928148250 2023-07-19T20:45:12.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f9926d9d700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99280b09a0 0x7f9928148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:12.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992759e700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f992814e6a0 0x7f99280b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:12.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992659c700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9928148250 0x7f99280b5ee0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f991c00d800 tx=0x7f991c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:12.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f990f7fe700 1 -- 172.21.15.117:0/2661312218 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0125f0 con 0x7f9928148250 2023-07-19T20:45:12.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f990f7fe700 1 -- 172.21.15.117:0/2661312218 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c012750 con 0x7f9928148250 2023-07-19T20:45:12.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992d1e1700 1 -- 172.21.15.117:0/2661312218 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99280b6f90 con 0x7f9928148250 2023-07-19T20:45:12.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f990f7fe700 1 -- 172.21.15.117:0/2661312218 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c012b00 con 0x7f9928148250 2023-07-19T20:45:12.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.192+0000 7f992d1e1700 1 -- 172.21.15.117:0/2661312218 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99280707a0 con 0x7f9928148250 2023-07-19T20:45:12.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.193+0000 7f992d1e1700 1 -- 172.21.15.117:0/2661312218 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99280b68b0 con 0x7f9928148250 2023-07-19T20:45:12.194 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.194+0000 7f990f7fe700 1 -- 172.21.15.117:0/2661312218 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f991c012c60 con 0x7f9928148250 2023-07-19T20:45:12.195 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.194+0000 7f990f7fe700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f991406a660 0x7f991406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.195 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.194+0000 7f990f7fe700 1 -- 172.21.15.117:0/2661312218 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f991c088e90 con 0x7f9928148250 2023-07-19T20:45:12.195 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.194+0000 7f9926d9d700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f991406a660 0x7f991406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.195 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.194+0000 7f9926d9d700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f991406a660 0x7f991406cb10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9918000f60 tx=0x7f9918009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:12.196 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.198+0000 7f990f7fe700 1 -- 172.21.15.117:0/2661312218 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f99280b68b0 con 0x7f9928148250 2023-07-19T20:45:12.418 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.425+0000 7f992d1e1700 1 -- 172.21.15.117:0/2661312218 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99280b68b0 con 0x7f9928148250 2023-07-19T20:45:12.419 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.425+0000 7f990f7fe700 1 -- 172.21.15.117:0/2661312218 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3892 (secure 0 0 0) 0x7f99280b68b0 con 0x7f9928148250 2023-07-19T20:45:12.420 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:12.421 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6833/1121968339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":1121968339},{"type":"v1","addr":"172.21.15.124:6833","nonce":1121968339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3740070710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3740070710},{"type":"v1","addr":"172.21.15.117:6835","nonce":3740070710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-19T20:44:38.547955+0000","modified":"2023-07-19T20:44:41.558655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/479216080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":479216080},{"type":"v1","addr":"172.21.15.117:6837","nonce":479216080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-19T20:45:12.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.428+0000 7f992d1e1700 1 -- 172.21.15.117:0/2661312218 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f991406a660 msgr2=0x7f991406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.428+0000 7f992d1e1700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f991406a660 0x7f991406cb10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9918000f60 tx=0x7f9918009040 comp rx=0 tx=0).stop 2023-07-19T20:45:12.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.428+0000 7f992d1e1700 1 -- 172.21.15.117:0/2661312218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9928148250 msgr2=0x7f99280b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.428+0000 7f992d1e1700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9928148250 0x7f99280b5ee0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f991c00d800 tx=0x7f991c00dbc0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.428+0000 7f992d1e1700 1 -- 172.21.15.117:0/2661312218 shutdown_connections 2023-07-19T20:45:12.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.428+0000 7f992d1e1700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f991406a660 0x7f991406cb10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.428+0000 7f992d1e1700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f992814e6a0 0x7f99280b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.428+0000 7f992d1e1700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f99280b09a0 0x7f9928148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.428+0000 7f992d1e1700 1 --2- 172.21.15.117:0/2661312218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9928148250 0x7f99280b5ee0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.428+0000 7f992d1e1700 1 -- 172.21.15.117:0/2661312218 >> 172.21.15.117:0/2661312218 conn(0x7f99280ba790 msgr2=0x7f99281473e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:12.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.428+0000 7f992d1e1700 1 -- 172.21.15.117:0/2661312218 shutdown_connections 2023-07-19T20:45:12.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.428+0000 7f992d1e1700 1 -- 172.21.15.117:0/2661312218 wait complete. 2023-07-19T20:45:12.426 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 8 2023-07-19T20:45:12.433 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:45:12.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.561+0000 7f00b721b700 1 Processor -- start 2023-07-19T20:45:12.555 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.561+0000 7f00b721b700 1 -- start start 2023-07-19T20:45:12.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.562+0000 7f00b721b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00b006f250 0x7f00b014bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.562+0000 7f00b721b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b0142ca0 con 0x7f00b00bce80 2023-07-19T20:45:12.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.562+0000 7f00b721b700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b00b7bd0 con 0x7f00b00b8d80 2023-07-19T20:45:12.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.562+0000 7f00b721b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b00b7eb0 con 0x7f00b006f250 2023-07-19T20:45:12.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.562+0000 7f00affff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00b006f250 0x7f00b014bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.562+0000 7f00b4fb7700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f00b00bce80 0x7f00b0142590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:60236/0 (socket says 172.21.15.117:60236) 2023-07-19T20:45:12.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.562+0000 7f00b4fb7700 1 -- 172.21.15.117:0/1869813642 learned_addr learned my addr 172.21.15.117:0/1869813642 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:12.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.562+0000 7f00affff700 1 -- 172.21.15.117:0/1869813642 >> v1:172.21.15.124:6789/0 conn(0x7f00b00b8d80 legacy=0x7f00b0152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.562+0000 7f00affff700 1 -- 172.21.15.117:0/1869813642 >> v1:172.21.15.117:6789/0 conn(0x7f00b00bce80 legacy=0x7f00b0142590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.565 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.563+0000 7f00af7fe700 1 -- 172.21.15.117:0/1869813642 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171253733 0 0) 0x7f00b0142ca0 con 0x7f00b00bce80 2023-07-19T20:45:12.565 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.563+0000 7f00affff700 1 -- 172.21.15.117:0/1869813642 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b00b8190 con 0x7f00b006f250 2023-07-19T20:45:12.565 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.563+0000 7f00affff700 1 --2- 172.21.15.117:0/1869813642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b006f250 0x7f00b014bca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f009c009840 tx=0x7f009c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd7f51aa2dd1eda server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:12.565 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.563+0000 7f00af7fe700 1 -- 172.21.15.117:0/1869813642 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c011830 con 0x7f00b006f250 2023-07-19T20:45:12.565 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.563+0000 7f00af7fe700 1 -- 172.21.15.117:0/1869813642 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c011990 con 0x7f00b006f250 2023-07-19T20:45:12.566 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.563+0000 7f00af7fe700 1 -- 172.21.15.117:0/1869813642 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c011d20 con 0x7f00b006f250 2023-07-19T20:45:12.566 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.563+0000 7f00b721b700 1 -- 172.21.15.117:0/1869813642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b006f250 msgr2=0x7f00b014bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.566 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.563+0000 7f00b721b700 1 --2- 172.21.15.117:0/1869813642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b006f250 0x7f00b014bca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f009c009840 tx=0x7f009c009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:12.567 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.563+0000 7f00b721b700 1 -- 172.21.15.117:0/1869813642 shutdown_connections 2023-07-19T20:45:12.567 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.563+0000 7f00b721b700 1 --2- 172.21.15.117:0/1869813642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b006f250 0x7f00b014bca0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.567 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.563+0000 7f00b721b700 1 -- 172.21.15.117:0/1869813642 >> 172.21.15.117:0/1869813642 conn(0x7f00b006b1f0 msgr2=0x7f00b00bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:12.567 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.563+0000 7f00b721b700 1 -- 172.21.15.117:0/1869813642 shutdown_connections 2023-07-19T20:45:12.568 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.563+0000 7f00b721b700 1 -- 172.21.15.117:0/1869813642 wait complete. 2023-07-19T20:45:12.568 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.564+0000 7f00b721b700 1 Processor -- start 2023-07-19T20:45:12.568 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.564+0000 7f00b721b700 1 -- start start 2023-07-19T20:45:12.568 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.565+0000 7f00b721b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b006f250 0x7f00b0143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.568 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.565+0000 7f00b721b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00b00b8d80 0x7f00b0146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.568 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.565+0000 7f00b721b700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00b00bce80 0x7f00b0147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.565+0000 7f00b721b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b01437b0 con 0x7f00b006f250 2023-07-19T20:45:12.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.565+0000 7f00b721b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b01e0700 con 0x7f00b00b8d80 2023-07-19T20:45:12.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.565+0000 7f00b721b700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b01e09e0 con 0x7f00b00bce80 2023-07-19T20:45:12.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.565+0000 7f00b4fb7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b006f250 0x7f00b0143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.565+0000 7f00b4fb7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b006f250 0x7f00b0143130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38166/0 (socket says 172.21.15.117:38166) 2023-07-19T20:45:12.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.565+0000 7f00b4fb7700 1 -- 172.21.15.117:0/2402693315 learned_addr learned my addr 172.21.15.117:0/2402693315 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:12.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.565+0000 7f00affff700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00b00b8d80 0x7f00b0146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.565+0000 7f00b57b8700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00b00bce80 0x7f00b0147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.566+0000 7f00b4fb7700 1 -- 172.21.15.117:0/2402693315 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00b00bce80 msgr2=0x7f00b0147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.566+0000 7f00b4fb7700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00b00bce80 0x7f00b0147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.566+0000 7f00b4fb7700 1 -- 172.21.15.117:0/2402693315 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00b00b8d80 msgr2=0x7f00b0146e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.566+0000 7f00b4fb7700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00b00b8d80 0x7f00b0146e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.571 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.566+0000 7f00b4fb7700 1 -- 172.21.15.117:0/2402693315 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c0094a0 con 0x7f00b006f250 2023-07-19T20:45:12.571 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.566+0000 7f00b57b8700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00b00bce80 0x7f00b0147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:12.571 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.566+0000 7f00b4fb7700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b006f250 0x7f00b0143130 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f00a400c520 tx=0x7f00a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:12.571 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.566+0000 7f00ad7fa700 1 -- 172.21.15.117:0/2402693315 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4004c80 con 0x7f00b006f250 2023-07-19T20:45:12.571 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.566+0000 7f00ad7fa700 1 -- 172.21.15.117:0/2402693315 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a4004e00 con 0x7f00b006f250 2023-07-19T20:45:12.571 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.566+0000 7f00b721b700 1 -- 172.21.15.117:0/2402693315 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b01e0cc0 con 0x7f00b006f250 2023-07-19T20:45:12.571 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.566+0000 7f00ad7fa700 1 -- 172.21.15.117:0/2402693315 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4007310 con 0x7f00b006f250 2023-07-19T20:45:12.571 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.566+0000 7f00b721b700 1 -- 172.21.15.117:0/2402693315 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b01e14c0 con 0x7f00b006f250 2023-07-19T20:45:12.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.567+0000 7f00b721b700 1 -- 172.21.15.117:0/2402693315 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b0074890 con 0x7f00b006f250 2023-07-19T20:45:12.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.567+0000 7f00ad7fa700 1 -- 172.21.15.117:0/2402693315 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f00a4007470 con 0x7f00b006f250 2023-07-19T20:45:12.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.567+0000 7f00ad7fa700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f009406a660 0x7f009406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.568+0000 7f00affff700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f009406a660 0x7f009406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.568+0000 7f00ad7fa700 1 -- 172.21.15.117:0/2402693315 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00a40887d0 con 0x7f00b006f250 2023-07-19T20:45:12.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.568+0000 7f00affff700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f009406a660 0x7f009406cb10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f00b0072d40 tx=0x7f009c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:12.573 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.572+0000 7f00ad7fa700 1 -- 172.21.15.117:0/2402693315 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f00a4053bd0 con 0x7f00b006f250 2023-07-19T20:45:12.751 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.757+0000 7f00b721b700 1 -- 172.21.15.117:0/2402693315 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00b0149550 con 0x7f00b006f250 2023-07-19T20:45:12.752 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.758+0000 7f00ad7fa700 1 -- 172.21.15.117:0/2402693315 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17897 (secure 0 0 0) 0x7f00a40571f0 con 0x7f00b006f250 2023-07-19T20:45:12.752 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:12.753 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:44:39.549566+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:44:36.280405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-19T20:44:37.509195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:45:12.756 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.761+0000 7f00b721b700 1 -- 172.21.15.117:0/2402693315 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f009406a660 msgr2=0x7f009406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.756 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.761+0000 7f00b721b700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f009406a660 0x7f009406cb10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f00b0072d40 tx=0x7f009c01c040 comp rx=0 tx=0).stop 2023-07-19T20:45:12.756 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.761+0000 7f00b721b700 1 -- 172.21.15.117:0/2402693315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b006f250 msgr2=0x7f00b0143130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.761+0000 7f00b721b700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b006f250 0x7f00b0143130 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f00a400c520 tx=0x7f00a400c8e0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.761+0000 7f00b721b700 1 -- 172.21.15.117:0/2402693315 shutdown_connections 2023-07-19T20:45:12.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.761+0000 7f00b721b700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f009406a660 0x7f009406cb10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.761+0000 7f00b721b700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00b00bce80 0x7f00b0147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.761+0000 7f00b721b700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b006f250 0x7f00b0143130 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.761+0000 7f00b721b700 1 --2- 172.21.15.117:0/2402693315 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00b00b8d80 0x7f00b0146e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.761+0000 7f00b721b700 1 -- 172.21.15.117:0/2402693315 >> 172.21.15.117:0/2402693315 conn(0x7f00b006b1f0 msgr2=0x7f00b01409e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:12.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.761+0000 7f00b721b700 1 -- 172.21.15.117:0/2402693315 shutdown_connections 2023-07-19T20:45:12.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.761+0000 7f00b721b700 1 -- 172.21.15.117:0/2402693315 wait complete. 2023-07-19T20:45:12.767 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-19T20:45:12.889 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.896+0000 7f3591c1e700 1 Processor -- start 2023-07-19T20:45:12.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.896+0000 7f3591c1e700 1 -- start start 2023-07-19T20:45:12.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f3591c1e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f358c0b8a20 0x7f358c153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f3591c1e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358c0b7900 con 0x7f358c0baa40 2023-07-19T20:45:12.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f3591c1e700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358c147a70 con 0x7f358c1475e0 2023-07-19T20:45:12.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f3591c1e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358c147d50 con 0x7f358c0b8a20 2023-07-19T20:45:12.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f358b7fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f358c0baa40 0x7f358c0b8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:60248/0 (socket says 172.21.15.117:60248) 2023-07-19T20:45:12.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f358b7fe700 1 -- 172.21.15.117:0/3942678022 learned_addr learned my addr 172.21.15.117:0/3942678022 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:12.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f358bfff700 1 --2- 172.21.15.117:0/3942678022 >> v2:172.21.15.124:3300/0 conn(0x7f358c0b8a20 0x7f358c153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f358a7fc700 1 -- 172.21.15.117:0/3942678022 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021175184 0 0) 0x7f358c0b7900 con 0x7f358c0baa40 2023-07-19T20:45:12.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f358a7fc700 1 -- 172.21.15.117:0/3942678022 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35740057c0 con 0x7f358c0baa40 2023-07-19T20:45:12.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f358a7fc700 1 -- 172.21.15.117:0/3942678022 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3192480801 0 0) 0x7f35740057c0 con 0x7f358c0baa40 2023-07-19T20:45:12.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f358a7fc700 1 -- 172.21.15.117:0/3942678022 >> v2:172.21.15.124:3300/0 conn(0x7f358c0b8a20 msgr2=0x7f358c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:12.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f358a7fc700 1 --2- 172.21.15.117:0/3942678022 >> v2:172.21.15.124:3300/0 conn(0x7f358c0b8a20 0x7f358c153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f358a7fc700 1 -- 172.21.15.117:0/3942678022 >> v1:172.21.15.124:6789/0 conn(0x7f358c1475e0 legacy=0x7f358c14fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f358a7fc700 1 -- 172.21.15.117:0/3942678022 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c148030 con 0x7f358c0baa40 2023-07-19T20:45:12.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f358a7fc700 1 -- 172.21.15.117:0/3942678022 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f357c001670 con 0x7f358c0baa40 2023-07-19T20:45:12.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.897+0000 7f358a7fc700 1 -- 172.21.15.117:0/3942678022 >> v1:172.21.15.117:6789/0 conn(0x7f358c0baa40 legacy=0x7f358c0b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358a7fc700 1 --2- 172.21.15.117:0/3942678022 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3574005c10 0x7f3574006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358a7fc700 1 --2- 172.21.15.117:0/3942678022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3574006a60 0x7f3574006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358a7fc700 1 --2- 172.21.15.117:0/3942678022 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3574007410 0x7f357400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358a7fc700 1 -- 172.21.15.117:0/3942678022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c147d50 con 0x7f3574006a60 2023-07-19T20:45:12.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358a7fc700 1 -- 172.21.15.117:0/3942678022 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357400e2a0 con 0x7f3574007410 2023-07-19T20:45:12.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358a7fc700 1 -- 172.21.15.117:0/3942678022 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357400e460 con 0x7f3574005c10 2023-07-19T20:45:12.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358affd700 1 --2- 172.21.15.117:0/3942678022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3574006a60 0x7f3574006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358b7fe700 1 --2- 172.21.15.117:0/3942678022 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3574005c10 0x7f3574006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358bfff700 1 --2- 172.21.15.117:0/3942678022 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3574007410 0x7f357400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358affd700 1 -- 172.21.15.117:0/3942678022 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3574005c10 msgr2=0x7f3574006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:12.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358affd700 1 --2- 172.21.15.117:0/3942678022 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3574005c10 0x7f3574006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.898 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358affd700 1 -- 172.21.15.117:0/3942678022 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3574007410 msgr2=0x7f357400dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:12.898 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358affd700 1 --2- 172.21.15.117:0/3942678022 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3574007410 0x7f357400dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.899 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358affd700 1 -- 172.21.15.117:0/3942678022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35740057c0 con 0x7f3574006a60 2023-07-19T20:45:12.899 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358bfff700 1 -- 172.21.15.117:0/3942678022 reap_dead start 2023-07-19T20:45:12.900 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358affd700 1 --2- 172.21.15.117:0/3942678022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3574006a60 0x7f3574006ed0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f35800017c0 tx=0x7f3574007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d5f63bcadb537a server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:12.900 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358a7fc700 1 -- 172.21.15.117:0/3942678022 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35800052d0 con 0x7f3574006a60 2023-07-19T20:45:12.900 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358a7fc700 1 -- 172.21.15.117:0/3942678022 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3580005450 con 0x7f3574006a60 2023-07-19T20:45:12.901 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.898+0000 7f358a7fc700 1 -- 172.21.15.117:0/3942678022 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35800038c0 con 0x7f3574006a60 2023-07-19T20:45:12.901 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.899+0000 7f3591c1e700 1 -- 172.21.15.117:0/3942678022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3574006a60 msgr2=0x7f3574006ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.901 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.899+0000 7f3591c1e700 1 --2- 172.21.15.117:0/3942678022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3574006a60 0x7f3574006ed0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f35800017c0 tx=0x7f3574007a90 comp rx=0 tx=0).stop 2023-07-19T20:45:12.901 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.899+0000 7f3591c1e700 1 -- 172.21.15.117:0/3942678022 shutdown_connections 2023-07-19T20:45:12.902 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.899+0000 7f3591c1e700 1 --2- 172.21.15.117:0/3942678022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3574006a60 0x7f3574006ed0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.902 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.899+0000 7f3591c1e700 1 -- 172.21.15.117:0/3942678022 >> 172.21.15.117:0/3942678022 conn(0x7f358c0be4b0 msgr2=0x7f358c0ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:12.903 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.899+0000 7f3591c1e700 1 -- 172.21.15.117:0/3942678022 shutdown_connections 2023-07-19T20:45:12.903 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.899+0000 7f3591c1e700 1 -- 172.21.15.117:0/3942678022 wait complete. 2023-07-19T20:45:12.907 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.900+0000 7f3591c1e700 1 Processor -- start 2023-07-19T20:45:12.907 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.900+0000 7f3591c1e700 1 -- start start 2023-07-19T20:45:12.907 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f3591c1e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3574006a60 0x7f358c1d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f3591c1e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f358c1449e0 0x7f358c0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f3591c1e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f358c0b5ee0 0x7f358c140b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f3591c1e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c1d3f60 con 0x7f358c0b5ee0 2023-07-19T20:45:12.908 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f3591c1e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0b5550 con 0x7f3574006a60 2023-07-19T20:45:12.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f3591c1e700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c1d60d0 con 0x7f358c1449e0 2023-07-19T20:45:12.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f358bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f358c0b5ee0 0x7f358c140b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f358bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f358c0b5ee0 0x7f358c140b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38182/0 (socket says 172.21.15.117:38182) 2023-07-19T20:45:12.909 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f358bfff700 1 -- 172.21.15.117:0/3941382079 learned_addr learned my addr 172.21.15.117:0/3941382079 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:12.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f358b7fe700 1 --2- 172.21.15.117:0/3941382079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3574006a60 0x7f358c1d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f358affd700 1 --2- 172.21.15.117:0/3941382079 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f358c1449e0 0x7f358c0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.910 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f358bfff700 1 -- 172.21.15.117:0/3941382079 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f358c1449e0 msgr2=0x7f358c0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f358bfff700 1 --2- 172.21.15.117:0/3941382079 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f358c1449e0 0x7f358c0b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f358bfff700 1 -- 172.21.15.117:0/3941382079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3574006a60 msgr2=0x7f358c1d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:12.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f358bfff700 1 --2- 172.21.15.117:0/3941382079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3574006a60 0x7f358c1d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:12.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f358bfff700 1 -- 172.21.15.117:0/3941382079 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c1d63b0 con 0x7f358c0b5ee0 2023-07-19T20:45:12.912 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f358bfff700 1 --2- 172.21.15.117:0/3941382079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f358c0b5ee0 0x7f358c140b60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f358c072350 tx=0x7f3584011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:12.912 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f3573fff700 1 -- 172.21.15.117:0/3941382079 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358400e040 con 0x7f358c0b5ee0 2023-07-19T20:45:12.912 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f3573fff700 1 -- 172.21.15.117:0/3941382079 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358400f040 con 0x7f358c0b5ee0 2023-07-19T20:45:12.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f3591c1e700 1 -- 172.21.15.117:0/3941382079 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c1d6690 con 0x7f358c0b5ee0 2023-07-19T20:45:12.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f3573fff700 1 -- 172.21.15.117:0/3941382079 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358400fbc0 con 0x7f358c0b5ee0 2023-07-19T20:45:12.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.901+0000 7f3591c1e700 1 -- 172.21.15.117:0/3941382079 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c0b50c0 con 0x7f358c0b5ee0 2023-07-19T20:45:12.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.902+0000 7f3591c1e700 1 -- 172.21.15.117:0/3941382079 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358c067940 con 0x7f358c0b5ee0 2023-07-19T20:45:12.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.903+0000 7f3573fff700 1 -- 172.21.15.117:0/3941382079 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f358400fd20 con 0x7f358c0b5ee0 2023-07-19T20:45:12.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.903+0000 7f3573fff700 1 --2- 172.21.15.117:0/3941382079 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f357806a690 0x7f357806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:12.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.903+0000 7f3573fff700 1 -- 172.21.15.117:0/3941382079 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3584088ea0 con 0x7f358c0b5ee0 2023-07-19T20:45:12.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.903+0000 7f358b7fe700 1 --2- 172.21.15.117:0/3941382079 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f357806a690 0x7f357806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:12.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.903+0000 7f358b7fe700 1 --2- 172.21.15.117:0/3941382079 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f357806a690 0x7f357806cb40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f357c0014a0 tx=0x7f357c001430 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:12.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:12.907+0000 7f3573fff700 1 -- 172.21.15.117:0/3941382079 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3584057dc0 con 0x7f358c0b5ee0 2023-07-19T20:45:13.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.135+0000 7f3591c1e700 1 -- 172.21.15.117:0/3941382079 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f358c0b9870 con 0x7f358c0b5ee0 2023-07-19T20:45:13.839 INFO:tasks.ceph.mon.a.smithi117.stderr:2023-07-19T20:45:13.846+0000 7f4e69a7d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-19T20:45:13.846 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.852+0000 7f3573fff700 1 -- 172.21.15.117:0/3941382079 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3584057950 con 0x7f358c0b5ee0 2023-07-19T20:45:13.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.855+0000 7f3591c1e700 1 -- 172.21.15.117:0/3941382079 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f357806a690 msgr2=0x7f357806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:13.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.855+0000 7f3591c1e700 1 --2- 172.21.15.117:0/3941382079 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f357806a690 0x7f357806cb40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f357c0014a0 tx=0x7f357c001430 comp rx=0 tx=0).stop 2023-07-19T20:45:13.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.855+0000 7f3591c1e700 1 -- 172.21.15.117:0/3941382079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f358c0b5ee0 msgr2=0x7f358c140b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:13.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.855+0000 7f3591c1e700 1 --2- 172.21.15.117:0/3941382079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f358c0b5ee0 0x7f358c140b60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f358c072350 tx=0x7f3584011ed0 comp rx=0 tx=0).stop 2023-07-19T20:45:13.849 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.855+0000 7f3591c1e700 1 -- 172.21.15.117:0/3941382079 shutdown_connections 2023-07-19T20:45:13.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.855+0000 7f3591c1e700 1 --2- 172.21.15.117:0/3941382079 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f357806a690 0x7f357806cb40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:13.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.855+0000 7f3591c1e700 1 --2- 172.21.15.117:0/3941382079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f358c0b5ee0 0x7f358c140b60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:13.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.855+0000 7f3591c1e700 1 --2- 172.21.15.117:0/3941382079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3574006a60 0x7f358c1d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:13.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.855+0000 7f3591c1e700 1 --2- 172.21.15.117:0/3941382079 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f358c1449e0 0x7f358c0b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:13.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.855+0000 7f3591c1e700 1 -- 172.21.15.117:0/3941382079 >> 172.21.15.117:0/3941382079 conn(0x7f358c0be4b0 msgr2=0x7f358c145420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:13.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.855+0000 7f3591c1e700 1 -- 172.21.15.117:0/3941382079 shutdown_connections 2023-07-19T20:45:13.850 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.855+0000 7f3591c1e700 1 -- 172.21.15.117:0/3941382079 wait complete. 2023-07-19T20:45:13.851 INFO:teuthology.orchestra.run.smithi117.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-19T20:45:13.851 INFO:tasks.ceph.mds.c.smithi117.stderr: -9501> 2023-07-19T20:44:44.268+0000 7f8823f97700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-19T20:45:13.863 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-19T20:45:13.886 INFO:tasks.ceph.mds.c.smithi117.stdout:starting mds.c at 2023-07-19T20:45:13.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.997+0000 7f2bc2926700 1 Processor -- start 2023-07-19T20:45:13.991 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.997+0000 7f2bc2926700 1 -- start start 2023-07-19T20:45:13.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.998+0000 7f2bc2926700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2bbc14af90 0x7f2bbc0a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:13.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.998+0000 7f2bc2926700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2bbc0a2050 0x7f2bbc073530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:13.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bc2926700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bbc14a3f0 con 0x7f2bbc141100 2023-07-19T20:45:13.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bc2926700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bbc0a0220 con 0x7f2bbc0a2050 2023-07-19T20:45:13.994 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bc2926700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc1414d0 con 0x7f2bbc14af90 2023-07-19T20:45:13.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bc0ec3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2bbc0a2050 0x7f2bbc073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:13.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bc0ec3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2bbc0a2050 0x7f2bbc073530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38210/0 (socket says 172.21.15.117:38210) 2023-07-19T20:45:13.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bc0ec3700 1 -- 172.21.15.117:0/1657037068 learned_addr learned my addr 172.21.15.117:0/1657037068 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:13.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bbb7fe700 1 --2- 172.21.15.117:0/1657037068 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2bbc14af90 0x7f2bbc0a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:13.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bc0ec3700 1 -- 172.21.15.117:0/1657037068 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2bbc14af90 msgr2=0x7f2bbc0a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:13.995 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bc0ec3700 1 --2- 172.21.15.117:0/1657037068 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2bbc14af90 0x7f2bbc0a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:13.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bc0ec3700 1 -- 172.21.15.117:0/1657037068 >> v1:172.21.15.124:6789/0 conn(0x7f2bbc141100 legacy=0x7f2bbc14a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:13.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bc0ec3700 1 -- 172.21.15.117:0/1657037068 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc0bc6f0 con 0x7f2bbc0a2050 2023-07-19T20:45:13.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bc0ec3700 1 --2- 172.21.15.117:0/1657037068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc0a2050 0x7f2bbc073530 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400d150 tx=0x7f2bb400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8683197ff95553 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:13.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bbaffd700 1 -- 172.21.15.117:0/1657037068 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4010070 con 0x7f2bbc0a2050 2023-07-19T20:45:13.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bbaffd700 1 -- 172.21.15.117:0/1657037068 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb400dd80 con 0x7f2bbc0a2050 2023-07-19T20:45:13.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:13.999+0000 7f2bbaffd700 1 -- 172.21.15.117:0/1657037068 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400b310 con 0x7f2bbc0a2050 2023-07-19T20:45:13.997 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.000+0000 7f2bc2926700 1 -- 172.21.15.117:0/1657037068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc0a2050 msgr2=0x7f2bbc073530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:13.997 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.000+0000 7f2bc2926700 1 --2- 172.21.15.117:0/1657037068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc0a2050 0x7f2bbc073530 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400d150 tx=0x7f2bb400d460 comp rx=0 tx=0).stop 2023-07-19T20:45:13.997 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.000+0000 7f2bc2926700 1 -- 172.21.15.117:0/1657037068 shutdown_connections 2023-07-19T20:45:13.997 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.000+0000 7f2bc2926700 1 --2- 172.21.15.117:0/1657037068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc0a2050 0x7f2bbc073530 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:13.997 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.000+0000 7f2bc2926700 1 --2- 172.21.15.117:0/1657037068 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2bbc14af90 0x7f2bbc0a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:13.997 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.000+0000 7f2bc2926700 1 -- 172.21.15.117:0/1657037068 >> 172.21.15.117:0/1657037068 conn(0x7f2bbc0bd0b0 msgr2=0x7f2bbc0bd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:13.998 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.000+0000 7f2bc2926700 1 -- 172.21.15.117:0/1657037068 shutdown_connections 2023-07-19T20:45:13.998 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.000+0000 7f2bc2926700 1 -- 172.21.15.117:0/1657037068 wait complete. 2023-07-19T20:45:14.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.001+0000 7f2bc2926700 1 Processor -- start 2023-07-19T20:45:14.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.001+0000 7f2bc2926700 1 -- start start 2023-07-19T20:45:14.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bc2926700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2bbc0a2050 0x7f2bbc0717a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:14.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bc2926700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc141100 0x7f2bbc1dc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:14.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bc2926700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2bbc14af90 0x7f2bbc0709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:14.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bc2926700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc0acb90 con 0x7f2bbc141100 2023-07-19T20:45:14.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bc2926700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc071ce0 con 0x7f2bbc0a2050 2023-07-19T20:45:14.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bc2926700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc1dcbb0 con 0x7f2bbc14af90 2023-07-19T20:45:14.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bbb7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc141100 0x7f2bbc1dc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:14.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bbb7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc141100 0x7f2bbc1dc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38222/0 (socket says 172.21.15.117:38222) 2023-07-19T20:45:14.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bbb7fe700 1 -- 172.21.15.117:0/2408663294 learned_addr learned my addr 172.21.15.117:0/2408663294 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:14.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bbbfff700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2bbc0a2050 0x7f2bbc0717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:14.003 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bc0ec3700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2bbc14af90 0x7f2bbc0709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:14.003 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bbb7fe700 1 -- 172.21.15.117:0/2408663294 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2bbc14af90 msgr2=0x7f2bbc0709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:14.003 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bbb7fe700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2bbc14af90 0x7f2bbc0709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:14.003 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bbb7fe700 1 -- 172.21.15.117:0/2408663294 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2bbc0a2050 msgr2=0x7f2bbc0717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:14.003 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bbb7fe700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2bbc0a2050 0x7f2bbc0717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:14.003 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bbb7fe700 1 -- 172.21.15.117:0/2408663294 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb400bd40 con 0x7f2bbc141100 2023-07-19T20:45:14.004 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bc0ec3700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2bbc14af90 0x7f2bbc0709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:14.004 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bbb7fe700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc141100 0x7f2bbc1dc670 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000e810 tx=0x7f2bb000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:14.004 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bb8ff9700 1 -- 172.21.15.117:0/2408663294 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0013610 con 0x7f2bbc141100 2023-07-19T20:45:14.004 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bb8ff9700 1 -- 172.21.15.117:0/2408663294 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb0013770 con 0x7f2bbc141100 2023-07-19T20:45:14.005 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bb8ff9700 1 -- 172.21.15.117:0/2408663294 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0013b20 con 0x7f2bbc141100 2023-07-19T20:45:14.005 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bc2926700 1 -- 172.21.15.117:0/2408663294 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bbc1d6860 con 0x7f2bbc141100 2023-07-19T20:45:14.005 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.002+0000 7f2bc2926700 1 -- 172.21.15.117:0/2408663294 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bbc146300 con 0x7f2bbc141100 2023-07-19T20:45:14.005 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.003+0000 7f2bc2926700 1 -- 172.21.15.117:0/2408663294 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bbc0a1750 con 0x7f2bbc141100 2023-07-19T20:45:14.005 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.004+0000 7f2bb8ff9700 1 -- 172.21.15.117:0/2408663294 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f2bb0013c80 con 0x7f2bbc141100 2023-07-19T20:45:14.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.004+0000 7f2bb8ff9700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2ba806a660 0x7f2ba806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:14.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.004+0000 7f2bb8ff9700 1 -- 172.21.15.117:0/2408663294 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f2bb0088810 con 0x7f2bbc141100 2023-07-19T20:45:14.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.004+0000 7f2bbbfff700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2ba806a660 0x7f2ba806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:14.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.005+0000 7f2bbbfff700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2ba806a660 0x7f2ba806cb10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2bac007fd0 tx=0x7f2bac007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:14.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.009+0000 7f2bb8ff9700 1 -- 172.21.15.117:0/2408663294 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2bb0057650 con 0x7f2bbc141100 2023-07-19T20:45:14.229 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.236+0000 7f2bc2926700 1 -- 172.21.15.117:0/2408663294 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2bbc14a860 con 0x7f2bbc141100 2023-07-19T20:45:14.464 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:45:14.466 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:45:14.468 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:45:14.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.856+0000 7f2bb8ff9700 1 -- 172.21.15.117:0/2408663294 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2bb00571e0 con 0x7f2bbc141100 2023-07-19T20:45:14.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.860+0000 7f2bc2926700 1 -- 172.21.15.117:0/2408663294 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2ba806a660 msgr2=0x7f2ba806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:14.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.860+0000 7f2bc2926700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2ba806a660 0x7f2ba806cb10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2bac007fd0 tx=0x7f2bac007ec0 comp rx=0 tx=0).stop 2023-07-19T20:45:14.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.860+0000 7f2bc2926700 1 -- 172.21.15.117:0/2408663294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc141100 msgr2=0x7f2bbc1dc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:14.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.860+0000 7f2bc2926700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc141100 0x7f2bbc1dc670 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000e810 tx=0x7f2bb000eb20 comp rx=0 tx=0).stop 2023-07-19T20:45:14.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.860+0000 7f2bc2926700 1 -- 172.21.15.117:0/2408663294 shutdown_connections 2023-07-19T20:45:14.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.860+0000 7f2bc2926700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2ba806a660 0x7f2ba806cb10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:14.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.860+0000 7f2bc2926700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2bbc14af90 0x7f2bbc0709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:14.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.860+0000 7f2bc2926700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2bbc0a2050 0x7f2bbc0717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:14.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.860+0000 7f2bc2926700 1 --2- 172.21.15.117:0/2408663294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bbc141100 0x7f2bbc1dc670 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:14.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.860+0000 7f2bc2926700 1 -- 172.21.15.117:0/2408663294 >> 172.21.15.117:0/2408663294 conn(0x7f2bbc0bd0b0 msgr2=0x7f2bbc0b0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:14.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.860+0000 7f2bc2926700 1 -- 172.21.15.117:0/2408663294 shutdown_connections 2023-07-19T20:45:14.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:14.860+0000 7f2bc2926700 1 -- 172.21.15.117:0/2408663294 wait complete. 2023-07-19T20:45:14.867 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-19T20:45:14.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.002+0000 7f6c2bb68700 1 Processor -- start 2023-07-19T20:45:14.996 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.002+0000 7f6c2bb68700 1 -- start start 2023-07-19T20:45:14.998 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.003+0000 7f6c2bb68700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6c240c0300 0x7f6c2414ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:14.998 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.003+0000 7f6c2bb68700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6c240beaf0 0x7f6c2414abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:14.999 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.003+0000 7f6c2bb68700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c240c06d0 0x7f6c240bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:14.999 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.003+0000 7f6c2bb68700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c240bfef0 con 0x7f6c240c0300 2023-07-19T20:45:14.999 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.003+0000 7f6c2bb68700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c24148640 con 0x7f6c240beaf0 2023-07-19T20:45:14.999 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.003+0000 7f6c2bb68700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2408b2c0 con 0x7f6c240c06d0 2023-07-19T20:45:14.999 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.003+0000 7f6c29904700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6c240c0300 0x7f6c2414ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:14.999 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.003+0000 7f6c29904700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6c240c0300 0x7f6c2414ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38226/0 (socket says 172.21.15.117:38226) 2023-07-19T20:45:15.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.003+0000 7f6c29904700 1 -- 172.21.15.117:0/3144704692 learned_addr learned my addr 172.21.15.117:0/3144704692 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:15.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.003+0000 7f6c2a105700 1 --2- 172.21.15.117:0/3144704692 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c240c06d0 0x7f6c240bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:15.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.003+0000 7f6c29103700 1 --2- 172.21.15.117:0/3144704692 >> v2:172.21.15.124:3300/0 conn(0x7f6c240beaf0 0x7f6c2414abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:15.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.003+0000 7f6c29904700 1 -- 172.21.15.117:0/3144704692 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c240c06d0 msgr2=0x7f6c240bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:15.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.003+0000 7f6c29904700 1 --2- 172.21.15.117:0/3144704692 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c240c06d0 0x7f6c240bf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:15.000 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c29904700 1 -- 172.21.15.117:0/3144704692 >> v2:172.21.15.124:3300/0 conn(0x7f6c240beaf0 msgr2=0x7f6c2414abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:15.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c29904700 1 --2- 172.21.15.117:0/3144704692 >> v2:172.21.15.124:3300/0 conn(0x7f6c240beaf0 0x7f6c2414abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:15.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c29904700 1 -- 172.21.15.117:0/3144704692 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c240bf010 con 0x7f6c240c0300 2023-07-19T20:45:15.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c29904700 1 --2- 172.21.15.117:0/3144704692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c240c0300 0x7f6c2414ec00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c240a38e0 tx=0x7f6c14009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5247fe16a015a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:15.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c28902700 1 -- 172.21.15.117:0/3144704692 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14011830 con 0x7f6c240c0300 2023-07-19T20:45:15.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c28902700 1 -- 172.21.15.117:0/3144704692 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c14011990 con 0x7f6c240c0300 2023-07-19T20:45:15.001 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c28902700 1 -- 172.21.15.117:0/3144704692 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14011d20 con 0x7f6c240c0300 2023-07-19T20:45:15.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c2bb68700 1 -- 172.21.15.117:0/3144704692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c240c0300 msgr2=0x7f6c2414ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:15.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c2bb68700 1 --2- 172.21.15.117:0/3144704692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c240c0300 0x7f6c2414ec00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c240a38e0 tx=0x7f6c14009bd0 comp rx=0 tx=0).stop 2023-07-19T20:45:15.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c2bb68700 1 -- 172.21.15.117:0/3144704692 shutdown_connections 2023-07-19T20:45:15.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c2bb68700 1 --2- 172.21.15.117:0/3144704692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c240c0300 0x7f6c2414ec00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:15.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c2bb68700 1 --2- 172.21.15.117:0/3144704692 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c240c06d0 0x7f6c240bf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:15.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c2bb68700 1 --2- 172.21.15.117:0/3144704692 >> v2:172.21.15.124:3300/0 conn(0x7f6c240beaf0 0x7f6c2414abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:15.002 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c2bb68700 1 -- 172.21.15.117:0/3144704692 >> 172.21.15.117:0/3144704692 conn(0x7f6c240a2800 msgr2=0x7f6c240a2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:15.003 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c2bb68700 1 -- 172.21.15.117:0/3144704692 shutdown_connections 2023-07-19T20:45:15.003 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.004+0000 7f6c2bb68700 1 -- 172.21.15.117:0/3144704692 wait complete. 2023-07-19T20:45:15.005 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.005+0000 7f6c2bb68700 1 Processor -- start 2023-07-19T20:45:15.005 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.005+0000 7f6c2bb68700 1 -- start start 2023-07-19T20:45:15.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c2bb68700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c240beaf0 0x7f6c24149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:15.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c2bb68700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c240c0300 0x7f6c240b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:15.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c2bb68700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c240c06d0 0x7f6c241474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:15.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c2bb68700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2414a350 con 0x7f6c240c06d0 2023-07-19T20:45:15.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c2bb68700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240a6a20 con 0x7f6c240c0300 2023-07-19T20:45:15.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c2bb68700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240b5f70 con 0x7f6c240beaf0 2023-07-19T20:45:15.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c2a105700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c240c06d0 0x7f6c241474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:15.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c2a105700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c240c06d0 0x7f6c241474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38228/0 (socket says 172.21.15.117:38228) 2023-07-19T20:45:15.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c2a105700 1 -- 172.21.15.117:0/1589302750 learned_addr learned my addr 172.21.15.117:0/1589302750 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:15.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c29904700 1 --2- 172.21.15.117:0/1589302750 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c240beaf0 0x7f6c24149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:15.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c29103700 1 --2- 172.21.15.117:0/1589302750 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c240c0300 0x7f6c240b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:15.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c2a105700 1 -- 172.21.15.117:0/1589302750 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c240beaf0 msgr2=0x7f6c24149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:15.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c2a105700 1 --2- 172.21.15.117:0/1589302750 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c240beaf0 0x7f6c24149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:15.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c2a105700 1 -- 172.21.15.117:0/1589302750 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c240c0300 msgr2=0x7f6c240b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:15.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c2a105700 1 --2- 172.21.15.117:0/1589302750 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c240c0300 0x7f6c240b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:15.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.006+0000 7f6c2a105700 1 -- 172.21.15.117:0/1589302750 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c14009550 con 0x7f6c240c06d0 2023-07-19T20:45:15.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.007+0000 7f6c2a105700 1 --2- 172.21.15.117:0/1589302750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c240c06d0 0x7f6c241474a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00efc0 tx=0x7f6c1c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:15.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.007+0000 7f6c1a7fc700 1 -- 172.21.15.117:0/1589302750 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c009ea0 con 0x7f6c240c06d0 2023-07-19T20:45:15.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.007+0000 7f6c1a7fc700 1 -- 172.21.15.117:0/1589302750 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1c00f040 con 0x7f6c240c06d0 2023-07-19T20:45:15.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.007+0000 7f6c2bb68700 1 -- 172.21.15.117:0/1589302750 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c240a63d0 con 0x7f6c240c06d0 2023-07-19T20:45:15.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.007+0000 7f6c1a7fc700 1 -- 172.21.15.117:0/1589302750 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c00ced0 con 0x7f6c240c06d0 2023-07-19T20:45:15.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.007+0000 7f6c2bb68700 1 -- 172.21.15.117:0/1589302750 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2414a650 con 0x7f6c240c06d0 2023-07-19T20:45:15.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.008+0000 7f6c2bb68700 1 -- 172.21.15.117:0/1589302750 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c24074890 con 0x7f6c240c06d0 2023-07-19T20:45:15.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.008+0000 7f6c1a7fc700 1 -- 172.21.15.117:0/1589302750 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f6c1c014480 con 0x7f6c240c06d0 2023-07-19T20:45:15.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.009+0000 7f6c1a7fc700 1 --2- 172.21.15.117:0/1589302750 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f6c0806a660 0x7f6c0806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:15.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.009+0000 7f6c1a7fc700 1 -- 172.21.15.117:0/1589302750 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6c1c0892f0 con 0x7f6c240c06d0 2023-07-19T20:45:15.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.009+0000 7f6c29904700 1 --2- 172.21.15.117:0/1589302750 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f6c0806a660 0x7f6c0806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:15.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.009+0000 7f6c29904700 1 --2- 172.21.15.117:0/1589302750 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f6c0806a660 0x7f6c0806cb10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009c10 tx=0x7f6c14008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:15.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.013+0000 7f6c1a7fc700 1 -- 172.21.15.117:0/1589302750 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f6c1c0545f0 con 0x7f6c240c06d0 2023-07-19T20:45:15.193 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.200+0000 7f6c2bb68700 1 -- 172.21.15.117:0/1589302750 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6c240684f0 con 0x7f6c240c06d0 2023-07-19T20:45:15.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.860+0000 7f6c1a7fc700 1 -- 172.21.15.117:0/1589302750 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6c1c057c10 con 0x7f6c240c06d0 2023-07-19T20:45:15.861 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.865+0000 7f6c2bb68700 1 -- 172.21.15.117:0/1589302750 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f6c0806a660 msgr2=0x7f6c0806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:15.861 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.865+0000 7f6c2bb68700 1 --2- 172.21.15.117:0/1589302750 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f6c0806a660 0x7f6c0806cb10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009c10 tx=0x7f6c14008030 comp rx=0 tx=0).stop 2023-07-19T20:45:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.865+0000 7f6c2bb68700 1 -- 172.21.15.117:0/1589302750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c240c06d0 msgr2=0x7f6c241474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.865+0000 7f6c2bb68700 1 --2- 172.21.15.117:0/1589302750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c240c06d0 0x7f6c241474a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00efc0 tx=0x7f6c1c00c3a0 comp rx=0 tx=0).stop 2023-07-19T20:45:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.865+0000 7f6c2bb68700 1 -- 172.21.15.117:0/1589302750 shutdown_connections 2023-07-19T20:45:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.865+0000 7f6c2bb68700 1 --2- 172.21.15.117:0/1589302750 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f6c0806a660 0x7f6c0806cb10 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009c10 tx=0x7f6c14008030 comp rx=0 tx=0).stop 2023-07-19T20:45:15.863 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.865+0000 7f6c2bb68700 1 --2- 172.21.15.117:0/1589302750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c240c06d0 0x7f6c241474a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:15.863 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.865+0000 7f6c2bb68700 1 --2- 172.21.15.117:0/1589302750 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c240beaf0 0x7f6c24149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:15.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.865+0000 7f6c2bb68700 1 --2- 172.21.15.117:0/1589302750 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c240c0300 0x7f6c240b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:15.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.865+0000 7f6c2bb68700 1 -- 172.21.15.117:0/1589302750 >> 172.21.15.117:0/1589302750 conn(0x7f6c240a2800 msgr2=0x7f6c240bf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:15.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.866+0000 7f6c2bb68700 1 -- 172.21.15.117:0/1589302750 shutdown_connections 2023-07-19T20:45:15.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:15.866+0000 7f6c2bb68700 1 -- 172.21.15.117:0/1589302750 wait complete. 2023-07-19T20:45:15.865 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_metadata' removed 2023-07-19T20:45:15.875 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-19T20:45:16.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.012+0000 7fe74292f700 1 Processor -- start 2023-07-19T20:45:16.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.012+0000 7fe74292f700 1 -- start start 2023-07-19T20:45:16.012 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe74292f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe73c06a7d0 0x7fe73c06ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:16.013 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe74292f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c072500 con 0x7fe73c141160 2023-07-19T20:45:16.013 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe74292f700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c071970 con 0x7fe73c0bdfe0 2023-07-19T20:45:16.013 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe74292f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73c0715c0 con 0x7fe73c06a7d0 2023-07-19T20:45:16.013 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73b7fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe73c141160 0x7fe73c0bd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:60260/0 (socket says 172.21.15.117:60260) 2023-07-19T20:45:16.014 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73b7fe700 1 -- 172.21.15.117:0/633544636 learned_addr learned my addr 172.21.15.117:0/633544636 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:16.014 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73bfff700 1 --2- 172.21.15.117:0/633544636 >> v2:172.21.15.124:3300/0 conn(0x7fe73c06a7d0 0x7fe73c06ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:16.014 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 -- 172.21.15.117:0/633544636 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118275753 0 0) 0x7fe73c072500 con 0x7fe73c141160 2023-07-19T20:45:16.014 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 -- 172.21.15.117:0/633544636 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7240035b0 con 0x7fe73c141160 2023-07-19T20:45:16.015 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 -- 172.21.15.117:0/633544636 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3503905788 0 0) 0x7fe7240035b0 con 0x7fe73c141160 2023-07-19T20:45:16.015 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 -- 172.21.15.117:0/633544636 >> v2:172.21.15.124:3300/0 conn(0x7fe73c06a7d0 msgr2=0x7fe73c06ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:16.015 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 --2- 172.21.15.117:0/633544636 >> v2:172.21.15.124:3300/0 conn(0x7fe73c06a7d0 0x7fe73c06ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:16.015 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 -- 172.21.15.117:0/633544636 >> v1:172.21.15.124:6789/0 conn(0x7fe73c0bdfe0 legacy=0x7fe73c155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:16.016 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 -- 172.21.15.117:0/633544636 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c0704e0 con 0x7fe73c141160 2023-07-19T20:45:16.016 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 -- 172.21.15.117:0/633544636 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7fe730001670 con 0x7fe73c141160 2023-07-19T20:45:16.016 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 -- 172.21.15.117:0/633544636 >> v1:172.21.15.117:6789/0 conn(0x7fe73c141160 legacy=0x7fe73c0bd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:16.016 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 --2- 172.21.15.117:0/633544636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe724003a00 0x7fe724003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:16.016 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 --2- 172.21.15.117:0/633544636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe724004850 0x7fe724004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:16.016 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 --2- 172.21.15.117:0/633544636 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe724005200 0x7fe72400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:16.016 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 -- 172.21.15.117:0/633544636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0715c0 con 0x7fe724003a00 2023-07-19T20:45:16.017 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 -- 172.21.15.117:0/633544636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72400c060 con 0x7fe724004850 2023-07-19T20:45:16.017 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.013+0000 7fe73affd700 1 -- 172.21.15.117:0/633544636 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72400c220 con 0x7fe724005200 2023-07-19T20:45:16.017 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.014+0000 7fe73bfff700 1 --2- 172.21.15.117:0/633544636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe724003a00 0x7fe724003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:16.017 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.014+0000 7fe73b7fe700 1 --2- 172.21.15.117:0/633544636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe724004850 0x7fe724004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:16.017 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.014+0000 7fe740ecc700 1 --2- 172.21.15.117:0/633544636 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe724005200 0x7fe72400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:16.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.014+0000 7fe73bfff700 1 -- 172.21.15.117:0/633544636 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe724005200 msgr2=0x7fe72400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:16.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.014+0000 7fe73bfff700 1 --2- 172.21.15.117:0/633544636 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe724005200 0x7fe72400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:16.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.014+0000 7fe73bfff700 1 -- 172.21.15.117:0/633544636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe724004850 msgr2=0x7fe724004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:16.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.014+0000 7fe73bfff700 1 --2- 172.21.15.117:0/633544636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe724004850 0x7fe724004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:16.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.014+0000 7fe740ecc700 1 -- 172.21.15.117:0/633544636 reap_dead start 2023-07-19T20:45:16.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.014+0000 7fe73bfff700 1 -- 172.21.15.117:0/633544636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7240035b0 con 0x7fe724003a00 2023-07-19T20:45:16.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.014+0000 7fe73b7fe700 1 --2- 172.21.15.117:0/633544636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe724004850 0x7fe724004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:16.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.014+0000 7fe73bfff700 1 --2- 172.21.15.117:0/633544636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe724003a00 0x7fe724003e10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009b60 tx=0x7fe724005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7490bf73c53d57 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:16.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.014+0000 7fe73affd700 1 -- 172.21.15.117:0/633544636 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c00e6c0 con 0x7fe724003a00 2023-07-19T20:45:16.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.014+0000 7fe73affd700 1 -- 172.21.15.117:0/633544636 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c00e820 con 0x7fe724003a00 2023-07-19T20:45:16.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.014+0000 7fe73affd700 1 -- 172.21.15.117:0/633544636 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c00eb90 con 0x7fe724003a00 2023-07-19T20:45:16.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.015+0000 7fe74292f700 1 -- 172.21.15.117:0/633544636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe724003a00 msgr2=0x7fe724003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:16.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.015+0000 7fe74292f700 1 --2- 172.21.15.117:0/633544636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe724003a00 0x7fe724003e10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009b60 tx=0x7fe724005880 comp rx=0 tx=0).stop 2023-07-19T20:45:16.020 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.015+0000 7fe74292f700 1 -- 172.21.15.117:0/633544636 shutdown_connections 2023-07-19T20:45:16.020 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.015+0000 7fe74292f700 1 --2- 172.21.15.117:0/633544636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe724003a00 0x7fe724003e10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:16.020 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.015+0000 7fe74292f700 1 -- 172.21.15.117:0/633544636 >> 172.21.15.117:0/633544636 conn(0x7fe73c06b670 msgr2=0x7fe73c06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:16.022 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.015+0000 7fe74292f700 1 -- 172.21.15.117:0/633544636 shutdown_connections 2023-07-19T20:45:16.022 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.015+0000 7fe74292f700 1 -- 172.21.15.117:0/633544636 wait complete. 2023-07-19T20:45:16.022 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.016+0000 7fe74292f700 1 Processor -- start 2023-07-19T20:45:16.023 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.016+0000 7fe74292f700 1 -- start start 2023-07-19T20:45:16.023 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.016+0000 7fe74292f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe724003a00 0x7fe73c143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:16.023 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.016+0000 7fe74292f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe73c14bbb0 0x7fe73c14d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:16.023 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.016+0000 7fe74292f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe73c14de50 0x7fe73c1e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:16.025 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.016+0000 7fe74292f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c142ea0 con 0x7fe724003a00 2023-07-19T20:45:16.025 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.016+0000 7fe74292f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c14e2f0 con 0x7fe73c14de50 2023-07-19T20:45:16.025 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.016+0000 7fe74292f700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c1444d0 con 0x7fe73c14bbb0 2023-07-19T20:45:16.026 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe73bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe724003a00 0x7fe73c143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:16.026 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe73bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe724003a00 0x7fe73c143f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38240/0 (socket says 172.21.15.117:38240) 2023-07-19T20:45:16.027 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe73bfff700 1 -- 172.21.15.117:0/544734626 learned_addr learned my addr 172.21.15.117:0/544734626 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:16.027 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe73b7fe700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe73c14bbb0 0x7fe73c14d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:16.028 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe740ecc700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe73c14de50 0x7fe73c1e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:16.028 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe73bfff700 1 -- 172.21.15.117:0/544734626 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe73c14bbb0 msgr2=0x7fe73c14d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:16.029 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe73bfff700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe73c14bbb0 0x7fe73c14d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:16.030 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe73bfff700 1 -- 172.21.15.117:0/544734626 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe73c14de50 msgr2=0x7fe73c1e34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:16.030 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe73bfff700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe73c14de50 0x7fe73c1e34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:16.030 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe73bfff700 1 -- 172.21.15.117:0/544734626 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c14c040 con 0x7fe724003a00 2023-07-19T20:45:16.031 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe740ecc700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe73c14de50 0x7fe73c1e34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:16.032 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe73bfff700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe724003a00 0x7fe73c143f90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe72400c030 tx=0x7fe72c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:16.032 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe738ff9700 1 -- 172.21.15.117:0/544734626 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c00e6c0 con 0x7fe724003a00 2023-07-19T20:45:16.033 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe738ff9700 1 -- 172.21.15.117:0/544734626 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c003ad0 con 0x7fe724003a00 2023-07-19T20:45:16.033 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe74292f700 1 -- 172.21.15.117:0/544734626 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73c0bc830 con 0x7fe724003a00 2023-07-19T20:45:16.033 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe738ff9700 1 -- 172.21.15.117:0/544734626 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c003e80 con 0x7fe724003a00 2023-07-19T20:45:16.034 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.017+0000 7fe74292f700 1 -- 172.21.15.117:0/544734626 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73c0bcdf0 con 0x7fe724003a00 2023-07-19T20:45:16.034 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.018+0000 7fe74292f700 1 -- 172.21.15.117:0/544734626 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73c067940 con 0x7fe724003a00 2023-07-19T20:45:16.035 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.018+0000 7fe738ff9700 1 -- 172.21.15.117:0/544734626 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fe72c013470 con 0x7fe724003a00 2023-07-19T20:45:16.036 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.019+0000 7fe738ff9700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe72806a660 0x7fe72806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:16.036 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.019+0000 7fe738ff9700 1 -- 172.21.15.117:0/544734626 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5710+0+0 (secure 0 0 0) 0x7fe72c089ef0 con 0x7fe724003a00 2023-07-19T20:45:16.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.019+0000 7fe73b7fe700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe72806a660 0x7fe72806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:16.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.019+0000 7fe73b7fe700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe72806a660 0x7fe72806cb10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe73c13fdf0 tx=0x7fe730007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:16.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.023+0000 7fe738ff9700 1 -- 172.21.15.117:0/544734626 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fe72c0554e0 con 0x7fe724003a00 2023-07-19T20:45:16.201 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.208+0000 7fe74292f700 1 -- 172.21.15.117:0/544734626 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe73c14d5d0 con 0x7fe724003a00 2023-07-19T20:45:16.858 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.865+0000 7fe738ff9700 1 -- 172.21.15.117:0/544734626 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe72c017020 con 0x7fe724003a00 2023-07-19T20:45:16.862 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.868+0000 7fe74292f700 1 -- 172.21.15.117:0/544734626 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe72806a660 msgr2=0x7fe72806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:16.862 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.868+0000 7fe74292f700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe72806a660 0x7fe72806cb10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe73c13fdf0 tx=0x7fe730007040 comp rx=0 tx=0).stop 2023-07-19T20:45:16.863 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.868+0000 7fe74292f700 1 -- 172.21.15.117:0/544734626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe724003a00 msgr2=0x7fe73c143f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:16.863 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.868+0000 7fe74292f700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe724003a00 0x7fe73c143f90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe72400c030 tx=0x7fe72c0047c0 comp rx=0 tx=0).stop 2023-07-19T20:45:16.863 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.869+0000 7fe74292f700 1 -- 172.21.15.117:0/544734626 shutdown_connections 2023-07-19T20:45:16.863 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.869+0000 7fe74292f700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fe72806a660 0x7fe72806cb10 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe73c13fdf0 tx=0x7fe730007040 comp rx=0 tx=0).stop 2023-07-19T20:45:16.863 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.869+0000 7fe74292f700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe73c14de50 0x7fe73c1e34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:16.863 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.869+0000 7fe74292f700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe724003a00 0x7fe73c143f90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:16.863 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.869+0000 7fe74292f700 1 --2- 172.21.15.117:0/544734626 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe73c14bbb0 0x7fe73c14d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:16.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.869+0000 7fe74292f700 1 -- 172.21.15.117:0/544734626 >> 172.21.15.117:0/544734626 conn(0x7fe73c06b670 msgr2=0x7fe73c0ba3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:16.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.869+0000 7fe74292f700 1 -- 172.21.15.117:0/544734626 shutdown_connections 2023-07-19T20:45:16.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:16.869+0000 7fe74292f700 1 -- 172.21.15.117:0/544734626 wait complete. 2023-07-19T20:45:16.865 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_data' removed 2023-07-19T20:45:16.877 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-19T20:45:16.878 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-19T20:45:16.878 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-19T20:45:16.878 INFO:teuthology.orchestra.run:waiting for 300 2023-07-19T20:45:16.879 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-19T20:45:16.879 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-19T20:45:16.879 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-19T20:45:16.879 INFO:teuthology.orchestra.run:waiting for 300 2023-07-19T20:45:16.880 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-19T20:45:16.880 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-19T20:45:16.880 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-19T20:45:16.881 INFO:teuthology.orchestra.run:waiting for 300 2023-07-19T20:45:16.889 INFO:tasks.ceph.mds.a:Stopped 2023-07-19T20:45:16.889 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-19T20:45:16.890 INFO:tasks.ceph.mds.c:Stopped 2023-07-19T20:45:16.890 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-19T20:45:16.891 INFO:tasks.ceph.mds.b:Stopped 2023-07-19T20:45:16.892 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-19T20:45:16.931 INFO:tasks.ceph.mds.a:Started 2023-07-19T20:45:16.932 DEBUG:teuthology.parallel:result is None 2023-07-19T20:45:16.933 INFO:tasks.ceph.mds.c:Started 2023-07-19T20:45:16.933 DEBUG:teuthology.parallel:result is None 2023-07-19T20:45:16.934 INFO:tasks.ceph.mds.b:Started 2023-07-19T20:45:16.934 DEBUG:teuthology.parallel:result is None 2023-07-19T20:45:16.935 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-19T20:45:17.014 INFO:tasks.ceph.mds.a.smithi117.stdout:starting mds.a at 2023-07-19T20:45:17.014 INFO:tasks.ceph.mds.c.smithi117.stdout:starting mds.c at 2023-07-19T20:45:17.026 INFO:tasks.ceph.mds.b.smithi124.stdout:starting mds.b at 2023-07-19T20:45:17.081 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.080+0000 7f1babf98700 1 Processor -- start 2023-07-19T20:45:17.082 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.080+0000 7f1babf98700 1 -- start start 2023-07-19T20:45:17.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.081+0000 7f1babf98700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1ba40c1470 0x7f1ba40b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:17.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.081+0000 7f1babf98700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ba40b9370 0x7f1ba4149f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:17.083 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.081+0000 7f1babf98700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba40bcd00 con 0x7f1ba414a490 2023-07-19T20:45:17.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.081+0000 7f1babf98700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba40b8710 con 0x7f1ba40b9370 2023-07-19T20:45:17.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.081+0000 7f1babf98700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba40b8bd0 con 0x7f1ba40c1470 2023-07-19T20:45:17.084 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.081+0000 7f1ba9533700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ba40b9370 0x7f1ba4149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:17.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.081+0000 7f1ba9533700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ba40b9370 0x7f1ba4149f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38270/0 (socket says 172.21.15.117:38270) 2023-07-19T20:45:17.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.081+0000 7f1ba9533700 1 -- 172.21.15.117:0/1939925956 learned_addr learned my addr 172.21.15.117:0/1939925956 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:17.085 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.081+0000 7f1ba9d34700 1 --2- 172.21.15.117:0/1939925956 >> v2:172.21.15.124:3300/0 conn(0x7f1ba40c1470 0x7f1ba40b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:17.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.082+0000 7f1ba9533700 1 -- 172.21.15.117:0/1939925956 >> v2:172.21.15.124:3300/0 conn(0x7f1ba40c1470 msgr2=0x7f1ba40b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:17.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.082+0000 7f1ba9533700 1 --2- 172.21.15.117:0/1939925956 >> v2:172.21.15.124:3300/0 conn(0x7f1ba40c1470 0x7f1ba40b8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:17.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.082+0000 7f1ba9533700 1 -- 172.21.15.117:0/1939925956 >> v1:172.21.15.124:6789/0 conn(0x7f1ba414a490 legacy=0x7f1ba414df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:17.086 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.082+0000 7f1ba9533700 1 -- 172.21.15.117:0/1939925956 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba40bab50 con 0x7f1ba40b9370 2023-07-19T20:45:17.087 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.082+0000 7f1ba9533700 1 --2- 172.21.15.117:0/1939925956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba40b9370 0x7f1ba4149f50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40679a0 tx=0x7f1b98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c182a98ecc8c45ac server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:17.087 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.082+0000 7f1ba8d32700 1 -- 172.21.15.117:0/1939925956 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b98011830 con 0x7f1ba40b9370 2023-07-19T20:45:17.087 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.082+0000 7f1ba8d32700 1 -- 172.21.15.117:0/1939925956 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b98011990 con 0x7f1ba40b9370 2023-07-19T20:45:17.087 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.082+0000 7f1ba8d32700 1 -- 172.21.15.117:0/1939925956 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b98011d20 con 0x7f1ba40b9370 2023-07-19T20:45:17.088 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.082+0000 7f1babf98700 1 -- 172.21.15.117:0/1939925956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba40b9370 msgr2=0x7f1ba4149f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:17.088 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.082+0000 7f1babf98700 1 --2- 172.21.15.117:0/1939925956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba40b9370 0x7f1ba4149f50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40679a0 tx=0x7f1b98009bd0 comp rx=0 tx=0).stop 2023-07-19T20:45:17.088 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.082+0000 7f1babf98700 1 -- 172.21.15.117:0/1939925956 shutdown_connections 2023-07-19T20:45:17.088 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.082+0000 7f1babf98700 1 --2- 172.21.15.117:0/1939925956 >> v2:172.21.15.124:3300/0 conn(0x7f1ba40c1470 0x7f1ba40b8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:17.089 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.082+0000 7f1babf98700 1 --2- 172.21.15.117:0/1939925956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba40b9370 0x7f1ba4149f50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:17.089 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.082+0000 7f1babf98700 1 -- 172.21.15.117:0/1939925956 >> 172.21.15.117:0/1939925956 conn(0x7f1ba4072920 msgr2=0x7f1ba40c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:17.091 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.083+0000 7f1babf98700 1 -- 172.21.15.117:0/1939925956 shutdown_connections 2023-07-19T20:45:17.091 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.083+0000 7f1babf98700 1 -- 172.21.15.117:0/1939925956 wait complete. 2023-07-19T20:45:17.091 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.084+0000 7f1babf98700 1 Processor -- start 2023-07-19T20:45:17.092 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.084+0000 7f1babf98700 1 -- start start 2023-07-19T20:45:17.092 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.084+0000 7f1babf98700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ba40b9370 0x7f1ba41d3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:17.092 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.084+0000 7f1babf98700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1ba40c1470 0x7f1ba41d2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:17.092 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.084+0000 7f1babf98700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba414a490 0x7f1ba41d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:17.092 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.084+0000 7f1babf98700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba40b6090 con 0x7f1ba414a490 2023-07-19T20:45:17.092 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.084+0000 7f1babf98700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba40b3400 con 0x7f1ba40b9370 2023-07-19T20:45:17.092 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.084+0000 7f1babf98700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba41d3dc0 con 0x7f1ba40c1470 2023-07-19T20:45:17.093 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.084+0000 7f1baa535700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba414a490 0x7f1ba41d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:17.093 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.084+0000 7f1baa535700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba414a490 0x7f1ba41d0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38280/0 (socket says 172.21.15.117:38280) 2023-07-19T20:45:17.093 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.084+0000 7f1baa535700 1 -- 172.21.15.117:0/1039931681 learned_addr learned my addr 172.21.15.117:0/1039931681 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:17.093 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.084+0000 7f1ba9d34700 1 --2- 172.21.15.117:0/1039931681 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ba40b9370 0x7f1ba41d3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:17.093 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.084+0000 7f1ba9533700 1 --2- 172.21.15.117:0/1039931681 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1ba40c1470 0x7f1ba41d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:17.093 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.085+0000 7f1baa535700 1 -- 172.21.15.117:0/1039931681 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1ba40c1470 msgr2=0x7f1ba41d2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:17.093 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.085+0000 7f1baa535700 1 --2- 172.21.15.117:0/1039931681 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1ba40c1470 0x7f1ba41d2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:17.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.085+0000 7f1baa535700 1 -- 172.21.15.117:0/1039931681 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ba40b9370 msgr2=0x7f1ba41d3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:17.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.085+0000 7f1baa535700 1 --2- 172.21.15.117:0/1039931681 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ba40b9370 0x7f1ba41d3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:17.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.085+0000 7f1baa535700 1 -- 172.21.15.117:0/1039931681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b98009550 con 0x7f1ba414a490 2023-07-19T20:45:17.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.085+0000 7f1baa535700 1 --2- 172.21.15.117:0/1039931681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba414a490 0x7f1ba41d0eb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1b9400cb50 tx=0x7f1b9400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:17.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.085+0000 7f1ba27fc700 1 -- 172.21.15.117:0/1039931681 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94003c00 con 0x7f1ba414a490 2023-07-19T20:45:17.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.085+0000 7f1ba27fc700 1 -- 172.21.15.117:0/1039931681 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b94003d60 con 0x7f1ba414a490 2023-07-19T20:45:17.094 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.085+0000 7f1ba27fc700 1 -- 172.21.15.117:0/1039931681 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9400aa20 con 0x7f1ba414a490 2023-07-19T20:45:17.095 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.085+0000 7f1babf98700 1 -- 172.21.15.117:0/1039931681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba41d29a0 con 0x7f1ba414a490 2023-07-19T20:45:17.095 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.085+0000 7f1babf98700 1 -- 172.21.15.117:0/1039931681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba4145b30 con 0x7f1ba414a490 2023-07-19T20:45:17.095 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.086+0000 7f1babf98700 1 -- 172.21.15.117:0/1039931681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba4074890 con 0x7f1ba414a490 2023-07-19T20:45:17.095 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.086+0000 7f1ba27fc700 1 -- 172.21.15.117:0/1039931681 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f1b9400ab80 con 0x7f1ba414a490 2023-07-19T20:45:17.095 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.087+0000 7f1ba27fc700 1 --2- 172.21.15.117:0/1039931681 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f1b9006a660 0x7f1b9006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:17.095 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.087+0000 7f1ba27fc700 1 -- 172.21.15.117:0/1039931681 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1b94088720 con 0x7f1ba414a490 2023-07-19T20:45:17.099 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.087+0000 7f1ba9d34700 1 --2- 172.21.15.117:0/1039931681 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f1b9006a660 0x7f1b9006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:17.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.087+0000 7f1ba9d34700 1 --2- 172.21.15.117:0/1039931681 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f1b9006a660 0x7f1b9006cb10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009be0 tx=0x7f1b9c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:17.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.091+0000 7f1ba27fc700 1 -- 172.21.15.117:0/1039931681 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f1b94053eb0 con 0x7f1ba414a490 2023-07-19T20:45:17.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:17.292+0000 7f1babf98700 1 -- 172.21.15.117:0/1039931681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1ba40b3570 con 0x7f1ba414a490 2023-07-19T20:45:18.057 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.063+0000 7f1ba27fc700 1 -- 172.21.15.117:0/1039931681 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1b940574d0 con 0x7f1ba414a490 2023-07-19T20:45:18.059 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.066+0000 7f1babf98700 1 -- 172.21.15.117:0/1039931681 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f1b9006a660 msgr2=0x7f1b9006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.066+0000 7f1babf98700 1 --2- 172.21.15.117:0/1039931681 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f1b9006a660 0x7f1b9006cb10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009be0 tx=0x7f1b9c009210 comp rx=0 tx=0).stop 2023-07-19T20:45:18.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.066+0000 7f1babf98700 1 -- 172.21.15.117:0/1039931681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba414a490 msgr2=0x7f1ba41d0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.066+0000 7f1babf98700 1 --2- 172.21.15.117:0/1039931681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba414a490 0x7f1ba41d0eb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1b9400cb50 tx=0x7f1b9400ce60 comp rx=0 tx=0).stop 2023-07-19T20:45:18.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.066+0000 7f1babf98700 1 -- 172.21.15.117:0/1039931681 shutdown_connections 2023-07-19T20:45:18.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.066+0000 7f1babf98700 1 --2- 172.21.15.117:0/1039931681 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f1b9006a660 0x7f1b9006cb10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.066+0000 7f1babf98700 1 --2- 172.21.15.117:0/1039931681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba414a490 0x7f1ba41d0eb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.066+0000 7f1babf98700 1 --2- 172.21.15.117:0/1039931681 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ba40b9370 0x7f1ba41d3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.061 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.066+0000 7f1babf98700 1 --2- 172.21.15.117:0/1039931681 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1ba40c1470 0x7f1ba41d2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.061 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.066+0000 7f1babf98700 1 -- 172.21.15.117:0/1039931681 >> 172.21.15.117:0/1039931681 conn(0x7f1ba4072920 msgr2=0x7f1ba414b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:18.061 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.066+0000 7f1babf98700 1 -- 172.21.15.117:0/1039931681 shutdown_connections 2023-07-19T20:45:18.061 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.066+0000 7f1babf98700 1 -- 172.21.15.117:0/1039931681 wait complete. 2023-07-19T20:45:18.061 INFO:teuthology.orchestra.run.smithi117.stderr: removed all blocklist entries 2023-07-19T20:45:18.073 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-19T20:45:18.196 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.202+0000 7f9111c54700 1 Processor -- start 2023-07-19T20:45:18.196 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.202+0000 7f9111c54700 1 -- start start 2023-07-19T20:45:18.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.203+0000 7f9111c54700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f910c0be2b0 0x7f910c0bf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:18.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.203+0000 7f9111c54700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f910c0bf5d0 0x7f910c145c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:18.199 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.203+0000 7f9111c54700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910c0726a0 con 0x7f910c0bc780 2023-07-19T20:45:18.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.203+0000 7f9111c54700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910c072200 con 0x7f910c0be2b0 2023-07-19T20:45:18.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.203+0000 7f9111c54700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0bcea0 con 0x7f910c0bf5d0 2023-07-19T20:45:18.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.203+0000 7f910b7fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f910c0be2b0 0x7f910c0bf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:18.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.203+0000 7f910b7fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f910c0be2b0 0x7f910c0bf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38282/0 (socket says 172.21.15.117:38282) 2023-07-19T20:45:18.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.203+0000 7f910b7fe700 1 -- 172.21.15.117:0/808908242 learned_addr learned my addr 172.21.15.117:0/808908242 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:18.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.203+0000 7f910affd700 1 --2- 172.21.15.117:0/808908242 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f910c0bf5d0 0x7f910c145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:18.200 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.204+0000 7f910b7fe700 1 -- 172.21.15.117:0/808908242 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f910c0bf5d0 msgr2=0x7f910c145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:18.201 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.204+0000 7f910b7fe700 1 --2- 172.21.15.117:0/808908242 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f910c0bf5d0 0x7f910c145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.201 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.204+0000 7f910b7fe700 1 -- 172.21.15.117:0/808908242 >> v1:172.21.15.124:6789/0 conn(0x7f910c0bc780 legacy=0x7f910c14bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.201 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.204+0000 7f910b7fe700 1 -- 172.21.15.117:0/808908242 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c072b30 con 0x7f910c0be2b0 2023-07-19T20:45:18.201 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.204+0000 7f910a7fc700 1 -- 172.21.15.117:0/808908242 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102218038 0 0) 0x7f910c0726a0 con 0x7f910c0bc780 2023-07-19T20:45:18.202 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.204+0000 7f910b7fe700 1 --2- 172.21.15.117:0/808908242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f910c0be2b0 0x7f910c0bf090 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0098f0 tx=0x7f90fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfed431323ebd452 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:18.202 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.204+0000 7f910a7fc700 1 -- 172.21.15.117:0/808908242 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc011830 con 0x7f910c0be2b0 2023-07-19T20:45:18.202 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.204+0000 7f910a7fc700 1 -- 172.21.15.117:0/808908242 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc011990 con 0x7f910c0be2b0 2023-07-19T20:45:18.202 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.204+0000 7f910a7fc700 1 -- 172.21.15.117:0/808908242 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc011d20 con 0x7f910c0be2b0 2023-07-19T20:45:18.202 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.204+0000 7f9111c54700 1 -- 172.21.15.117:0/808908242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f910c0be2b0 msgr2=0x7f910c0bf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.202 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.204+0000 7f9111c54700 1 --2- 172.21.15.117:0/808908242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f910c0be2b0 0x7f910c0bf090 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0098f0 tx=0x7f90fc009c00 comp rx=0 tx=0).stop 2023-07-19T20:45:18.203 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.205+0000 7f9111c54700 1 -- 172.21.15.117:0/808908242 shutdown_connections 2023-07-19T20:45:18.203 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.205+0000 7f9111c54700 1 --2- 172.21.15.117:0/808908242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f910c0be2b0 0x7f910c0bf090 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.203 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.205+0000 7f9111c54700 1 --2- 172.21.15.117:0/808908242 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f910c0bf5d0 0x7f910c145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.203 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.205+0000 7f9111c54700 1 -- 172.21.15.117:0/808908242 >> 172.21.15.117:0/808908242 conn(0x7f910c0a1280 msgr2=0x7f910c0be980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:18.204 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.205+0000 7f9111c54700 1 -- 172.21.15.117:0/808908242 shutdown_connections 2023-07-19T20:45:18.204 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.205+0000 7f9111c54700 1 -- 172.21.15.117:0/808908242 wait complete. 2023-07-19T20:45:18.204 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.206+0000 7f9111c54700 1 Processor -- start 2023-07-19T20:45:18.204 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.206+0000 7f9111c54700 1 -- start start 2023-07-19T20:45:18.207 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.206+0000 7f9111c54700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f910c0bc780 0x7f910c1e18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:18.207 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.206+0000 7f9111c54700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f910c0be2b0 0x7f910c0a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:18.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.206+0000 7f9111c54700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f910c0bf5d0 0x7f910c0b9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:18.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.206+0000 7f9111c54700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c1e1e30 con 0x7f910c0be2b0 2023-07-19T20:45:18.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.206+0000 7f9111c54700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0b9200 con 0x7f910c0bf5d0 2023-07-19T20:45:18.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.206+0000 7f9111c54700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0b7410 con 0x7f910c0bc780 2023-07-19T20:45:18.209 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f910affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f910c0be2b0 0x7f910c0a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:18.209 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f910affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f910c0be2b0 0x7f910c0a3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38294/0 (socket says 172.21.15.117:38294) 2023-07-19T20:45:18.209 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f910affd700 1 -- 172.21.15.117:0/95780572 learned_addr learned my addr 172.21.15.117:0/95780572 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:18.210 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f910b7fe700 1 --2- 172.21.15.117:0/95780572 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f910c0bc780 0x7f910c1e18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:18.210 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f910bfff700 1 --2- 172.21.15.117:0/95780572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f910c0bf5d0 0x7f910c0b9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:18.211 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f910affd700 1 -- 172.21.15.117:0/95780572 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f910c0bc780 msgr2=0x7f910c1e18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.211 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f910affd700 1 --2- 172.21.15.117:0/95780572 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f910c0bc780 0x7f910c1e18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.211 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f910affd700 1 -- 172.21.15.117:0/95780572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f910c0bf5d0 msgr2=0x7f910c0b9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.211 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f910affd700 1 --2- 172.21.15.117:0/95780572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f910c0bf5d0 0x7f910c0b9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.212 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f910affd700 1 -- 172.21.15.117:0/95780572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc009550 con 0x7f910c0be2b0 2023-07-19T20:45:18.212 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f910affd700 1 --2- 172.21.15.117:0/95780572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f910c0be2b0 0x7f910c0a3d40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f90f400e850 tx=0x7f90f400eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:18.212 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f9103fff700 1 -- 172.21.15.117:0/95780572 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f40095b0 con 0x7f910c0be2b0 2023-07-19T20:45:18.212 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f9103fff700 1 -- 172.21.15.117:0/95780572 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f4013680 con 0x7f910c0be2b0 2023-07-19T20:45:18.213 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f9111c54700 1 -- 172.21.15.117:0/95780572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910c0b9450 con 0x7f910c0be2b0 2023-07-19T20:45:18.213 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f9103fff700 1 -- 172.21.15.117:0/95780572 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f4013a10 con 0x7f910c0be2b0 2023-07-19T20:45:18.213 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.207+0000 7f9111c54700 1 -- 172.21.15.117:0/95780572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910c0bbee0 con 0x7f910c0be2b0 2023-07-19T20:45:18.214 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.208+0000 7f9111c54700 1 -- 172.21.15.117:0/95780572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910c0b8bd0 con 0x7f910c0be2b0 2023-07-19T20:45:18.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.209+0000 7f9103fff700 1 -- 172.21.15.117:0/95780572 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f90f4013b70 con 0x7f910c0be2b0 2023-07-19T20:45:18.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.209+0000 7f9103fff700 1 --2- 172.21.15.117:0/95780572 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f90ec06a660 0x7f90ec06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:18.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.209+0000 7f9103fff700 1 -- 172.21.15.117:0/95780572 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f90f40885d0 con 0x7f910c0be2b0 2023-07-19T20:45:18.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.209+0000 7f910b7fe700 1 --2- 172.21.15.117:0/95780572 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f90ec06a660 0x7f90ec06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:18.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.209+0000 7f910b7fe700 1 --2- 172.21.15.117:0/95780572 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f90ec06a660 0x7f90ec06cb10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009130 tx=0x7f90fc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:18.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.213+0000 7f9103fff700 1 -- 172.21.15.117:0/95780572 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f90f4057840 con 0x7f910c0be2b0 2023-07-19T20:45:18.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.472+0000 7f9111c54700 1 -- 172.21.15.117:0/95780572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f910c067940 con 0x7f910c0be2b0 2023-07-19T20:45:18.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.472+0000 7f9103fff700 1 -- 172.21.15.117:0/95780572 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+5491 (secure 0 0 0) 0x7f90f4058e60 con 0x7f910c0be2b0 2023-07-19T20:45:18.466 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:18.466 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-07-19T20:45:18.467 INFO:teuthology.orchestra.run.smithi117.stdout: "auth_dump": [ 2023-07-19T20:45:18.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.467 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mds.a", 2023-07-19T20:45:18.467 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQACS7hkDkQcLxAAzNxmo6hjgZCZWjLcij1uKg==", 2023-07-19T20:45:18.467 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.467 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2023-07-19T20:45:18.467 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow *", 2023-07-19T20:45:18.467 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow *", 2023-07-19T20:45:18.468 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2023-07-19T20:45:18.468 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.469 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mds.b", 2023-07-19T20:45:18.469 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQADS7hkpFepABAAQ9QVUKpJdxsGpF0+fhkizg==", 2023-07-19T20:45:18.469 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.469 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2023-07-19T20:45:18.469 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow *", 2023-07-19T20:45:18.469 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow *", 2023-07-19T20:45:18.469 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2023-07-19T20:45:18.470 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.470 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mds.c", 2023-07-19T20:45:18.470 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQACS7hkVE3XNhAAhuCLcBAT+LXYTnJEPOe25Q==", 2023-07-19T20:45:18.470 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.470 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2023-07-19T20:45:18.470 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow *", 2023-07-19T20:45:18.471 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow *", 2023-07-19T20:45:18.471 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2023-07-19T20:45:18.471 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.471 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.0", 2023-07-19T20:45:18.472 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQAGS7hkwIpnFxAA8kQ9h4DuxAJSQQDQ8u2Exg==", 2023-07-19T20:45:18.472 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.472 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2023-07-19T20:45:18.472 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2023-07-19T20:45:18.472 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2023-07-19T20:45:18.472 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.473 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.1", 2023-07-19T20:45:18.473 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQAJS7hkzMbzFRAAIT7HxQohBTpixe/4jtByaQ==", 2023-07-19T20:45:18.473 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.473 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2023-07-19T20:45:18.473 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2023-07-19T20:45:18.474 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2023-07-19T20:45:18.474 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.474 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.2", 2023-07-19T20:45:18.474 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQAMS7hk64HKFBAAgqwMZViNddosEsiY7Rcvrw==", 2023-07-19T20:45:18.475 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.475 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2023-07-19T20:45:18.475 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2023-07-19T20:45:18.475 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2023-07-19T20:45:18.475 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.3", 2023-07-19T20:45:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQAPS7hkHqXyExAAty0bRl5w3dx+nNmv+iHb7w==", 2023-07-19T20:45:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2023-07-19T20:45:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2023-07-19T20:45:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2023-07-19T20:45:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.477 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.4", 2023-07-19T20:45:18.477 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQAVS7hk/L3GFxAALGTNTEK8fKZ4JlTzDmoO6Q==", 2023-07-19T20:45:18.477 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.477 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2023-07-19T20:45:18.477 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2023-07-19T20:45:18.477 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2023-07-19T20:45:18.478 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.478 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.5", 2023-07-19T20:45:18.478 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQAYS7hkWRLzFhAAUKUWj2DFsiKBEANKJVUBvg==", 2023-07-19T20:45:18.478 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.478 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2023-07-19T20:45:18.478 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2023-07-19T20:45:18.479 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2023-07-19T20:45:18.479 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.479 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.6", 2023-07-19T20:45:18.479 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQAbS7hkZjnoFRAATjzN1nn+MCDNuud8Fj+low==", 2023-07-19T20:45:18.479 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.479 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2023-07-19T20:45:18.480 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2023-07-19T20:45:18.480 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2023-07-19T20:45:18.480 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.480 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.7", 2023-07-19T20:45:18.480 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQAeS7hkvjSgFRAAyQUumsHiYw2NvNfOaSjiFg==", 2023-07-19T20:45:18.481 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.481 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2023-07-19T20:45:18.481 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2023-07-19T20:45:18.481 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2023-07-19T20:45:18.481 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.481 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.0", 2023-07-19T20:45:18.482 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQADS7hkov88CRAAHoaLO/lxvRuGZOni8NRqsg==", 2023-07-19T20:45:18.482 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.482 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2023-07-19T20:45:18.482 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow r", 2023-07-19T20:45:18.482 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow rw", 2023-07-19T20:45:18.482 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow rwx" 2023-07-19T20:45:18.482 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.483 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.admin", 2023-07-19T20:45:18.483 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQACS7hkwU4VBhAAiPG9OjvC296T9MaER6pAOw==", 2023-07-19T20:45:18.483 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.483 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow *", 2023-07-19T20:45:18.483 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow *", 2023-07-19T20:45:18.483 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow *", 2023-07-19T20:45:18.484 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2023-07-19T20:45:18.484 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.484 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.bootstrap-mds", 2023-07-19T20:45:18.484 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQAjS7hk8P3UORAA8nz29vn1/QsK5T6M3OQYXw==", 2023-07-19T20:45:18.484 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.484 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile bootstrap-mds" 2023-07-19T20:45:18.485 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.485 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.bootstrap-mgr", 2023-07-19T20:45:18.485 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQAjS7hksQbVORAAYO6k9Re6VkJDRdySRZg0nA==", 2023-07-19T20:45:18.485 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.485 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-19T20:45:18.485 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.486 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.bootstrap-osd", 2023-07-19T20:45:18.486 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQAjS7hk0A7VORAArJDHenKjt9I0x8uayUHJzA==", 2023-07-19T20:45:18.486 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.486 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile bootstrap-osd" 2023-07-19T20:45:18.487 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.487 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.bootstrap-rbd", 2023-07-19T20:45:18.487 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQAjS7hk5BbVORAAQAYzQO/NsgUyHxfuQw+EJA==", 2023-07-19T20:45:18.487 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.487 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-19T20:45:18.487 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.488 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-19T20:45:18.488 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQAjS7hkTh7VORAAR1T9e4bk9hVEJw3L62LeKQ==", 2023-07-19T20:45:18.488 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.488 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-19T20:45:18.488 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.489 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.bootstrap-rgw", 2023-07-19T20:45:18.489 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQAjS7hk8DXVORAAikR3IekAGNVZ9ip5ozaW1Q==", 2023-07-19T20:45:18.489 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.489 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-19T20:45:18.489 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.490 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mgr.x", 2023-07-19T20:45:18.490 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQACS7hkxACzKxAAuNarCn8GCSKJm9F/Ooz1RA==", 2023-07-19T20:45:18.490 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.490 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow *", 2023-07-19T20:45:18.490 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile mgr", 2023-07-19T20:45:18.490 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2023-07-19T20:45:18.490 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:18.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:18.491 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mgr.y", 2023-07-19T20:45:18.491 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQACS7hkYftYJxAAo5qtnWajZJAk+N/ykp1Rxg==", 2023-07-19T20:45:18.491 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2023-07-19T20:45:18.491 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow *", 2023-07-19T20:45:18.491 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile mgr", 2023-07-19T20:45:18.491 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2023-07-19T20:45:18.492 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.492 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:18.492 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2023-07-19T20:45:18.492 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-07-19T20:45:18.493 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.474+0000 7f9111c54700 1 -- 172.21.15.117:0/95780572 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f90ec06a660 msgr2=0x7f90ec06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.474+0000 7f9111c54700 1 --2- 172.21.15.117:0/95780572 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f90ec06a660 0x7f90ec06cb10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009130 tx=0x7f90fc008030 comp rx=0 tx=0).stop 2023-07-19T20:45:18.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.474+0000 7f9111c54700 1 -- 172.21.15.117:0/95780572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f910c0be2b0 msgr2=0x7f910c0a3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.474+0000 7f9111c54700 1 --2- 172.21.15.117:0/95780572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f910c0be2b0 0x7f910c0a3d40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f90f400e850 tx=0x7f90f400eb60 comp rx=0 tx=0).stop 2023-07-19T20:45:18.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.474+0000 7f9111c54700 1 -- 172.21.15.117:0/95780572 shutdown_connections 2023-07-19T20:45:18.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.474+0000 7f9111c54700 1 --2- 172.21.15.117:0/95780572 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f90ec06a660 0x7f90ec06cb10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.474+0000 7f9111c54700 1 --2- 172.21.15.117:0/95780572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f910c0bf5d0 0x7f910c0b9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.474+0000 7f9111c54700 1 --2- 172.21.15.117:0/95780572 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f910c0bc780 0x7f910c1e18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.494 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.474+0000 7f9111c54700 1 --2- 172.21.15.117:0/95780572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f910c0be2b0 0x7f910c0a3d40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.495 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.474+0000 7f9111c54700 1 -- 172.21.15.117:0/95780572 >> 172.21.15.117:0/95780572 conn(0x7f910c0a1280 msgr2=0x7f910c0be980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:18.495 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.474+0000 7f9111c54700 1 -- 172.21.15.117:0/95780572 shutdown_connections 2023-07-19T20:45:18.495 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.474+0000 7f9111c54700 1 -- 172.21.15.117:0/95780572 wait complete. 2023-07-19T20:45:18.495 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-19T20:45:18.618 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.624+0000 7f83d3f40700 1 Processor -- start 2023-07-19T20:45:18.618 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.624+0000 7f83d3f40700 1 -- start start 2023-07-19T20:45:18.620 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.625+0000 7f83d3f40700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f83cc06f560 0x7f83cc1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:18.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.625+0000 7f83d3f40700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83cc0b8a70 con 0x7f83cc1447e0 2023-07-19T20:45:18.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.625+0000 7f83d3f40700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83cc072210 con 0x7f83cc06baf0 2023-07-19T20:45:18.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.625+0000 7f83d3f40700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83cc070db0 con 0x7f83cc06f560 2023-07-19T20:45:18.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.625+0000 7f83d24dd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f83cc06f560 0x7f83cc1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:18.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.625+0000 7f83d1cdc700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f83cc1447e0 0x7f83cc0b9230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:60288/0 (socket says 172.21.15.117:60288) 2023-07-19T20:45:18.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.625+0000 7f83d1cdc700 1 -- 172.21.15.117:0/1823898532 learned_addr learned my addr 172.21.15.117:0/1823898532 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:18.621 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.625+0000 7f83d24dd700 1 -- 172.21.15.117:0/1823898532 >> v1:172.21.15.124:6789/0 conn(0x7f83cc06baf0 legacy=0x7f83cc070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.625+0000 7f83d24dd700 1 -- 172.21.15.117:0/1823898532 >> v1:172.21.15.117:6789/0 conn(0x7f83cc1447e0 legacy=0x7f83cc0b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.625+0000 7f83d24dd700 1 -- 172.21.15.117:0/1823898532 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc071a10 con 0x7f83cc06f560 2023-07-19T20:45:18.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.625+0000 7f83d0cda700 1 -- 172.21.15.117:0/1823898532 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159001413 0 0) 0x7f83cc0b8a70 con 0x7f83cc1447e0 2023-07-19T20:45:18.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.626+0000 7f83d24dd700 1 --2- 172.21.15.117:0/1823898532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc06f560 0x7f83cc1528d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009d90 tx=0x7f83c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875292015e970da3 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:18.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.626+0000 7f83d0cda700 1 -- 172.21.15.117:0/1823898532 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c400e070 con 0x7f83cc06f560 2023-07-19T20:45:18.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.626+0000 7f83d0cda700 1 -- 172.21.15.117:0/1823898532 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c400bbd0 con 0x7f83cc06f560 2023-07-19T20:45:18.622 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.626+0000 7f83d0cda700 1 -- 172.21.15.117:0/1823898532 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c4012430 con 0x7f83cc06f560 2023-07-19T20:45:18.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.626+0000 7f83d3f40700 1 -- 172.21.15.117:0/1823898532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc06f560 msgr2=0x7f83cc1528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.626+0000 7f83d3f40700 1 --2- 172.21.15.117:0/1823898532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc06f560 0x7f83cc1528d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009d90 tx=0x7f83c400b330 comp rx=0 tx=0).stop 2023-07-19T20:45:18.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.626+0000 7f83d3f40700 1 -- 172.21.15.117:0/1823898532 shutdown_connections 2023-07-19T20:45:18.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.626+0000 7f83d3f40700 1 --2- 172.21.15.117:0/1823898532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc06f560 0x7f83cc1528d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.626+0000 7f83d3f40700 1 -- 172.21.15.117:0/1823898532 >> 172.21.15.117:0/1823898532 conn(0x7f83cc0bdc00 msgr2=0x7f83cc0b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:18.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.626+0000 7f83d3f40700 1 -- 172.21.15.117:0/1823898532 shutdown_connections 2023-07-19T20:45:18.624 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.626+0000 7f83d3f40700 1 -- 172.21.15.117:0/1823898532 wait complete. 2023-07-19T20:45:18.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.627+0000 7f83d3f40700 1 Processor -- start 2023-07-19T20:45:18.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.627+0000 7f83d3f40700 1 -- start start 2023-07-19T20:45:18.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d3f40700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc06baf0 0x7f83cc1d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:18.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d3f40700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f83cc06f560 0x7f83cc0bbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:18.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d3f40700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc1447e0 0x7f83cc1370e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:18.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d3f40700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc1d3e00 con 0x7f83cc06baf0 2023-07-19T20:45:18.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d3f40700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc0bcbe0 con 0x7f83cc1447e0 2023-07-19T20:45:18.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d3f40700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc0b4e40 con 0x7f83cc06f560 2023-07-19T20:45:18.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d1cdc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc06baf0 0x7f83cc1d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:18.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d1cdc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc06baf0 0x7f83cc1d38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38310/0 (socket says 172.21.15.117:38310) 2023-07-19T20:45:18.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d1cdc700 1 -- 172.21.15.117:0/739665556 learned_addr learned my addr 172.21.15.117:0/739665556 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:18.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d24dd700 1 --2- 172.21.15.117:0/739665556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc1447e0 0x7f83cc1370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:18.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d1cdc700 1 -- 172.21.15.117:0/739665556 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f83cc06f560 msgr2=0x7f83cc0bbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d1cdc700 1 --2- 172.21.15.117:0/739665556 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f83cc06f560 0x7f83cc0bbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d1cdc700 1 -- 172.21.15.117:0/739665556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc1447e0 msgr2=0x7f83cc1370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d1cdc700 1 --2- 172.21.15.117:0/739665556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc1447e0 0x7f83cc1370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d1cdc700 1 -- 172.21.15.117:0/739665556 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c4009a70 con 0x7f83cc06baf0 2023-07-19T20:45:18.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.628+0000 7f83d24dd700 1 --2- 172.21.15.117:0/739665556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc1447e0 0x7f83cc1370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:18.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.629+0000 7f83d1cdc700 1 --2- 172.21.15.117:0/739665556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc06baf0 0x7f83cc1d38c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c550 tx=0x7f83bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:18.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.629+0000 7f83c27fc700 1 -- 172.21.15.117:0/739665556 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc004c80 con 0x7f83cc06baf0 2023-07-19T20:45:18.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.629+0000 7f83c27fc700 1 -- 172.21.15.117:0/739665556 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc004de0 con 0x7f83cc06baf0 2023-07-19T20:45:18.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.629+0000 7f83d3f40700 1 -- 172.21.15.117:0/739665556 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83cc0bc590 con 0x7f83cc06baf0 2023-07-19T20:45:18.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.629+0000 7f83c27fc700 1 -- 172.21.15.117:0/739665556 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc007310 con 0x7f83cc06baf0 2023-07-19T20:45:18.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.629+0000 7f83d3f40700 1 -- 172.21.15.117:0/739665556 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83cc140cc0 con 0x7f83cc06baf0 2023-07-19T20:45:18.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.630+0000 7f83d3f40700 1 -- 172.21.15.117:0/739665556 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83cc067940 con 0x7f83cc06baf0 2023-07-19T20:45:18.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.630+0000 7f83c27fc700 1 -- 172.21.15.117:0/739665556 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f83bc007470 con 0x7f83cc06baf0 2023-07-19T20:45:18.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.630+0000 7f83c27fc700 1 --2- 172.21.15.117:0/739665556 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f83b006a660 0x7f83b006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:18.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.631+0000 7f83c27fc700 1 -- 172.21.15.117:0/739665556 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f83bc088410 con 0x7f83cc06baf0 2023-07-19T20:45:18.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.631+0000 7f83d14db700 1 --2- 172.21.15.117:0/739665556 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f83b006a660 0x7f83b006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:18.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.631+0000 7f83d14db700 1 --2- 172.21.15.117:0/739665556 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f83b006a660 0x7f83b006cb10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f83cc14a400 tx=0x7f83c8007a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:18.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.635+0000 7f83c27fc700 1 -- 172.21.15.117:0/739665556 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f83bc053b60 con 0x7f83cc06baf0 2023-07-19T20:45:18.890 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.896+0000 7f83d3f40700 1 -- 172.21.15.117:0/739665556 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f83cc06c0a0 con 0x7f83cc06baf0 2023-07-19T20:45:18.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.899+0000 7f83c27fc700 1 -- 172.21.15.117:0/739665556 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f83bc057180 con 0x7f83cc06baf0 2023-07-19T20:45:18.895 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.901+0000 7f83d3f40700 1 -- 172.21.15.117:0/739665556 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f83b006a660 msgr2=0x7f83b006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.901+0000 7f83d3f40700 1 --2- 172.21.15.117:0/739665556 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f83b006a660 0x7f83b006cb10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f83cc14a400 tx=0x7f83c8007a20 comp rx=0 tx=0).stop 2023-07-19T20:45:18.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.901+0000 7f83d3f40700 1 -- 172.21.15.117:0/739665556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc06baf0 msgr2=0x7f83cc1d38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:18.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.901+0000 7f83d3f40700 1 --2- 172.21.15.117:0/739665556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc06baf0 0x7f83cc1d38c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c550 tx=0x7f83bc00c910 comp rx=0 tx=0).stop 2023-07-19T20:45:18.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.902+0000 7f83d3f40700 1 -- 172.21.15.117:0/739665556 shutdown_connections 2023-07-19T20:45:18.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.902+0000 7f83d3f40700 1 --2- 172.21.15.117:0/739665556 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f83b006a660 0x7f83b006cb10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.896 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.902+0000 7f83d3f40700 1 --2- 172.21.15.117:0/739665556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83cc1447e0 0x7f83cc1370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.897 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.902+0000 7f83d3f40700 1 --2- 172.21.15.117:0/739665556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc06baf0 0x7f83cc1d38c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.897 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.902+0000 7f83d3f40700 1 --2- 172.21.15.117:0/739665556 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f83cc06f560 0x7f83cc0bbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:18.897 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.902+0000 7f83d3f40700 1 -- 172.21.15.117:0/739665556 >> 172.21.15.117:0/739665556 conn(0x7f83cc0bdc00 msgr2=0x7f83cc13c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:18.897 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.902+0000 7f83d3f40700 1 -- 172.21.15.117:0/739665556 shutdown_connections 2023-07-19T20:45:18.897 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:18.902+0000 7f83d3f40700 1 -- 172.21.15.117:0/739665556 wait complete. 2023-07-19T20:45:18.907 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-19T20:45:19.028 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.035+0000 7f7517637700 1 Processor -- start 2023-07-19T20:45:19.029 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.035+0000 7f7517637700 1 -- start start 2023-07-19T20:45:19.030 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.036+0000 7f7517637700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7510154260 0x7f7510156640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.031 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.036+0000 7f7517637700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75100bcd00 con 0x7f75100c1470 2023-07-19T20:45:19.032 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.036+0000 7f7517637700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75100b8bd0 con 0x7f7510149f50 2023-07-19T20:45:19.032 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.036+0000 7f7517637700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75100b8710 con 0x7f7510154260 2023-07-19T20:45:19.032 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.036+0000 7f7515bd4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7510154260 0x7f7510156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.033 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.036+0000 7f75153d3700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f75100c1470 0x7f75100b8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:60292/0 (socket says 172.21.15.117:60292) 2023-07-19T20:45:19.033 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.036+0000 7f75153d3700 1 -- 172.21.15.117:0/4238572234 learned_addr learned my addr 172.21.15.117:0/4238572234 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:19.033 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.036+0000 7f7507fff700 1 -- 172.21.15.117:0/4238572234 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922660423 0 0) 0x7f75100bcd00 con 0x7f75100c1470 2023-07-19T20:45:19.034 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.036+0000 7f7507fff700 1 -- 172.21.15.117:0/4238572234 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74fc0035b0 con 0x7f75100c1470 2023-07-19T20:45:19.034 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.036+0000 7f7515bd4700 1 -- 172.21.15.117:0/4238572234 >> v1:172.21.15.124:6789/0 conn(0x7f7510149f50 legacy=0x7f751014a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:19.035 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.036+0000 7f7515bd4700 1 -- 172.21.15.117:0/4238572234 >> v1:172.21.15.117:6789/0 conn(0x7f75100c1470 legacy=0x7f75100b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.035 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.036+0000 7f7515bd4700 1 -- 172.21.15.117:0/4238572234 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75100bab50 con 0x7f7510154260 2023-07-19T20:45:19.036 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.036+0000 7f7515bd4700 1 --2- 172.21.15.117:0/4238572234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7510154260 0x7f7510156640 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7508009d90 tx=0x7f750800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dba292a1ae26eff server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:19.036 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.036+0000 7f7507fff700 1 -- 172.21.15.117:0/4238572234 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750800e070 con 0x7f7510154260 2023-07-19T20:45:19.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.037+0000 7f7507fff700 1 -- 172.21.15.117:0/4238572234 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750800bae0 con 0x7f7510154260 2023-07-19T20:45:19.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.037+0000 7f7507fff700 1 -- 172.21.15.117:0/4238572234 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750800be90 con 0x7f7510154260 2023-07-19T20:45:19.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.037+0000 7f7517637700 1 -- 172.21.15.117:0/4238572234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7510154260 msgr2=0x7f7510156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.037+0000 7f7517637700 1 --2- 172.21.15.117:0/4238572234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7510154260 0x7f7510156640 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7508009d90 tx=0x7f750800b330 comp rx=0 tx=0).stop 2023-07-19T20:45:19.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.037+0000 7f7517637700 1 -- 172.21.15.117:0/4238572234 shutdown_connections 2023-07-19T20:45:19.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.037+0000 7f7517637700 1 --2- 172.21.15.117:0/4238572234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7510154260 0x7f7510156640 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.037+0000 7f7517637700 1 -- 172.21.15.117:0/4238572234 >> 172.21.15.117:0/4238572234 conn(0x7f7510072920 msgr2=0x7f75100c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:19.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.037+0000 7f7517637700 1 -- 172.21.15.117:0/4238572234 shutdown_connections 2023-07-19T20:45:19.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.037+0000 7f7517637700 1 -- 172.21.15.117:0/4238572234 wait complete. 2023-07-19T20:45:19.041 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.038+0000 7f7517637700 1 Processor -- start 2023-07-19T20:45:19.041 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.038+0000 7f7517637700 1 -- start start 2023-07-19T20:45:19.041 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7517637700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75100c1470 0x7f751014fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.042 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7517637700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7510149f50 0x7f7510151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.042 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7517637700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7510154260 0x7f751014ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.042 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7517637700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7510153e10 con 0x7f7510149f50 2023-07-19T20:45:19.042 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7517637700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7510150cf0 con 0x7f75100c1470 2023-07-19T20:45:19.042 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7517637700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75101519a0 con 0x7f7510154260 2023-07-19T20:45:19.042 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7514bd2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7510149f50 0x7f7510151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7514bd2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7510149f50 0x7f7510151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38334/0 (socket says 172.21.15.117:38334) 2023-07-19T20:45:19.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7514bd2700 1 -- 172.21.15.117:0/2591654628 learned_addr learned my addr 172.21.15.117:0/2591654628 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:19.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f75153d3700 1 --2- 172.21.15.117:0/2591654628 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75100c1470 0x7f751014fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7515bd4700 1 --2- 172.21.15.117:0/2591654628 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7510154260 0x7f751014ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7514bd2700 1 -- 172.21.15.117:0/2591654628 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7510154260 msgr2=0x7f751014ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7514bd2700 1 --2- 172.21.15.117:0/2591654628 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7510154260 0x7f751014ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7514bd2700 1 -- 172.21.15.117:0/2591654628 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75100c1470 msgr2=0x7f751014fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7514bd2700 1 --2- 172.21.15.117:0/2591654628 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75100c1470 0x7f751014fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7514bd2700 1 -- 172.21.15.117:0/2591654628 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7508009a70 con 0x7f7510149f50 2023-07-19T20:45:19.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.039+0000 7f7514bd2700 1 --2- 172.21.15.117:0/2591654628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7510149f50 0x7f7510151460 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c4a0 tx=0x7f750c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:19.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.040+0000 7f7505ffb700 1 -- 172.21.15.117:0/2591654628 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c011790 con 0x7f7510149f50 2023-07-19T20:45:19.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.040+0000 7f7505ffb700 1 -- 172.21.15.117:0/2591654628 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c0118f0 con 0x7f7510149f50 2023-07-19T20:45:19.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.040+0000 7f7517637700 1 -- 172.21.15.117:0/2591654628 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7510153b30 con 0x7f7510149f50 2023-07-19T20:45:19.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.040+0000 7f7505ffb700 1 -- 172.21.15.117:0/2591654628 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c011ca0 con 0x7f7510149f50 2023-07-19T20:45:19.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.040+0000 7f7517637700 1 -- 172.21.15.117:0/2591654628 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751014f650 con 0x7f7510149f50 2023-07-19T20:45:19.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.041+0000 7f7517637700 1 -- 172.21.15.117:0/2591654628 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751014f810 con 0x7f7510149f50 2023-07-19T20:45:19.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.041+0000 7f7505ffb700 1 -- 172.21.15.117:0/2591654628 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f750c01c460 con 0x7f7510149f50 2023-07-19T20:45:19.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.041+0000 7f7505ffb700 1 --2- 172.21.15.117:0/2591654628 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f74f406a660 0x7f74f406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.042+0000 7f75153d3700 1 --2- 172.21.15.117:0/2591654628 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f74f406a660 0x7f74f406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.042+0000 7f7505ffb700 1 -- 172.21.15.117:0/2591654628 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f750c088370 con 0x7f7510149f50 2023-07-19T20:45:19.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.042+0000 7f75153d3700 1 --2- 172.21.15.117:0/2591654628 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f74f406a660 0x7f74f406cb10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7500007fd0 tx=0x7f7500009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:19.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.046+0000 7f7505ffb700 1 -- 172.21.15.117:0/2591654628 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f750c053b50 con 0x7f7510149f50 2023-07-19T20:45:19.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.306+0000 7f7517637700 1 -- 172.21.15.117:0/2591654628 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f7510074890 con 0x7f7510149f50 2023-07-19T20:45:19.303 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.310+0000 7f7505ffb700 1 -- 172.21.15.117:0/2591654628 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f750c057170 con 0x7f7510149f50 2023-07-19T20:45:19.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.312+0000 7f7517637700 1 -- 172.21.15.117:0/2591654628 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f74f406a660 msgr2=0x7f74f406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.312+0000 7f7517637700 1 --2- 172.21.15.117:0/2591654628 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f74f406a660 0x7f74f406cb10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7500007fd0 tx=0x7f7500009040 comp rx=0 tx=0).stop 2023-07-19T20:45:19.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.312+0000 7f7517637700 1 -- 172.21.15.117:0/2591654628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7510149f50 msgr2=0x7f7510151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.312+0000 7f7517637700 1 --2- 172.21.15.117:0/2591654628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7510149f50 0x7f7510151460 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c4a0 tx=0x7f750c00c7b0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.312+0000 7f7517637700 1 -- 172.21.15.117:0/2591654628 shutdown_connections 2023-07-19T20:45:19.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.312+0000 7f7517637700 1 --2- 172.21.15.117:0/2591654628 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f74f406a660 0x7f74f406cb10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.312+0000 7f7517637700 1 --2- 172.21.15.117:0/2591654628 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7510154260 0x7f751014ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.312+0000 7f7517637700 1 --2- 172.21.15.117:0/2591654628 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75100c1470 0x7f751014fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.312+0000 7f7517637700 1 --2- 172.21.15.117:0/2591654628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7510149f50 0x7f7510151460 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.312+0000 7f7517637700 1 -- 172.21.15.117:0/2591654628 >> 172.21.15.117:0/2591654628 conn(0x7f7510072920 msgr2=0x7f75100bb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:19.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.312+0000 7f7517637700 1 -- 172.21.15.117:0/2591654628 shutdown_connections 2023-07-19T20:45:19.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.312+0000 7f7517637700 1 -- 172.21.15.117:0/2591654628 wait complete. 2023-07-19T20:45:19.317 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-19T20:45:19.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.445+0000 7f27d1845700 1 Processor -- start 2023-07-19T20:45:19.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.445+0000 7f27d1845700 1 -- start start 2023-07-19T20:45:19.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27d1845700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f27cc149f50 0x7f27cc14a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27d1845700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f27cc153250 0x7f27cc155630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27d1845700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27cc0bcd00 con 0x7f27cc0c1470 2023-07-19T20:45:19.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27d1845700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27cc0b8710 con 0x7f27cc153250 2023-07-19T20:45:19.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27d1845700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc0b8bd0 con 0x7f27cc149f50 2023-07-19T20:45:19.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27caffd700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f27cc0c1470 0x7f27cc0b8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:60294/0 (socket says 172.21.15.117:60294) 2023-07-19T20:45:19.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27caffd700 1 -- 172.21.15.117:0/3936016843 learned_addr learned my addr 172.21.15.117:0/3936016843 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:19.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27cb7fe700 1 --2- 172.21.15.117:0/3936016843 >> v2:172.21.15.124:3300/0 conn(0x7f27cc153250 0x7f27cc155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27ca7fc700 1 --2- 172.21.15.117:0/3936016843 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f27cc149f50 0x7f27cc14a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 -- 172.21.15.117:0/3936016843 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952837416 0 0) 0x7f27cc0bcd00 con 0x7f27cc0c1470 2023-07-19T20:45:19.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 -- 172.21.15.117:0/3936016843 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b40035b0 con 0x7f27cc0c1470 2023-07-19T20:45:19.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 -- 172.21.15.117:0/3936016843 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 480362851 0 0) 0x7f27b40035b0 con 0x7f27cc0c1470 2023-07-19T20:45:19.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 -- 172.21.15.117:0/3936016843 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f27cc149f50 msgr2=0x7f27cc14a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:19.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 --2- 172.21.15.117:0/3936016843 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f27cc149f50 0x7f27cc14a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 -- 172.21.15.117:0/3936016843 >> v2:172.21.15.124:3300/0 conn(0x7f27cc153250 msgr2=0x7f27cc155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:19.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 --2- 172.21.15.117:0/3936016843 >> v2:172.21.15.124:3300/0 conn(0x7f27cc153250 0x7f27cc155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 -- 172.21.15.117:0/3936016843 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc0bab50 con 0x7f27cc0c1470 2023-07-19T20:45:19.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 -- 172.21.15.117:0/3936016843 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f27bc001670 con 0x7f27cc0c1470 2023-07-19T20:45:19.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 -- 172.21.15.117:0/3936016843 >> v1:172.21.15.117:6789/0 conn(0x7f27cc0c1470 legacy=0x7f27cc0b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 --2- 172.21.15.117:0/3936016843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4003a00 0x7f27b4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 --2- 172.21.15.117:0/3936016843 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27b4004430 0x7f27b40048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 --2- 172.21.15.117:0/3936016843 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f27cc149f50 0x7f27b4004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 -- 172.21.15.117:0/3936016843 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc0b8710 con 0x7f27b4003a00 2023-07-19T20:45:19.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 -- 172.21.15.117:0/3936016843 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc0b8bd0 con 0x7f27b4004430 2023-07-19T20:45:19.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27c9ffb700 1 -- 172.21.15.117:0/3936016843 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b400ba10 con 0x7f27cc149f50 2023-07-19T20:45:19.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27caffd700 1 --2- 172.21.15.117:0/3936016843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4003a00 0x7f27b4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27ca7fc700 1 --2- 172.21.15.117:0/3936016843 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27b4004430 0x7f27b40048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.446+0000 7f27cb7fe700 1 --2- 172.21.15.117:0/3936016843 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f27cc149f50 0x7f27b4004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.447+0000 7f27caffd700 1 -- 172.21.15.117:0/3936016843 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f27cc149f50 msgr2=0x7f27b4004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:19.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.447+0000 7f27caffd700 1 --2- 172.21.15.117:0/3936016843 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f27cc149f50 0x7f27b4004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.447+0000 7f27caffd700 1 -- 172.21.15.117:0/3936016843 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27b4004430 msgr2=0x7f27b40048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:19.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.447+0000 7f27caffd700 1 --2- 172.21.15.117:0/3936016843 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27b4004430 0x7f27b40048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.447+0000 7f27caffd700 1 -- 172.21.15.117:0/3936016843 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b40035b0 con 0x7f27b4003a00 2023-07-19T20:45:19.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.447+0000 7f27caffd700 1 --2- 172.21.15.117:0/3936016843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4003a00 0x7f27b4003e10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00c370 tx=0x7f27b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a69f07a58b09cd8 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:19.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.447+0000 7f27c9ffb700 1 -- 172.21.15.117:0/3936016843 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc007c60 con 0x7f27b4003a00 2023-07-19T20:45:19.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.447+0000 7f27c9ffb700 1 -- 172.21.15.117:0/3936016843 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc005960 con 0x7f27b4003a00 2023-07-19T20:45:19.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.447+0000 7f27c9ffb700 1 -- 172.21.15.117:0/3936016843 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc005d10 con 0x7f27b4003a00 2023-07-19T20:45:19.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.447+0000 7f27d1845700 1 -- 172.21.15.117:0/3936016843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4003a00 msgr2=0x7f27b4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.447+0000 7f27d1845700 1 --2- 172.21.15.117:0/3936016843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4003a00 0x7f27b4003e10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00c370 tx=0x7f27b4005880 comp rx=0 tx=0).stop 2023-07-19T20:45:19.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.447+0000 7f27cb7fe700 1 -- 172.21.15.117:0/3936016843 reap_dead start 2023-07-19T20:45:19.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.448+0000 7f27d1845700 1 -- 172.21.15.117:0/3936016843 shutdown_connections 2023-07-19T20:45:19.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.448+0000 7f27d1845700 1 -- 172.21.15.117:0/3936016843 >> 172.21.15.117:0/3936016843 conn(0x7f27cc072920 msgr2=0x7f27cc0c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:19.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.448+0000 7f27d1845700 1 -- 172.21.15.117:0/3936016843 shutdown_connections 2023-07-19T20:45:19.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.448+0000 7f27d1845700 1 -- 172.21.15.117:0/3936016843 wait complete. 2023-07-19T20:45:19.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.449+0000 7f27d1845700 1 Processor -- start 2023-07-19T20:45:19.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.449+0000 7f27d1845700 1 -- start start 2023-07-19T20:45:19.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27d1845700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4003a00 0x7f27cc14ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27d1845700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f27cc151730 0x7f27cc151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27d1845700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27cc1508d0 0x7f27cc150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27d1845700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc14b070 con 0x7f27b4003a00 2023-07-19T20:45:19.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27d1845700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc151280 con 0x7f27cc1508d0 2023-07-19T20:45:19.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27d1845700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc150340 con 0x7f27cc151730 2023-07-19T20:45:19.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27caffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4003a00 0x7f27cc14ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27caffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4003a00 0x7f27cc14ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38342/0 (socket says 172.21.15.117:38342) 2023-07-19T20:45:19.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27caffd700 1 -- 172.21.15.117:0/489954622 learned_addr learned my addr 172.21.15.117:0/489954622 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:19.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27ca7fc700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f27cc151730 0x7f27cc151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27caffd700 1 -- 172.21.15.117:0/489954622 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f27cc151730 msgr2=0x7f27cc151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27caffd700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f27cc151730 0x7f27cc151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27caffd700 1 -- 172.21.15.117:0/489954622 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27cc1508d0 msgr2=0x7f27cc150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27cb7fe700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27cc1508d0 0x7f27cc150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.470 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27caffd700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27cc1508d0 0x7f27cc150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27caffd700 1 -- 172.21.15.117:0/489954622 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc0b3060 con 0x7f27b4003a00 2023-07-19T20:45:19.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27ca7fc700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f27cc151730 0x7f27cc151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:19.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.450+0000 7f27caffd700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4003a00 0x7f27cc14ab30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f27b4005790 tx=0x7f27bc000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:19.471 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.451+0000 7f27b3fff700 1 -- 172.21.15.117:0/489954622 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc001ab0 con 0x7f27b4003a00 2023-07-19T20:45:19.472 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.451+0000 7f27b3fff700 1 -- 172.21.15.117:0/489954622 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc004870 con 0x7f27b4003a00 2023-07-19T20:45:19.472 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.451+0000 7f27d1845700 1 -- 172.21.15.117:0/489954622 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27cc1521b0 con 0x7f27b4003a00 2023-07-19T20:45:19.472 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.451+0000 7f27b3fff700 1 -- 172.21.15.117:0/489954622 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc004c20 con 0x7f27b4003a00 2023-07-19T20:45:19.472 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.451+0000 7f27d1845700 1 -- 172.21.15.117:0/489954622 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27cc150010 con 0x7f27b4003a00 2023-07-19T20:45:19.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.451+0000 7f27d1845700 1 -- 172.21.15.117:0/489954622 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27cc074890 con 0x7f27b4003a00 2023-07-19T20:45:19.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.452+0000 7f27b3fff700 1 -- 172.21.15.117:0/489954622 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f27bc0070d0 con 0x7f27b4003a00 2023-07-19T20:45:19.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.452+0000 7f27b3fff700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f27b806a660 0x7f27b806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.473 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.452+0000 7f27b3fff700 1 -- 172.21.15.117:0/489954622 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f27bc089d90 con 0x7f27b4003a00 2023-07-19T20:45:19.474 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.452+0000 7f27ca7fc700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f27b806a660 0x7f27b806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.474 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.453+0000 7f27ca7fc700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f27b806a660 0x7f27b806cb10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009470 tx=0x7f27c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:19.474 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.457+0000 7f27b3fff700 1 -- 172.21.15.117:0/489954622 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f27bc055450 con 0x7f27b4003a00 2023-07-19T20:45:19.712 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.719+0000 7f27d1845700 1 -- 172.21.15.117:0/489954622 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f27cc0bc7e0 con 0x7f27b4003a00 2023-07-19T20:45:19.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.722+0000 7f27b3fff700 1 -- 172.21.15.117:0/489954622 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f27bc007dc0 con 0x7f27b4003a00 2023-07-19T20:45:19.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.725+0000 7f27d1845700 1 -- 172.21.15.117:0/489954622 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f27b806a660 msgr2=0x7f27b806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.725+0000 7f27d1845700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f27b806a660 0x7f27b806cb10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009470 tx=0x7f27c0008040 comp rx=0 tx=0).stop 2023-07-19T20:45:19.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.725+0000 7f27d1845700 1 -- 172.21.15.117:0/489954622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4003a00 msgr2=0x7f27cc14ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.725+0000 7f27d1845700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4003a00 0x7f27cc14ab30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f27b4005790 tx=0x7f27bc000fe0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.725+0000 7f27d1845700 1 -- 172.21.15.117:0/489954622 shutdown_connections 2023-07-19T20:45:19.720 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.725+0000 7f27d1845700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f27b806a660 0x7f27b806cb10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.720 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.725+0000 7f27d1845700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27cc1508d0 0x7f27cc150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.720 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.725+0000 7f27d1845700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4003a00 0x7f27cc14ab30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.720 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.725+0000 7f27d1845700 1 --2- 172.21.15.117:0/489954622 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f27cc151730 0x7f27cc151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.725+0000 7f27d1845700 1 -- 172.21.15.117:0/489954622 >> 172.21.15.117:0/489954622 conn(0x7f27cc072920 msgr2=0x7f27cc0bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:19.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.725+0000 7f27d1845700 1 -- 172.21.15.117:0/489954622 shutdown_connections 2023-07-19T20:45:19.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.725+0000 7f27d1845700 1 -- 172.21.15.117:0/489954622 wait complete. 2023-07-19T20:45:19.730 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-19T20:45:19.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.860+0000 7f7ca50b1700 1 Processor -- start 2023-07-19T20:45:19.854 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.860+0000 7f7ca50b1700 1 -- start start 2023-07-19T20:45:19.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7ca50b1700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7ca009f570 0x7f7ca01540b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.865 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7ca50b1700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca0149750 con 0x7f7ca009ce10 2023-07-19T20:45:19.865 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7ca50b1700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca00ba1e0 con 0x7f7ca00bbff0 2023-07-19T20:45:19.866 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7ca50b1700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca00bd2d0 con 0x7f7ca009f570 2023-07-19T20:45:19.866 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9e59c700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7ca009ce10 0x7f7ca0142720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:60302/0 (socket says 172.21.15.117:60302) 2023-07-19T20:45:19.866 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9e59c700 1 -- 172.21.15.117:0/1542731747 learned_addr learned my addr 172.21.15.117:0/1542731747 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:19.866 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9f59e700 1 --2- 172.21.15.117:0/1542731747 >> v2:172.21.15.124:3300/0 conn(0x7f7ca009f570 0x7f7ca01540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.867 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 -- 172.21.15.117:0/1542731747 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593155795 0 0) 0x7f7ca0149750 con 0x7f7ca009ce10 2023-07-19T20:45:19.868 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 -- 172.21.15.117:0/1542731747 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c880035b0 con 0x7f7ca009ce10 2023-07-19T20:45:19.868 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 -- 172.21.15.117:0/1542731747 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 604266636 0 0) 0x7f7c880035b0 con 0x7f7ca009ce10 2023-07-19T20:45:19.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 -- 172.21.15.117:0/1542731747 >> v2:172.21.15.124:3300/0 conn(0x7f7ca009f570 msgr2=0x7f7ca01540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:19.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 --2- 172.21.15.117:0/1542731747 >> v2:172.21.15.124:3300/0 conn(0x7f7ca009f570 0x7f7ca01540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 -- 172.21.15.117:0/1542731747 >> v1:172.21.15.124:6789/0 conn(0x7f7ca00bbff0 legacy=0x7f7ca014c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 -- 172.21.15.117:0/1542731747 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca014bdb0 con 0x7f7ca009ce10 2023-07-19T20:45:19.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 -- 172.21.15.117:0/1542731747 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f7c94001670 con 0x7f7ca009ce10 2023-07-19T20:45:19.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 -- 172.21.15.117:0/1542731747 >> v1:172.21.15.117:6789/0 conn(0x7f7ca009ce10 legacy=0x7f7ca0142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 --2- 172.21.15.117:0/1542731747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c88003a00 0x7f7c88003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 --2- 172.21.15.117:0/1542731747 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c880043f0 0x7f7c880048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 --2- 172.21.15.117:0/1542731747 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c880050b0 0x7f7c8800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 -- 172.21.15.117:0/1542731747 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00bd2d0 con 0x7f7c88003a00 2023-07-19T20:45:19.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 -- 172.21.15.117:0/1542731747 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8800c000 con 0x7f7c880050b0 2023-07-19T20:45:19.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.861+0000 7f7c9dd9b700 1 -- 172.21.15.117:0/1542731747 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8800c1c0 con 0x7f7c880043f0 2023-07-19T20:45:19.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.862+0000 7f7c9ed9d700 1 --2- 172.21.15.117:0/1542731747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c88003a00 0x7f7c88003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.862+0000 7f7c9e59c700 1 --2- 172.21.15.117:0/1542731747 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c880043f0 0x7f7c880048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.862+0000 7f7c9f59e700 1 --2- 172.21.15.117:0/1542731747 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c880050b0 0x7f7c8800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.862+0000 7f7c9ed9d700 1 -- 172.21.15.117:0/1542731747 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c880043f0 msgr2=0x7f7c880048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:19.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.862+0000 7f7c9ed9d700 1 --2- 172.21.15.117:0/1542731747 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7c880043f0 0x7f7c880048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.862+0000 7f7c9ed9d700 1 -- 172.21.15.117:0/1542731747 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c880050b0 msgr2=0x7f7c8800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:19.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.862+0000 7f7c9ed9d700 1 --2- 172.21.15.117:0/1542731747 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c880050b0 0x7f7c8800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.862+0000 7f7c9f59e700 1 -- 172.21.15.117:0/1542731747 reap_dead start 2023-07-19T20:45:19.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.862+0000 7f7c9ed9d700 1 -- 172.21.15.117:0/1542731747 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c880035b0 con 0x7f7c88003a00 2023-07-19T20:45:19.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.862+0000 7f7c9ed9d700 1 --2- 172.21.15.117:0/1542731747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c88003a00 0x7f7c88003dd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800c290 tx=0x7f7c88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec14f722f8aaaed server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:19.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.862+0000 7f7c9dd9b700 1 -- 172.21.15.117:0/1542731747 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98001e70 con 0x7f7c88003a00 2023-07-19T20:45:19.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.862+0000 7f7c9dd9b700 1 -- 172.21.15.117:0/1542731747 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9800ce30 con 0x7f7c88003a00 2023-07-19T20:45:19.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.862+0000 7f7c9dd9b700 1 -- 172.21.15.117:0/1542731747 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98003c40 con 0x7f7c88003a00 2023-07-19T20:45:19.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.863+0000 7f7ca50b1700 1 -- 172.21.15.117:0/1542731747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c88003a00 msgr2=0x7f7c88003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.863+0000 7f7ca50b1700 1 --2- 172.21.15.117:0/1542731747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c88003a00 0x7f7c88003dd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800c290 tx=0x7f7c88005880 comp rx=0 tx=0).stop 2023-07-19T20:45:19.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.863+0000 7f7ca50b1700 1 -- 172.21.15.117:0/1542731747 shutdown_connections 2023-07-19T20:45:19.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.863+0000 7f7ca50b1700 1 --2- 172.21.15.117:0/1542731747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c88003a00 0x7f7c88003dd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.863+0000 7f7ca50b1700 1 -- 172.21.15.117:0/1542731747 >> 172.21.15.117:0/1542731747 conn(0x7f7ca00bd910 msgr2=0x7f7ca00bdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:19.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.863+0000 7f7ca50b1700 1 -- 172.21.15.117:0/1542731747 shutdown_connections 2023-07-19T20:45:19.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.863+0000 7f7ca50b1700 1 -- 172.21.15.117:0/1542731747 wait complete. 2023-07-19T20:45:19.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.864+0000 7f7ca50b1700 1 Processor -- start 2023-07-19T20:45:19.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.864+0000 7f7ca50b1700 1 -- start start 2023-07-19T20:45:19.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7ca50b1700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c88003a00 0x7f7ca009c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7ca50b1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00b4d40 0x7f7ca0140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7ca50b1700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ca00b51b0 0x7f7ca0140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7ca50b1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca009d290 con 0x7f7ca00b4d40 2023-07-19T20:45:19.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7ca50b1700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca014c150 con 0x7f7c88003a00 2023-07-19T20:45:19.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7ca50b1700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00a26c0 con 0x7f7ca00b51b0 2023-07-19T20:45:19.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c9e59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00b4d40 0x7f7ca0140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c9e59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00b4d40 0x7f7ca0140930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38356/0 (socket says 172.21.15.117:38356) 2023-07-19T20:45:19.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c9e59c700 1 -- 172.21.15.117:0/2617373594 learned_addr learned my addr 172.21.15.117:0/2617373594 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:19.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c9ed9d700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c88003a00 0x7f7ca009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c9f59e700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ca00b51b0 0x7f7ca0140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c9e59c700 1 -- 172.21.15.117:0/2617373594 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ca00b51b0 msgr2=0x7f7ca0140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c9e59c700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ca00b51b0 0x7f7ca0140e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c9e59c700 1 -- 172.21.15.117:0/2617373594 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c88003a00 msgr2=0x7f7ca009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:19.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c9e59c700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c88003a00 0x7f7ca009c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:19.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c9e59c700 1 -- 172.21.15.117:0/2617373594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca009c5c0 con 0x7f7ca00b4d40 2023-07-19T20:45:19.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c9ed9d700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c88003a00 0x7f7ca009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:45:19.877 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c9e59c700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00b4d40 0x7f7ca0140930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7c940072f0 tx=0x7f7c94007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:19.877 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c877fe700 1 -- 172.21.15.117:0/2617373594 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400f5a0 con 0x7f7ca00b4d40 2023-07-19T20:45:19.877 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c877fe700 1 -- 172.21.15.117:0/2617373594 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9400f700 con 0x7f7ca00b4d40 2023-07-19T20:45:19.877 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7ca50b1700 1 -- 172.21.15.117:0/2617373594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca00b8f30 con 0x7f7ca00b4d40 2023-07-19T20:45:19.877 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7c877fe700 1 -- 172.21.15.117:0/2617373594 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400fab0 con 0x7f7ca00b4d40 2023-07-19T20:45:19.877 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.865+0000 7f7ca50b1700 1 -- 172.21.15.117:0/2617373594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca00a2070 con 0x7f7ca00b4d40 2023-07-19T20:45:19.878 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.866+0000 7f7ca50b1700 1 -- 172.21.15.117:0/2617373594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca0067940 con 0x7f7ca00b4d40 2023-07-19T20:45:19.878 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.867+0000 7f7c877fe700 1 -- 172.21.15.117:0/2617373594 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f7c9400fc10 con 0x7f7ca00b4d40 2023-07-19T20:45:19.878 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.867+0000 7f7c877fe700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7c8c06a660 0x7f7c8c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:19.878 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.867+0000 7f7c9ed9d700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7c8c06a660 0x7f7c8c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:19.878 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.867+0000 7f7c877fe700 1 -- 172.21.15.117:0/2617373594 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7c94087fe0 con 0x7f7ca00b4d40 2023-07-19T20:45:19.878 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.867+0000 7f7c9ed9d700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7c8c06a660 0x7f7c8c06cb10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7c98015040 tx=0x7f7c98005000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:19.879 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:19.871+0000 7f7c877fe700 1 -- 172.21.15.117:0/2617373594 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7c94053760 con 0x7f7ca00b4d40 2023-07-19T20:45:20.127 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.134+0000 7f7ca50b1700 1 -- 172.21.15.117:0/2617373594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7ca009bc80 con 0x7f7ca00b4d40 2023-07-19T20:45:20.133 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.139+0000 7f7c877fe700 1 -- 172.21.15.117:0/2617373594 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7c9401a0a0 con 0x7f7ca00b4d40 2023-07-19T20:45:20.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.141+0000 7f7ca50b1700 1 -- 172.21.15.117:0/2617373594 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7c8c06a660 msgr2=0x7f7c8c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:20.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.141+0000 7f7ca50b1700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7c8c06a660 0x7f7c8c06cb10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7c98015040 tx=0x7f7c98005000 comp rx=0 tx=0).stop 2023-07-19T20:45:20.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.141+0000 7f7ca50b1700 1 -- 172.21.15.117:0/2617373594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00b4d40 msgr2=0x7f7ca0140930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:20.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.141+0000 7f7ca50b1700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00b4d40 0x7f7ca0140930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7c940072f0 tx=0x7f7c94007600 comp rx=0 tx=0).stop 2023-07-19T20:45:20.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.141+0000 7f7ca50b1700 1 -- 172.21.15.117:0/2617373594 shutdown_connections 2023-07-19T20:45:20.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.141+0000 7f7ca50b1700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7c8c06a660 0x7f7c8c06cb10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.141+0000 7f7ca50b1700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7ca00b51b0 0x7f7ca0140e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.141+0000 7f7ca50b1700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c88003a00 0x7f7ca009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.141+0000 7f7ca50b1700 1 --2- 172.21.15.117:0/2617373594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00b4d40 0x7f7ca0140930 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.141+0000 7f7ca50b1700 1 -- 172.21.15.117:0/2617373594 >> 172.21.15.117:0/2617373594 conn(0x7f7ca00bd910 msgr2=0x7f7ca006ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:20.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.141+0000 7f7ca50b1700 1 -- 172.21.15.117:0/2617373594 shutdown_connections 2023-07-19T20:45:20.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.141+0000 7f7ca50b1700 1 -- 172.21.15.117:0/2617373594 wait complete. 2023-07-19T20:45:20.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-19T20:45:20.270 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.276+0000 7f346a2d3700 1 Processor -- start 2023-07-19T20:45:20.270 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.276+0000 7f346a2d3700 1 -- start start 2023-07-19T20:45:20.272 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.277+0000 7f346a2d3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34641447e0 0x7f34640b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:20.273 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.277+0000 7f346a2d3700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f346406baf0 0x7f3464070110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:20.273 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.277+0000 7f346a2d3700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34640b9770 con 0x7f346406f560 2023-07-19T20:45:20.273 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.277+0000 7f346a2d3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3464070db0 con 0x7f34641447e0 2023-07-19T20:45:20.273 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.277+0000 7f346a2d3700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346406b6a0 con 0x7f346406baf0 2023-07-19T20:45:20.273 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.277+0000 7f3463fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34641447e0 0x7f34640b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:20.273 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.277+0000 7f3468870700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f346406f560 0x7f34640b7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:60316/0 (socket says 172.21.15.117:60316) 2023-07-19T20:45:20.274 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.277+0000 7f3468870700 1 -- 172.21.15.117:0/927326461 learned_addr learned my addr 172.21.15.117:0/927326461 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:20.274 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f34637fe700 1 --2- 172.21.15.117:0/927326461 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f346406baf0 0x7f3464070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:20.274 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f3463fff700 1 -- 172.21.15.117:0/927326461 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f346406baf0 msgr2=0x7f3464070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:20.274 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f3463fff700 1 --2- 172.21.15.117:0/927326461 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f346406baf0 0x7f3464070110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.274 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f3463fff700 1 -- 172.21.15.117:0/927326461 >> v1:172.21.15.117:6789/0 conn(0x7f346406f560 legacy=0x7f34640b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:20.275 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f3463fff700 1 -- 172.21.15.117:0/927326461 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34640b8a70 con 0x7f34641447e0 2023-07-19T20:45:20.275 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f3462ffd700 1 -- 172.21.15.117:0/927326461 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150728770 0 0) 0x7f34640b9770 con 0x7f346406f560 2023-07-19T20:45:20.275 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f3463fff700 1 --2- 172.21.15.117:0/927326461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34641447e0 0x7f34640b9230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3454009840 tx=0x7f3454009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d8bfac58bf369 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:20.275 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f3462ffd700 1 -- 172.21.15.117:0/927326461 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454011830 con 0x7f34641447e0 2023-07-19T20:45:20.275 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f3462ffd700 1 -- 172.21.15.117:0/927326461 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3454011990 con 0x7f34641447e0 2023-07-19T20:45:20.275 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f3462ffd700 1 -- 172.21.15.117:0/927326461 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454011d20 con 0x7f34641447e0 2023-07-19T20:45:20.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f346a2d3700 1 -- 172.21.15.117:0/927326461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34641447e0 msgr2=0x7f34640b9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:20.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f346a2d3700 1 --2- 172.21.15.117:0/927326461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34641447e0 0x7f34640b9230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3454009840 tx=0x7f3454009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:20.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f346a2d3700 1 -- 172.21.15.117:0/927326461 shutdown_connections 2023-07-19T20:45:20.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f346a2d3700 1 --2- 172.21.15.117:0/927326461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34641447e0 0x7f34640b9230 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f346a2d3700 1 --2- 172.21.15.117:0/927326461 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f346406baf0 0x7f3464070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.278+0000 7f346a2d3700 1 -- 172.21.15.117:0/927326461 >> 172.21.15.117:0/927326461 conn(0x7f34640bdc00 msgr2=0x7f34640b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:20.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.279+0000 7f346a2d3700 1 -- 172.21.15.117:0/927326461 shutdown_connections 2023-07-19T20:45:20.277 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.279+0000 7f346a2d3700 1 -- 172.21.15.117:0/927326461 wait complete. 2023-07-19T20:45:20.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.280+0000 7f346a2d3700 1 Processor -- start 2023-07-19T20:45:20.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.280+0000 7f346a2d3700 1 -- start start 2023-07-19T20:45:20.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.280+0000 7f346a2d3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346406baf0 0x7f3464149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:20.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.280+0000 7f346a2d3700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f346406f560 0x7f3464147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:20.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.280+0000 7f346a2d3700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34641447e0 0x7f34641406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:20.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.280+0000 7f346a2d3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34641466c0 con 0x7f346406baf0 2023-07-19T20:45:20.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.280+0000 7f346a2d3700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3464149760 con 0x7f34641447e0 2023-07-19T20:45:20.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.280+0000 7f346a2d3700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3464145860 con 0x7f346406f560 2023-07-19T20:45:20.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.280+0000 7f3463fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346406baf0 0x7f3464149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:20.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.280+0000 7f3463fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346406baf0 0x7f3464149220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38370/0 (socket says 172.21.15.117:38370) 2023-07-19T20:45:20.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.280+0000 7f3463fff700 1 -- 172.21.15.117:0/2312416891 learned_addr learned my addr 172.21.15.117:0/2312416891 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:20.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.281+0000 7f34637fe700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f346406f560 0x7f3464147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:20.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.281+0000 7f3468870700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34641447e0 0x7f34641406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:20.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.281+0000 7f3463fff700 1 -- 172.21.15.117:0/2312416891 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f346406f560 msgr2=0x7f3464147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:20.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.281+0000 7f3463fff700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f346406f560 0x7f3464147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.281+0000 7f3463fff700 1 -- 172.21.15.117:0/2312416891 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34641447e0 msgr2=0x7f34641406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:20.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.281+0000 7f3463fff700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34641447e0 0x7f34641406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.281+0000 7f3463fff700 1 -- 172.21.15.117:0/2312416891 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34540094a0 con 0x7f346406baf0 2023-07-19T20:45:20.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.281+0000 7f3468870700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34641447e0 0x7f34641406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:20.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.281+0000 7f3463fff700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346406baf0 0x7f3464149220 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3454014040 tx=0x7f3454004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:20.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.281+0000 7f3460ff9700 1 -- 172.21.15.117:0/2312416891 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454004480 con 0x7f346406baf0 2023-07-19T20:45:20.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.281+0000 7f3460ff9700 1 -- 172.21.15.117:0/2312416891 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34540045e0 con 0x7f346406baf0 2023-07-19T20:45:20.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.281+0000 7f346a2d3700 1 -- 172.21.15.117:0/2312416891 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3464143250 con 0x7f346406baf0 2023-07-19T20:45:20.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.281+0000 7f3460ff9700 1 -- 172.21.15.117:0/2312416891 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34540038a0 con 0x7f346406baf0 2023-07-19T20:45:20.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.281+0000 7f346a2d3700 1 -- 172.21.15.117:0/2312416891 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3464145c40 con 0x7f346406baf0 2023-07-19T20:45:20.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.282+0000 7f346a2d3700 1 -- 172.21.15.117:0/2312416891 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3464148110 con 0x7f346406baf0 2023-07-19T20:45:20.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.282+0000 7f3460ff9700 1 -- 172.21.15.117:0/2312416891 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f3454023070 con 0x7f346406baf0 2023-07-19T20:45:20.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.283+0000 7f3460ff9700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f345006a660 0x7f345006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:20.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.283+0000 7f3460ff9700 1 -- 172.21.15.117:0/2312416891 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f345408b710 con 0x7f346406baf0 2023-07-19T20:45:20.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.283+0000 7f34637fe700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f345006a660 0x7f345006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:20.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.283+0000 7f34637fe700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f345006a660 0x7f345006cb10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3464149c40 tx=0x7f3458008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:20.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.287+0000 7f3460ff9700 1 -- 172.21.15.117:0/2312416891 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3454056ef0 con 0x7f346406baf0 2023-07-19T20:45:20.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.546+0000 7f346a2d3700 1 -- 172.21.15.117:0/2312416891 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f34641459f0 con 0x7f346406baf0 2023-07-19T20:45:20.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.552+0000 7f3460ff9700 1 -- 172.21.15.117:0/2312416891 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f345405a510 con 0x7f346406baf0 2023-07-19T20:45:20.548 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.554+0000 7f346a2d3700 1 -- 172.21.15.117:0/2312416891 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f345006a660 msgr2=0x7f345006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:20.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.554+0000 7f346a2d3700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f345006a660 0x7f345006cb10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3464149c40 tx=0x7f3458008040 comp rx=0 tx=0).stop 2023-07-19T20:45:20.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.554+0000 7f346a2d3700 1 -- 172.21.15.117:0/2312416891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346406baf0 msgr2=0x7f3464149220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:20.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.554+0000 7f346a2d3700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346406baf0 0x7f3464149220 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3454014040 tx=0x7f3454004750 comp rx=0 tx=0).stop 2023-07-19T20:45:20.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.554+0000 7f346a2d3700 1 -- 172.21.15.117:0/2312416891 shutdown_connections 2023-07-19T20:45:20.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.554+0000 7f346a2d3700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f345006a660 0x7f345006cb10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.554+0000 7f346a2d3700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34641447e0 0x7f34641406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.554+0000 7f346a2d3700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346406baf0 0x7f3464149220 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.554+0000 7f346a2d3700 1 --2- 172.21.15.117:0/2312416891 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f346406f560 0x7f3464147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.554+0000 7f346a2d3700 1 -- 172.21.15.117:0/2312416891 >> 172.21.15.117:0/2312416891 conn(0x7f34640bdc00 msgr2=0x7f34641428e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:20.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.554+0000 7f346a2d3700 1 -- 172.21.15.117:0/2312416891 shutdown_connections 2023-07-19T20:45:20.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.554+0000 7f346a2d3700 1 -- 172.21.15.117:0/2312416891 wait complete. 2023-07-19T20:45:20.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-19T20:45:20.681 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.688+0000 7f3d86a70700 1 Processor -- start 2023-07-19T20:45:20.682 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.688+0000 7f3d86a70700 1 -- start start 2023-07-19T20:45:20.683 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d86a70700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3d80141bb0 0x7f3d800bd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:20.684 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d86a70700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3d800b9870 0x7f3d800b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:20.684 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d86a70700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8009f570 con 0x7f3d80147cb0 2023-07-19T20:45:20.684 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d86a70700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d800b8ae0 con 0x7f3d800b9870 2023-07-19T20:45:20.684 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d86a70700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d800727f0 con 0x7f3d80141bb0 2023-07-19T20:45:20.684 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d7ffff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3d800b9870 0x7f3d800b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:20.685 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d7ffff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3d800b9870 0x7f3d800b9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38374/0 (socket says 172.21.15.117:38374) 2023-07-19T20:45:20.685 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d7ffff700 1 -- 172.21.15.117:0/1219294598 learned_addr learned my addr 172.21.15.117:0/1219294598 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:20.686 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d8480c700 1 --2- 172.21.15.117:0/1219294598 >> v2:172.21.15.124:3300/0 conn(0x7f3d80141bb0 0x7f3d800bd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:20.686 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d7ffff700 1 -- 172.21.15.117:0/1219294598 >> v2:172.21.15.124:3300/0 conn(0x7f3d80141bb0 msgr2=0x7f3d800bd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:20.686 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d7ffff700 1 --2- 172.21.15.117:0/1219294598 >> v2:172.21.15.124:3300/0 conn(0x7f3d80141bb0 0x7f3d800bd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.686 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d7ffff700 1 -- 172.21.15.117:0/1219294598 >> v1:172.21.15.124:6789/0 conn(0x7f3d80147cb0 legacy=0x7f3d8014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:20.686 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d7ffff700 1 -- 172.21.15.117:0/1219294598 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80147820 con 0x7f3d800b9870 2023-07-19T20:45:20.686 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d7ffff700 1 --2- 172.21.15.117:0/1219294598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d800b9870 0x7f3d800b9cc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d8006f7a0 tx=0x7f3d6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e35fc84bbd52937 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:20.686 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d7f7fe700 1 -- 172.21.15.117:0/1219294598 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c011830 con 0x7f3d800b9870 2023-07-19T20:45:20.687 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d7f7fe700 1 -- 172.21.15.117:0/1219294598 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c011990 con 0x7f3d800b9870 2023-07-19T20:45:20.687 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.689+0000 7f3d7f7fe700 1 -- 172.21.15.117:0/1219294598 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c011d20 con 0x7f3d800b9870 2023-07-19T20:45:20.687 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.690+0000 7f3d86a70700 1 -- 172.21.15.117:0/1219294598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d800b9870 msgr2=0x7f3d800b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:20.687 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.690+0000 7f3d86a70700 1 --2- 172.21.15.117:0/1219294598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d800b9870 0x7f3d800b9cc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d8006f7a0 tx=0x7f3d6c009c00 comp rx=0 tx=0).stop 2023-07-19T20:45:20.687 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.690+0000 7f3d86a70700 1 -- 172.21.15.117:0/1219294598 shutdown_connections 2023-07-19T20:45:20.687 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.690+0000 7f3d86a70700 1 --2- 172.21.15.117:0/1219294598 >> v2:172.21.15.124:3300/0 conn(0x7f3d80141bb0 0x7f3d800bd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.688 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.690+0000 7f3d86a70700 1 --2- 172.21.15.117:0/1219294598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d800b9870 0x7f3d800b9cc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.688 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.690+0000 7f3d86a70700 1 -- 172.21.15.117:0/1219294598 >> 172.21.15.117:0/1219294598 conn(0x7f3d800bd910 msgr2=0x7f3d800bdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:20.688 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.690+0000 7f3d86a70700 1 -- 172.21.15.117:0/1219294598 shutdown_connections 2023-07-19T20:45:20.688 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.690+0000 7f3d86a70700 1 -- 172.21.15.117:0/1219294598 wait complete. 2023-07-19T20:45:20.690 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.691+0000 7f3d86a70700 1 Processor -- start 2023-07-19T20:45:20.690 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.691+0000 7f3d86a70700 1 -- start start 2023-07-19T20:45:20.690 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d86a70700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d800b9870 0x7f3d800a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:20.691 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d86a70700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d80141bb0 0x7f3d80145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:20.691 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d86a70700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3d80147cb0 0x7f3d801e1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:20.691 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d86a70700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d801470c0 con 0x7f3d80141bb0 2023-07-19T20:45:20.691 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d86a70700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d801e1630 con 0x7f3d800b9870 2023-07-19T20:45:20.691 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d86a70700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d801465e0 con 0x7f3d80147cb0 2023-07-19T20:45:20.691 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d7ffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d80141bb0 0x7f3d80145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:20.691 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d7ffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d80141bb0 0x7f3d80145660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38378/0 (socket says 172.21.15.117:38378) 2023-07-19T20:45:20.691 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d7ffff700 1 -- 172.21.15.117:0/1079125479 learned_addr learned my addr 172.21.15.117:0/1079125479 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:20.692 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d8480c700 1 --2- 172.21.15.117:0/1079125479 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d800b9870 0x7f3d800a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:20.692 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d8500d700 1 --2- 172.21.15.117:0/1079125479 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3d80147cb0 0x7f3d801e1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:20.692 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d7ffff700 1 -- 172.21.15.117:0/1079125479 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3d80147cb0 msgr2=0x7f3d801e1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:20.692 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d7ffff700 1 --2- 172.21.15.117:0/1079125479 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3d80147cb0 0x7f3d801e1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.692 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d7ffff700 1 -- 172.21.15.117:0/1079125479 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d800b9870 msgr2=0x7f3d800a09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:20.692 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d7ffff700 1 --2- 172.21.15.117:0/1079125479 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d800b9870 0x7f3d800a09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.692 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d7ffff700 1 -- 172.21.15.117:0/1079125479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c009550 con 0x7f3d80141bb0 2023-07-19T20:45:20.693 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d7ffff700 1 --2- 172.21.15.117:0/1079125479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d80141bb0 0x7f3d80145660 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009870 tx=0x7f3d6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:20.693 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d7d7fa700 1 -- 172.21.15.117:0/1079125479 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c004510 con 0x7f3d80141bb0 2023-07-19T20:45:20.693 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d7d7fa700 1 -- 172.21.15.117:0/1079125479 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c01e070 con 0x7f3d80141bb0 2023-07-19T20:45:20.693 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d86a70700 1 -- 172.21.15.117:0/1079125479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d80146860 con 0x7f3d80141bb0 2023-07-19T20:45:20.693 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.692+0000 7f3d7d7fa700 1 -- 172.21.15.117:0/1079125479 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0038c0 con 0x7f3d80141bb0 2023-07-19T20:45:20.693 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.693+0000 7f3d86a70700 1 -- 172.21.15.117:0/1079125479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8009f140 con 0x7f3d80141bb0 2023-07-19T20:45:20.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.693+0000 7f3d86a70700 1 -- 172.21.15.117:0/1079125479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d80146d80 con 0x7f3d80141bb0 2023-07-19T20:45:20.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.694+0000 7f3d7d7fa700 1 -- 172.21.15.117:0/1079125479 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f3d6c003a20 con 0x7f3d80141bb0 2023-07-19T20:45:20.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.694+0000 7f3d7d7fa700 1 --2- 172.21.15.117:0/1079125479 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3d6406a660 0x7f3d6406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:20.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.694+0000 7f3d7d7fa700 1 -- 172.21.15.117:0/1079125479 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3d6c089710 con 0x7f3d80141bb0 2023-07-19T20:45:20.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.694+0000 7f3d8480c700 1 --2- 172.21.15.117:0/1079125479 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3d6406a660 0x7f3d6406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:20.694 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.695+0000 7f3d8480c700 1 --2- 172.21.15.117:0/1079125479 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3d6406a660 0x7f3d6406cb10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009be0 tx=0x7f3d74009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:20.695 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.699+0000 7f3d7d7fa700 1 -- 172.21.15.117:0/1079125479 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3d6c054e70 con 0x7f3d80141bb0 2023-07-19T20:45:20.956 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.963+0000 7f3d86a70700 1 -- 172.21.15.117:0/1079125479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f3d80067940 con 0x7f3d80141bb0 2023-07-19T20:45:20.962 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.968+0000 7f3d7d7fa700 1 -- 172.21.15.117:0/1079125479 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3d6c0200a0 con 0x7f3d80141bb0 2023-07-19T20:45:20.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.970+0000 7f3d86a70700 1 -- 172.21.15.117:0/1079125479 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3d6406a660 msgr2=0x7f3d6406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:20.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.970+0000 7f3d86a70700 1 --2- 172.21.15.117:0/1079125479 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3d6406a660 0x7f3d6406cb10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009be0 tx=0x7f3d74009210 comp rx=0 tx=0).stop 2023-07-19T20:45:20.964 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.970+0000 7f3d86a70700 1 -- 172.21.15.117:0/1079125479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d80141bb0 msgr2=0x7f3d80145660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:20.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.970+0000 7f3d86a70700 1 --2- 172.21.15.117:0/1079125479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d80141bb0 0x7f3d80145660 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009870 tx=0x7f3d6c004750 comp rx=0 tx=0).stop 2023-07-19T20:45:20.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.970+0000 7f3d86a70700 1 -- 172.21.15.117:0/1079125479 shutdown_connections 2023-07-19T20:45:20.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.970+0000 7f3d86a70700 1 --2- 172.21.15.117:0/1079125479 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f3d6406a660 0x7f3d6406cb10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.970+0000 7f3d86a70700 1 --2- 172.21.15.117:0/1079125479 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3d80147cb0 0x7f3d801e1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.970+0000 7f3d86a70700 1 --2- 172.21.15.117:0/1079125479 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d800b9870 0x7f3d800a09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.970+0000 7f3d86a70700 1 --2- 172.21.15.117:0/1079125479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d80141bb0 0x7f3d80145660 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:20.965 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.971+0000 7f3d86a70700 1 -- 172.21.15.117:0/1079125479 >> 172.21.15.117:0/1079125479 conn(0x7f3d800bd910 msgr2=0x7f3d8006c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:20.966 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.971+0000 7f3d86a70700 1 -- 172.21.15.117:0/1079125479 shutdown_connections 2023-07-19T20:45:20.966 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:20.971+0000 7f3d86a70700 1 -- 172.21.15.117:0/1079125479 wait complete. 2023-07-19T20:45:20.977 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:45:21.099 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.105+0000 7f5082916700 1 Processor -- start 2023-07-19T20:45:21.099 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.105+0000 7f5082916700 1 -- start start 2023-07-19T20:45:21.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.106+0000 7f5082916700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f507c0b7210 0x7f507c071770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.106+0000 7f5082916700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f507c0b91c0 0x7f507c06b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.106+0000 7f5082916700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f507c14c2d0 0x7f507c14c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.106+0000 7f5082916700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507c14be40 con 0x7f507c0b7210 2023-07-19T20:45:21.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.106+0000 7f5082916700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507c14cc90 con 0x7f507c0b91c0 2023-07-19T20:45:21.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.106+0000 7f5082916700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507c071e40 con 0x7f507c14c2d0 2023-07-19T20:45:21.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.106+0000 7f507bfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f507c0b7210 0x7f507c071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.102 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.106+0000 7f507bfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f507c0b7210 0x7f507c071770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38392/0 (socket says 172.21.15.117:38392) 2023-07-19T20:45:21.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.106+0000 7f507bfff700 1 -- 172.21.15.117:0/379078912 learned_addr learned my addr 172.21.15.117:0/379078912 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:21.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.107+0000 7f507b7fe700 1 --2- 172.21.15.117:0/379078912 >> v2:172.21.15.124:3300/0 conn(0x7f507c0b91c0 0x7f507c06b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.107+0000 7f5080eb3700 1 --2- 172.21.15.117:0/379078912 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f507c14c2d0 0x7f507c14c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.107+0000 7f507bfff700 1 -- 172.21.15.117:0/379078912 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f507c14c2d0 msgr2=0x7f507c14c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:21.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.107+0000 7f507bfff700 1 --2- 172.21.15.117:0/379078912 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f507c14c2d0 0x7f507c14c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.107+0000 7f507bfff700 1 -- 172.21.15.117:0/379078912 >> v2:172.21.15.124:3300/0 conn(0x7f507c0b91c0 msgr2=0x7f507c06b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:21.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.107+0000 7f507bfff700 1 --2- 172.21.15.117:0/379078912 >> v2:172.21.15.124:3300/0 conn(0x7f507c0b91c0 0x7f507c06b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.107+0000 7f507bfff700 1 -- 172.21.15.117:0/379078912 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c072120 con 0x7f507c0b7210 2023-07-19T20:45:21.104 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.107+0000 7f507b7fe700 1 --2- 172.21.15.117:0/379078912 >> v2:172.21.15.124:3300/0 conn(0x7f507c0b91c0 0x7f507c06b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:21.104 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.107+0000 7f507bfff700 1 --2- 172.21.15.117:0/379078912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f507c0b7210 0x7f507c071770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f507c0738d0 tx=0x7f506c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a3223739adc9a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:21.104 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.107+0000 7f507affd700 1 -- 172.21.15.117:0/379078912 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c00b870 con 0x7f507c0b7210 2023-07-19T20:45:21.104 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.107+0000 7f507affd700 1 -- 172.21.15.117:0/379078912 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c00b9d0 con 0x7f507c0b7210 2023-07-19T20:45:21.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.107+0000 7f507affd700 1 -- 172.21.15.117:0/379078912 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c00bd60 con 0x7f507c0b7210 2023-07-19T20:45:21.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.107+0000 7f5082916700 1 -- 172.21.15.117:0/379078912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f507c0b7210 msgr2=0x7f507c071770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.107+0000 7f5082916700 1 --2- 172.21.15.117:0/379078912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f507c0b7210 0x7f507c071770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f507c0738d0 tx=0x7f506c009bd0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.108+0000 7f5082916700 1 -- 172.21.15.117:0/379078912 shutdown_connections 2023-07-19T20:45:21.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.108+0000 7f5082916700 1 --2- 172.21.15.117:0/379078912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f507c0b7210 0x7f507c071770 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.108+0000 7f5082916700 1 --2- 172.21.15.117:0/379078912 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f507c14c2d0 0x7f507c14c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.108+0000 7f5082916700 1 --2- 172.21.15.117:0/379078912 >> v2:172.21.15.124:3300/0 conn(0x7f507c0b91c0 0x7f507c06b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.108+0000 7f5082916700 1 -- 172.21.15.117:0/379078912 >> 172.21.15.117:0/379078912 conn(0x7f507c0bdc00 msgr2=0x7f507c0b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:21.106 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.108+0000 7f5082916700 1 -- 172.21.15.117:0/379078912 shutdown_connections 2023-07-19T20:45:21.106 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.108+0000 7f5082916700 1 -- 172.21.15.117:0/379078912 wait complete. 2023-07-19T20:45:21.108 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.109+0000 7f5082916700 1 Processor -- start 2023-07-19T20:45:21.108 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.109+0000 7f5082916700 1 -- start start 2023-07-19T20:45:21.108 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.109+0000 7f5082916700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f507c0b7210 0x7f507c070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.108 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.109+0000 7f5082916700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f507c0b91c0 0x7f507c1446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.108 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.109+0000 7f5082916700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f507c14c2d0 0x7f507c1d3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.108 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.109+0000 7f5082916700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c071270 con 0x7f507c0b91c0 2023-07-19T20:45:21.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.109+0000 7f5082916700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c141fd0 con 0x7f507c14c2d0 2023-07-19T20:45:21.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.109+0000 7f5082916700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507c144c00 con 0x7f507c0b7210 2023-07-19T20:45:21.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f507b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f507c0b91c0 0x7f507c1446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f507b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f507c0b91c0 0x7f507c1446c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38406/0 (socket says 172.21.15.117:38406) 2023-07-19T20:45:21.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f507b7fe700 1 -- 172.21.15.117:0/3518984280 learned_addr learned my addr 172.21.15.117:0/3518984280 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:21.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f5080eb3700 1 --2- 172.21.15.117:0/3518984280 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f507c14c2d0 0x7f507c1d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f507bfff700 1 --2- 172.21.15.117:0/3518984280 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f507c0b7210 0x7f507c070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f507b7fe700 1 -- 172.21.15.117:0/3518984280 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f507c0b7210 msgr2=0x7f507c070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f507b7fe700 1 --2- 172.21.15.117:0/3518984280 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f507c0b7210 0x7f507c070d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f507b7fe700 1 -- 172.21.15.117:0/3518984280 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f507c14c2d0 msgr2=0x7f507c1d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f507b7fe700 1 --2- 172.21.15.117:0/3518984280 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f507c14c2d0 0x7f507c1d3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f507b7fe700 1 -- 172.21.15.117:0/3518984280 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c009550 con 0x7f507c0b91c0 2023-07-19T20:45:21.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f507b7fe700 1 --2- 172.21.15.117:0/3518984280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f507c0b91c0 0x7f507c1446c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f507000c740 tx=0x7f507000ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:21.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f5078ff9700 1 -- 172.21.15.117:0/3518984280 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070011800 con 0x7f507c0b91c0 2023-07-19T20:45:21.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f5078ff9700 1 -- 172.21.15.117:0/3518984280 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5070011960 con 0x7f507c0b91c0 2023-07-19T20:45:21.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f5082916700 1 -- 172.21.15.117:0/3518984280 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507c1d4710 con 0x7f507c0b91c0 2023-07-19T20:45:21.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f5078ff9700 1 -- 172.21.15.117:0/3518984280 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070011cd0 con 0x7f507c0b91c0 2023-07-19T20:45:21.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.110+0000 7f5082916700 1 -- 172.21.15.117:0/3518984280 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507c0bb260 con 0x7f507c0b91c0 2023-07-19T20:45:21.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.111+0000 7f5082916700 1 -- 172.21.15.117:0/3518984280 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507c143d50 con 0x7f507c0b91c0 2023-07-19T20:45:21.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.111+0000 7f5078ff9700 1 -- 172.21.15.117:0/3518984280 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f5070021350 con 0x7f507c0b91c0 2023-07-19T20:45:21.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.112+0000 7f5078ff9700 1 --2- 172.21.15.117:0/3518984280 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f506806a660 0x7f506806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.112+0000 7f507bfff700 1 --2- 172.21.15.117:0/3518984280 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f506806a660 0x7f506806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.112+0000 7f5078ff9700 1 -- 172.21.15.117:0/3518984280 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5070088470 con 0x7f507c0b91c0 2023-07-19T20:45:21.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.112+0000 7f507bfff700 1 --2- 172.21.15.117:0/3518984280 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f506806a660 0x7f506806cb10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f506c000c00 tx=0x7f506c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:21.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.116+0000 7f5078ff9700 1 -- 172.21.15.117:0/3518984280 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f50700576e0 con 0x7f507c0b91c0 2023-07-19T20:45:21.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.302+0000 7f5082916700 1 -- 172.21.15.117:0/3518984280 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f507c067940 con 0x7f507c0b91c0 2023-07-19T20:45:21.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.303+0000 7f5078ff9700 1 -- 172.21.15.117:0/3518984280 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+14257 (secure 0 0 0) 0x7f5070057270 con 0x7f507c0b91c0 2023-07-19T20:45:21.297 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:21.297 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":29,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:45:18.058796+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:45:21.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.305+0000 7f5082916700 1 -- 172.21.15.117:0/3518984280 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f506806a660 msgr2=0x7f506806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.305+0000 7f5082916700 1 --2- 172.21.15.117:0/3518984280 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f506806a660 0x7f506806cb10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f506c000c00 tx=0x7f506c008030 comp rx=0 tx=0).stop 2023-07-19T20:45:21.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.305+0000 7f5082916700 1 -- 172.21.15.117:0/3518984280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f507c0b91c0 msgr2=0x7f507c1446c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.299 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.305+0000 7f5082916700 1 --2- 172.21.15.117:0/3518984280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f507c0b91c0 0x7f507c1446c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f507000c740 tx=0x7f507000ca50 comp rx=0 tx=0).stop 2023-07-19T20:45:21.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.305+0000 7f5082916700 1 -- 172.21.15.117:0/3518984280 shutdown_connections 2023-07-19T20:45:21.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.305+0000 7f5082916700 1 --2- 172.21.15.117:0/3518984280 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f506806a660 0x7f506806cb10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.305+0000 7f5082916700 1 --2- 172.21.15.117:0/3518984280 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f507c14c2d0 0x7f507c1d3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.305+0000 7f5082916700 1 --2- 172.21.15.117:0/3518984280 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f507c0b7210 0x7f507c070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.305+0000 7f5082916700 1 --2- 172.21.15.117:0/3518984280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f507c0b91c0 0x7f507c1446c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.305+0000 7f5082916700 1 -- 172.21.15.117:0/3518984280 >> 172.21.15.117:0/3518984280 conn(0x7f507c0bdc00 msgr2=0x7f507c0bb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:21.300 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.306+0000 7f5082916700 1 -- 172.21.15.117:0/3518984280 shutdown_connections 2023-07-19T20:45:21.301 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.306+0000 7f5082916700 1 -- 172.21.15.117:0/3518984280 wait complete. 2023-07-19T20:45:21.315 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-19T20:44:31.325778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-19T20:44:31.728215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-19T20:45:21.317 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-19T20:45:21.441 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.448+0000 7f9871d04700 1 Processor -- start 2023-07-19T20:45:21.442 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.448+0000 7f9871d04700 1 -- start start 2023-07-19T20:45:21.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f9871d04700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f986c0baa60 0x7f986c0b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.444 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f9871d04700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f986c0bca00 0x7f986c0bd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f9871d04700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f986c14ddd0 0x7f986c144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f9871d04700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c0bdf10 con 0x7f986c14ddd0 2023-07-19T20:45:21.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f9871d04700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c0bd540 con 0x7f986c0baa60 2023-07-19T20:45:21.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f9871d04700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0b8d70 con 0x7f986c0bca00 2023-07-19T20:45:21.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986bfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f986c14ddd0 0x7f986c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986bfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f986c14ddd0 0x7f986c144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38408/0 (socket says 172.21.15.117:38408) 2023-07-19T20:45:21.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986bfff700 1 -- 172.21.15.117:0/980205024 learned_addr learned my addr 172.21.15.117:0/980205024 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:21.445 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986b7fe700 1 --2- 172.21.15.117:0/980205024 >> v2:172.21.15.124:3300/0 conn(0x7f986c0baa60 0x7f986c0b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.446 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986affd700 1 --2- 172.21.15.117:0/980205024 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f986c0bca00 0x7f986c0bd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.446 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986bfff700 1 -- 172.21.15.117:0/980205024 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f986c0bca00 msgr2=0x7f986c0bd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:21.446 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986bfff700 1 --2- 172.21.15.117:0/980205024 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f986c0bca00 0x7f986c0bd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.446 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986bfff700 1 -- 172.21.15.117:0/980205024 >> v2:172.21.15.124:3300/0 conn(0x7f986c0baa60 msgr2=0x7f986c0b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:21.446 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986bfff700 1 --2- 172.21.15.117:0/980205024 >> v2:172.21.15.124:3300/0 conn(0x7f986c0baa60 0x7f986c0b7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.446 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986bfff700 1 -- 172.21.15.117:0/980205024 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c0b8fe0 con 0x7f986c14ddd0 2023-07-19T20:45:21.446 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986affd700 1 --2- 172.21.15.117:0/980205024 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f986c0bca00 0x7f986c0bd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:21.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986b7fe700 1 --2- 172.21.15.117:0/980205024 >> v2:172.21.15.124:3300/0 conn(0x7f986c0baa60 0x7f986c0b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:21.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986bfff700 1 --2- 172.21.15.117:0/980205024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c14ddd0 0x7f986c144790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f986c068650 tx=0x7f986400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa79b6e8aff3acf server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:21.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986a7fc700 1 -- 172.21.15.117:0/980205024 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986400e070 con 0x7f986c14ddd0 2023-07-19T20:45:21.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986a7fc700 1 -- 172.21.15.117:0/980205024 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986400b9c0 con 0x7f986c14ddd0 2023-07-19T20:45:21.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.449+0000 7f986a7fc700 1 -- 172.21.15.117:0/980205024 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986400bd70 con 0x7f986c14ddd0 2023-07-19T20:45:21.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.450+0000 7f9871d04700 1 -- 172.21.15.117:0/980205024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c14ddd0 msgr2=0x7f986c144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.450+0000 7f9871d04700 1 --2- 172.21.15.117:0/980205024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c14ddd0 0x7f986c144790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f986c068650 tx=0x7f986400b330 comp rx=0 tx=0).stop 2023-07-19T20:45:21.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.450+0000 7f9871d04700 1 -- 172.21.15.117:0/980205024 shutdown_connections 2023-07-19T20:45:21.448 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.450+0000 7f9871d04700 1 --2- 172.21.15.117:0/980205024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c14ddd0 0x7f986c144790 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.448 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.450+0000 7f9871d04700 1 --2- 172.21.15.117:0/980205024 >> v2:172.21.15.124:3300/0 conn(0x7f986c0baa60 0x7f986c0b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.448 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.450+0000 7f9871d04700 1 --2- 172.21.15.117:0/980205024 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f986c0bca00 0x7f986c0bd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.449 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.450+0000 7f9871d04700 1 -- 172.21.15.117:0/980205024 >> 172.21.15.117:0/980205024 conn(0x7f986c071c90 msgr2=0x7f986c072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:21.449 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.450+0000 7f9871d04700 1 -- 172.21.15.117:0/980205024 shutdown_connections 2023-07-19T20:45:21.449 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.450+0000 7f9871d04700 1 -- 172.21.15.117:0/980205024 wait complete. 2023-07-19T20:45:21.449 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.451+0000 7f9871d04700 1 Processor -- start 2023-07-19T20:45:21.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.451+0000 7f9871d04700 1 -- start start 2023-07-19T20:45:21.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f9871d04700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c0baa60 0x7f986c1498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f9871d04700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f986c0bca00 0x7f986c1d60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f9871d04700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f986c14ddd0 0x7f986c0b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f9871d04700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c145730 con 0x7f986c0baa60 2023-07-19T20:45:21.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f9871d04700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c149df0 con 0x7f986c14ddd0 2023-07-19T20:45:21.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f9871d04700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c145b20 con 0x7f986c0bca00 2023-07-19T20:45:21.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f986b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c0baa60 0x7f986c1498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f986b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c0baa60 0x7f986c1498b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38412/0 (socket says 172.21.15.117:38412) 2023-07-19T20:45:21.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f986b7fe700 1 -- 172.21.15.117:0/150695044 learned_addr learned my addr 172.21.15.117:0/150695044 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:21.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f986affd700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f986c0bca00 0x7f986c1d60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f986bfff700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f986c14ddd0 0x7f986c0b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f986b7fe700 1 -- 172.21.15.117:0/150695044 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f986c0bca00 msgr2=0x7f986c1d60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f986b7fe700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f986c0bca00 0x7f986c1d60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f986b7fe700 1 -- 172.21.15.117:0/150695044 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f986c14ddd0 msgr2=0x7f986c0b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f986b7fe700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f986c14ddd0 0x7f986c0b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f986b7fe700 1 -- 172.21.15.117:0/150695044 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9864009b30 con 0x7f986c0baa60 2023-07-19T20:45:21.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f986bfff700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f986c14ddd0 0x7f986c0b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:21.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f986b7fe700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c0baa60 0x7f986c1498b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f986000e810 tx=0x7f986000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:21.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f9853fff700 1 -- 172.21.15.117:0/150695044 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986000c020 con 0x7f986c0baa60 2023-07-19T20:45:21.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.452+0000 7f9853fff700 1 -- 172.21.15.117:0/150695044 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9860004250 con 0x7f986c0baa60 2023-07-19T20:45:21.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.453+0000 7f9871d04700 1 -- 172.21.15.117:0/150695044 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c146810 con 0x7f986c0baa60 2023-07-19T20:45:21.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.453+0000 7f9853fff700 1 -- 172.21.15.117:0/150695044 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98600036a0 con 0x7f986c0baa60 2023-07-19T20:45:21.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.453+0000 7f9871d04700 1 -- 172.21.15.117:0/150695044 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c145450 con 0x7f986c0baa60 2023-07-19T20:45:21.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.453+0000 7f9871d04700 1 -- 172.21.15.117:0/150695044 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986c0b9800 con 0x7f986c0baa60 2023-07-19T20:45:21.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.454+0000 7f9853fff700 1 -- 172.21.15.117:0/150695044 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f9860003800 con 0x7f986c0baa60 2023-07-19T20:45:21.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.454+0000 7f9853fff700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f985806a660 0x7f985806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.454+0000 7f9853fff700 1 -- 172.21.15.117:0/150695044 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9860088280 con 0x7f986c0baa60 2023-07-19T20:45:21.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.454+0000 7f986affd700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f985806a660 0x7f985806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.455+0000 7f986affd700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f985806a660 0x7f985806cb10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f986c1d5ea0 tx=0x7f985c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:21.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.458+0000 7f9853fff700 1 -- 172.21.15.117:0/150695044 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9860053a60 con 0x7f986c0baa60 2023-07-19T20:45:21.637 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.642+0000 7f9871d04700 1 -- 172.21.15.117:0/150695044 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f986c074890 con 0x7f986c0baa60 2023-07-19T20:45:21.637 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.642+0000 7f9853fff700 1 -- 172.21.15.117:0/150695044 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9860057080 con 0x7f986c0baa60 2023-07-19T20:45:21.637 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 8 2023-07-19T20:45:21.638 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.644+0000 7f9871d04700 1 -- 172.21.15.117:0/150695044 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f985806a660 msgr2=0x7f985806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.638 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.644+0000 7f9871d04700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f985806a660 0x7f985806cb10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f986c1d5ea0 tx=0x7f985c008040 comp rx=0 tx=0).stop 2023-07-19T20:45:21.638 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.644+0000 7f9871d04700 1 -- 172.21.15.117:0/150695044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c0baa60 msgr2=0x7f986c1498b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.639 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.644+0000 7f9871d04700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c0baa60 0x7f986c1498b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f986000e810 tx=0x7f986000ebd0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.639 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.644+0000 7f9871d04700 1 -- 172.21.15.117:0/150695044 shutdown_connections 2023-07-19T20:45:21.639 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.644+0000 7f9871d04700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f985806a660 0x7f985806cb10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.639 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.644+0000 7f9871d04700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f986c14ddd0 0x7f986c0b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.639 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.644+0000 7f9871d04700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c0baa60 0x7f986c1498b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.639 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.644+0000 7f9871d04700 1 --2- 172.21.15.117:0/150695044 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f986c0bca00 0x7f986c1d60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.639 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.644+0000 7f9871d04700 1 -- 172.21.15.117:0/150695044 >> 172.21.15.117:0/150695044 conn(0x7f986c071c90 msgr2=0x7f986c14c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:21.639 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.644+0000 7f9871d04700 1 -- 172.21.15.117:0/150695044 shutdown_connections 2023-07-19T20:45:21.640 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.644+0000 7f9871d04700 1 -- 172.21.15.117:0/150695044 wait complete. 2023-07-19T20:45:21.651 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-19T20:45:21.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.783+0000 7f8fe0a7f700 1 Processor -- start 2023-07-19T20:45:21.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.783+0000 7f8fe0a7f700 1 -- start start 2023-07-19T20:45:21.779 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.783+0000 7f8fe0a7f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8fdc14e930 0x7f8fdc0b8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.780 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.783+0000 7f8fe0a7f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8fdc0babc0 0x7f8fdc0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.780 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.783+0000 7f8fe0a7f700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fdc0b9210 con 0x7f8fdc0ba7f0 2023-07-19T20:45:21.781 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.783+0000 7f8fe0a7f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc0b44f0 con 0x7f8fdc0babc0 2023-07-19T20:45:21.781 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.783+0000 7f8fe0a7f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc14e4a0 con 0x7f8fdc14e930 2023-07-19T20:45:21.781 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.783+0000 7f8fdad9d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8fdc0babc0 0x7f8fdc0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.781 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.784+0000 7f8fdad9d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8fdc0babc0 0x7f8fdc0b8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38416/0 (socket says 172.21.15.117:38416) 2023-07-19T20:45:21.782 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.784+0000 7f8fdad9d700 1 -- 172.21.15.117:0/117405470 learned_addr learned my addr 172.21.15.117:0/117405470 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:21.782 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.784+0000 7f8fd9d9b700 1 --2- 172.21.15.117:0/117405470 >> v2:172.21.15.124:3300/0 conn(0x7f8fdc14e930 0x7f8fdc0b8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.784+0000 7f8fdad9d700 1 -- 172.21.15.117:0/117405470 >> v2:172.21.15.124:3300/0 conn(0x7f8fdc14e930 msgr2=0x7f8fdc0b8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:21.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.784+0000 7f8fdad9d700 1 --2- 172.21.15.117:0/117405470 >> v2:172.21.15.124:3300/0 conn(0x7f8fdc14e930 0x7f8fdc0b8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.784 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.784+0000 7f8fdad9d700 1 -- 172.21.15.117:0/117405470 >> v1:172.21.15.124:6789/0 conn(0x7f8fdc0ba7f0 legacy=0x7f8fdc14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.784 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.784+0000 7f8fdad9d700 1 -- 172.21.15.117:0/117405470 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc144e60 con 0x7f8fdc0babc0 2023-07-19T20:45:21.784 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.784+0000 7f8fdad9d700 1 --2- 172.21.15.117:0/117405470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fdc0babc0 0x7f8fdc0b8bb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0b9be0 tx=0x7f8fd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac579f0da7baa05f server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:21.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.784+0000 7f8fd959a700 1 -- 172.21.15.117:0/117405470 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd400e070 con 0x7f8fdc0babc0 2023-07-19T20:45:21.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.784+0000 7f8fd959a700 1 -- 172.21.15.117:0/117405470 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd400b910 con 0x7f8fdc0babc0 2023-07-19T20:45:21.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.784+0000 7f8fd959a700 1 -- 172.21.15.117:0/117405470 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd400bcc0 con 0x7f8fdc0babc0 2023-07-19T20:45:21.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.785+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/117405470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fdc0babc0 msgr2=0x7f8fdc0b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.785+0000 7f8fe0a7f700 1 --2- 172.21.15.117:0/117405470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fdc0babc0 0x7f8fdc0b8bb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0b9be0 tx=0x7f8fd400b330 comp rx=0 tx=0).stop 2023-07-19T20:45:21.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.785+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/117405470 shutdown_connections 2023-07-19T20:45:21.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.785+0000 7f8fe0a7f700 1 --2- 172.21.15.117:0/117405470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fdc0babc0 0x7f8fdc0b8bb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.787 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.785+0000 7f8fe0a7f700 1 --2- 172.21.15.117:0/117405470 >> v2:172.21.15.124:3300/0 conn(0x7f8fdc14e930 0x7f8fdc0b8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.787 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.785+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/117405470 >> 172.21.15.117:0/117405470 conn(0x7f8fdc071c90 msgr2=0x7f8fdc072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:21.787 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.785+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/117405470 shutdown_connections 2023-07-19T20:45:21.788 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.785+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/117405470 wait complete. 2023-07-19T20:45:21.788 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.786+0000 7f8fe0a7f700 1 Processor -- start 2023-07-19T20:45:21.788 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.786+0000 7f8fe0a7f700 1 -- start start 2023-07-19T20:45:21.792 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.786+0000 7f8fe0a7f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fdc0ba7f0 0x7f8fdc14cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.792 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fe0a7f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fdc0babc0 0x7f8fdc145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.792 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fe0a7f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8fdc14e930 0x7f8fdc145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.793 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fe0a7f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc14d300 con 0x7f8fdc0babc0 2023-07-19T20:45:21.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fe0a7f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc148030 con 0x7f8fdc0ba7f0 2023-07-19T20:45:21.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fe0a7f700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc141b00 con 0x7f8fdc14e930 2023-07-19T20:45:21.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fd9d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fdc0babc0 0x7f8fdc145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fd9d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fdc0babc0 0x7f8fdc145220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38430/0 (socket says 172.21.15.117:38430) 2023-07-19T20:45:21.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fd9d9b700 1 -- 172.21.15.117:0/448357436 learned_addr learned my addr 172.21.15.117:0/448357436 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:21.794 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fda59c700 1 --2- 172.21.15.117:0/448357436 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fdc0ba7f0 0x7f8fdc14cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fdad9d700 1 --2- 172.21.15.117:0/448357436 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8fdc14e930 0x7f8fdc145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fd9d9b700 1 -- 172.21.15.117:0/448357436 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8fdc14e930 msgr2=0x7f8fdc145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fd9d9b700 1 --2- 172.21.15.117:0/448357436 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8fdc14e930 0x7f8fdc145760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fd9d9b700 1 -- 172.21.15.117:0/448357436 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fdc0ba7f0 msgr2=0x7f8fdc14cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fd9d9b700 1 --2- 172.21.15.117:0/448357436 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fdc0ba7f0 0x7f8fdc14cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fd9d9b700 1 -- 172.21.15.117:0/448357436 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd4009b30 con 0x7f8fdc0babc0 2023-07-19T20:45:21.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fd9d9b700 1 --2- 172.21.15.117:0/448357436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fdc0babc0 0x7f8fdc145220 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00e870 tx=0x7f8fcc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:21.795 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fcaffd700 1 -- 172.21.15.117:0/448357436 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc009590 con 0x7f8fdc0babc0 2023-07-19T20:45:21.796 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fcaffd700 1 -- 172.21.15.117:0/448357436 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc013680 con 0x7f8fdc0babc0 2023-07-19T20:45:21.796 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/448357436 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc1479e0 con 0x7f8fdc0babc0 2023-07-19T20:45:21.796 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fcaffd700 1 -- 172.21.15.117:0/448357436 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0139f0 con 0x7f8fdc0babc0 2023-07-19T20:45:21.796 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.787+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/448357436 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc141790 con 0x7f8fdc0babc0 2023-07-19T20:45:21.797 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.788+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/448357436 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fdc0ba0c0 con 0x7f8fdc0babc0 2023-07-19T20:45:21.797 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.789+0000 7f8fcaffd700 1 -- 172.21.15.117:0/448357436 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f8fcc013b50 con 0x7f8fdc0babc0 2023-07-19T20:45:21.797 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.789+0000 7f8fcaffd700 1 --2- 172.21.15.117:0/448357436 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f8fbc06a660 0x7f8fbc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:21.798 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.789+0000 7f8fcaffd700 1 -- 172.21.15.117:0/448357436 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8fcc0884c0 con 0x7f8fdc0babc0 2023-07-19T20:45:21.798 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.789+0000 7f8fda59c700 1 --2- 172.21.15.117:0/448357436 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f8fbc06a660 0x7f8fbc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:21.798 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.789+0000 7f8fda59c700 1 --2- 172.21.15.117:0/448357436 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f8fbc06a660 0x7f8fbc06cb10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0007fd0 tx=0x7f8fd0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:21.798 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.793+0000 7f8fcaffd700 1 -- 172.21.15.117:0/448357436 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f8fcc057730 con 0x7f8fdc0babc0 2023-07-19T20:45:21.972 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.979+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/448357436 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fdc145090 con 0x7f8fdc0babc0 2023-07-19T20:45:21.973 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.979+0000 7f8fcaffd700 1 -- 172.21.15.117:0/448357436 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fcc0572c0 con 0x7f8fdc0babc0 2023-07-19T20:45:21.973 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2023-07-19T20:45:21.975 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.981+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/448357436 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f8fbc06a660 msgr2=0x7f8fbc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.975 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.981+0000 7f8fe0a7f700 1 --2- 172.21.15.117:0/448357436 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f8fbc06a660 0x7f8fbc06cb10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0007fd0 tx=0x7f8fd0009040 comp rx=0 tx=0).stop 2023-07-19T20:45:21.975 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.981+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/448357436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fdc0babc0 msgr2=0x7f8fdc145220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:21.975 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.981+0000 7f8fe0a7f700 1 --2- 172.21.15.117:0/448357436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fdc0babc0 0x7f8fdc145220 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00e870 tx=0x7f8fcc00eb80 comp rx=0 tx=0).stop 2023-07-19T20:45:21.976 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.981+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/448357436 shutdown_connections 2023-07-19T20:45:21.976 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.981+0000 7f8fe0a7f700 1 --2- 172.21.15.117:0/448357436 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f8fbc06a660 0x7f8fbc06cb10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.976 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.981+0000 7f8fe0a7f700 1 --2- 172.21.15.117:0/448357436 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8fdc14e930 0x7f8fdc145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.976 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.981+0000 7f8fe0a7f700 1 --2- 172.21.15.117:0/448357436 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fdc0ba7f0 0x7f8fdc14cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.976 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.981+0000 7f8fe0a7f700 1 --2- 172.21.15.117:0/448357436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fdc0babc0 0x7f8fdc145220 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:21.976 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.981+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/448357436 >> 172.21.15.117:0/448357436 conn(0x7f8fdc071c90 msgr2=0x7f8fdc0bee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:21.976 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.982+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/448357436 shutdown_connections 2023-07-19T20:45:21.977 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:21.982+0000 7f8fe0a7f700 1 -- 172.21.15.117:0/448357436 wait complete. 2023-07-19T20:45:21.987 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-19T20:45:22.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.114+0000 7f89ced67700 1 Processor -- start 2023-07-19T20:45:22.115 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.114+0000 7f89ced67700 1 -- start start 2023-07-19T20:45:22.115 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89ced67700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f89c81417f0 0x7f89c80b88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:22.115 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89ced67700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f89c80b5300 0x7f89c8147710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:22.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89ced67700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f89c80bd360 0x7f89c8147c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:22.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89ced67700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c8072620 con 0x7f89c80b5300 2023-07-19T20:45:22.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89ced67700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c80b6390 con 0x7f89c81417f0 2023-07-19T20:45:22.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89ced67700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c8141bc0 con 0x7f89c80bd360 2023-07-19T20:45:22.117 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89c7fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f89c80b5300 0x7f89c8147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:22.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89c7fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f89c80b5300 0x7f89c8147710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38438/0 (socket says 172.21.15.117:38438) 2023-07-19T20:45:22.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89c7fff700 1 -- 172.21.15.117:0/407959617 learned_addr learned my addr 172.21.15.117:0/407959617 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:22.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89cd304700 1 --2- 172.21.15.117:0/407959617 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f89c80bd360 0x7f89c8147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:22.119 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89ccb03700 1 --2- 172.21.15.117:0/407959617 >> v2:172.21.15.124:3300/0 conn(0x7f89c81417f0 0x7f89c80b88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:22.119 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89c7fff700 1 -- 172.21.15.117:0/407959617 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f89c80bd360 msgr2=0x7f89c8147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:22.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89c7fff700 1 --2- 172.21.15.117:0/407959617 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f89c80bd360 0x7f89c8147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89c7fff700 1 -- 172.21.15.117:0/407959617 >> v2:172.21.15.124:3300/0 conn(0x7f89c81417f0 msgr2=0x7f89c80b88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:22.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89c7fff700 1 --2- 172.21.15.117:0/407959617 >> v2:172.21.15.124:3300/0 conn(0x7f89c81417f0 0x7f89c80b88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89c7fff700 1 -- 172.21.15.117:0/407959617 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c8072b00 con 0x7f89c80b5300 2023-07-19T20:45:22.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.115+0000 7f89cd304700 1 --2- 172.21.15.117:0/407959617 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f89c80bd360 0x7f89c8147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:22.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.116+0000 7f89c7fff700 1 --2- 172.21.15.117:0/407959617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c80b5300 0x7f89c8147710 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f89c806ea30 tx=0x7f89b400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92705005cd96e58 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:22.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.116+0000 7f89c77fe700 1 -- 172.21.15.117:0/407959617 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b400dc70 con 0x7f89c80b5300 2023-07-19T20:45:22.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.116+0000 7f89c77fe700 1 -- 172.21.15.117:0/407959617 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b400ddd0 con 0x7f89c80b5300 2023-07-19T20:45:22.122 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.116+0000 7f89c77fe700 1 -- 172.21.15.117:0/407959617 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4010690 con 0x7f89c80b5300 2023-07-19T20:45:22.122 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.116+0000 7f89ced67700 1 -- 172.21.15.117:0/407959617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c80b5300 msgr2=0x7f89c8147710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:22.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.116+0000 7f89ced67700 1 --2- 172.21.15.117:0/407959617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c80b5300 0x7f89c8147710 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f89c806ea30 tx=0x7f89b400be70 comp rx=0 tx=0).stop 2023-07-19T20:45:22.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.116+0000 7f89ced67700 1 -- 172.21.15.117:0/407959617 shutdown_connections 2023-07-19T20:45:22.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.116+0000 7f89ced67700 1 --2- 172.21.15.117:0/407959617 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f89c80bd360 0x7f89c8147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.116+0000 7f89ced67700 1 --2- 172.21.15.117:0/407959617 >> v2:172.21.15.124:3300/0 conn(0x7f89c81417f0 0x7f89c80b88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.116+0000 7f89ced67700 1 --2- 172.21.15.117:0/407959617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c80b5300 0x7f89c8147710 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.116+0000 7f89ced67700 1 -- 172.21.15.117:0/407959617 >> 172.21.15.117:0/407959617 conn(0x7f89c806b1f0 msgr2=0x7f89c80bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:22.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.116+0000 7f89ced67700 1 -- 172.21.15.117:0/407959617 shutdown_connections 2023-07-19T20:45:22.125 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.116+0000 7f89ced67700 1 -- 172.21.15.117:0/407959617 wait complete. 2023-07-19T20:45:22.125 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.117+0000 7f89ced67700 1 Processor -- start 2023-07-19T20:45:22.125 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.117+0000 7f89ced67700 1 -- start start 2023-07-19T20:45:22.125 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89ced67700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f89c80b5300 0x7f89c81d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:22.126 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89ced67700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89c80bd360 0x7f89c81e31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:22.126 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89ced67700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c81417f0 0x7f89c81456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:22.126 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89ced67700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c81d2140 con 0x7f89c81417f0 2023-07-19T20:45:22.126 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89ced67700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c813c0e0 con 0x7f89c80bd360 2023-07-19T20:45:22.126 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89ced67700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c813da80 con 0x7f89c80b5300 2023-07-19T20:45:22.127 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89cd304700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c81417f0 0x7f89c81456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:22.127 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89cd304700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c81417f0 0x7f89c81456e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38440/0 (socket says 172.21.15.117:38440) 2023-07-19T20:45:22.127 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89cd304700 1 -- 172.21.15.117:0/176781722 learned_addr learned my addr 172.21.15.117:0/176781722 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:22.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89c7fff700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89c80bd360 0x7f89c81e31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:22.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89ccb03700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f89c80b5300 0x7f89c81d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:22.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89cd304700 1 -- 172.21.15.117:0/176781722 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f89c80b5300 msgr2=0x7f89c81d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:22.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89cd304700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f89c80b5300 0x7f89c81d1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89cd304700 1 -- 172.21.15.117:0/176781722 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89c80bd360 msgr2=0x7f89c81e31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:22.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89cd304700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89c80bd360 0x7f89c81e31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89cd304700 1 -- 172.21.15.117:0/176781722 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b400b7f0 con 0x7f89c81417f0 2023-07-19T20:45:22.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89c7fff700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89c80bd360 0x7f89c81e31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:22.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.118+0000 7f89ccb03700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f89c80b5300 0x7f89c81d1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:22.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.119+0000 7f89cd304700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c81417f0 0x7f89c81456e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f89c0007ef0 tx=0x7f89c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:22.130 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.119+0000 7f89c57fa700 1 -- 172.21.15.117:0/176781722 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000de60 con 0x7f89c81417f0 2023-07-19T20:45:22.130 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.119+0000 7f89c57fa700 1 -- 172.21.15.117:0/176781722 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c000f040 con 0x7f89c81417f0 2023-07-19T20:45:22.130 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.119+0000 7f89c57fa700 1 -- 172.21.15.117:0/176781722 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0015640 con 0x7f89c81417f0 2023-07-19T20:45:22.130 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.119+0000 7f89ced67700 1 -- 172.21.15.117:0/176781722 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c813be60 con 0x7f89c81417f0 2023-07-19T20:45:22.130 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.119+0000 7f89ced67700 1 -- 172.21.15.117:0/176781722 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c813df10 con 0x7f89c81417f0 2023-07-19T20:45:22.130 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.120+0000 7f89ced67700 1 -- 172.21.15.117:0/176781722 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c80b5a20 con 0x7f89c81417f0 2023-07-19T20:45:22.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.121+0000 7f89c57fa700 1 -- 172.21.15.117:0/176781722 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f89c001e3b0 con 0x7f89c81417f0 2023-07-19T20:45:22.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.121+0000 7f89c57fa700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f89ac06a660 0x7f89ac06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:22.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.121+0000 7f89c57fa700 1 -- 172.21.15.117:0/176781722 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f89c0088850 con 0x7f89c81417f0 2023-07-19T20:45:22.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.121+0000 7f89ccb03700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f89ac06a660 0x7f89ac06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:22.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.121+0000 7f89ccb03700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f89ac06a660 0x7f89ac06cb10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009a40 tx=0x7f89bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:22.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.125+0000 7f89c57fa700 1 -- 172.21.15.117:0/176781722 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f89c0054030 con 0x7f89c81417f0 2023-07-19T20:45:22.307 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.314+0000 7f89ced67700 1 -- 172.21.15.117:0/176781722 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f89c813dbf0 con 0x7f89c81417f0 2023-07-19T20:45:22.308 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.315+0000 7f89c57fa700 1 -- 172.21.15.117:0/176781722 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+126 (secure 0 0 0) 0x7f89c001a090 con 0x7f89c81417f0 2023-07-19T20:45:22.308 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:22.309 INFO:teuthology.orchestra.run.smithi117.stdout:[ 2023-07-19T20:45:22.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:22.309 INFO:teuthology.orchestra.run.smithi117.stdout: "poolnum": 1, 2023-07-19T20:45:22.309 INFO:teuthology.orchestra.run.smithi117.stdout: "poolname": "rbd" 2023-07-19T20:45:22.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-07-19T20:45:22.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-07-19T20:45:22.310 INFO:teuthology.orchestra.run.smithi117.stdout: "poolnum": 2, 2023-07-19T20:45:22.310 INFO:teuthology.orchestra.run.smithi117.stdout: "poolname": ".mgr" 2023-07-19T20:45:22.310 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-07-19T20:45:22.310 INFO:teuthology.orchestra.run.smithi117.stdout:] 2023-07-19T20:45:22.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.316+0000 7f89ced67700 1 -- 172.21.15.117:0/176781722 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f89ac06a660 msgr2=0x7f89ac06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:22.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.316+0000 7f89ced67700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f89ac06a660 0x7f89ac06cb10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009a40 tx=0x7f89bc008040 comp rx=0 tx=0).stop 2023-07-19T20:45:22.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.316+0000 7f89ced67700 1 -- 172.21.15.117:0/176781722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c81417f0 msgr2=0x7f89c81456e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:22.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.316+0000 7f89ced67700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c81417f0 0x7f89c81456e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f89c0007ef0 tx=0x7f89c000d3b0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.317+0000 7f89ced67700 1 -- 172.21.15.117:0/176781722 shutdown_connections 2023-07-19T20:45:22.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.317+0000 7f89ced67700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f89ac06a660 0x7f89ac06cb10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.317+0000 7f89ced67700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c81417f0 0x7f89c81456e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.317+0000 7f89ced67700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f89c80b5300 0x7f89c81d1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.317+0000 7f89ced67700 1 --2- 172.21.15.117:0/176781722 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89c80bd360 0x7f89c81e31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.317+0000 7f89ced67700 1 -- 172.21.15.117:0/176781722 >> 172.21.15.117:0/176781722 conn(0x7f89c806b1f0 msgr2=0x7f89c80bbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:22.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.317+0000 7f89ced67700 1 -- 172.21.15.117:0/176781722 shutdown_connections 2023-07-19T20:45:22.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.317+0000 7f89ced67700 1 -- 172.21.15.117:0/176781722 wait complete. 2023-07-19T20:45:22.322 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-19T20:45:22.323 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-19T20:45:22.448 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.454+0000 7fdcab101700 1 Processor -- start 2023-07-19T20:45:22.448 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.454+0000 7fdcab101700 1 -- start start 2023-07-19T20:45:22.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.455+0000 7fdcab101700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdca40c0300 0x7fdca414ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:22.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.455+0000 7fdcab101700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca4148640 con 0x7fdca40beaf0 2023-07-19T20:45:22.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.455+0000 7fdcab101700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca408b2c0 con 0x7fdca40c06d0 2023-07-19T20:45:22.453 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.455+0000 7fdcab101700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca406b4a0 con 0x7fdca40c0300 2023-07-19T20:45:22.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.455+0000 7fdca3fff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fdca40beaf0 0x7fdca406a680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:43144/0 (socket says 172.21.15.117:43144) 2023-07-19T20:45:22.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.455+0000 7fdca3fff700 1 -- 172.21.15.117:0/3271516032 learned_addr learned my addr 172.21.15.117:0/3271516032 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:22.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.455+0000 7fdca8e9d700 1 --2- 172.21.15.117:0/3271516032 >> v2:172.21.15.124:3300/0 conn(0x7fdca40c0300 0x7fdca414ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:22.454 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.455+0000 7fdca37fe700 1 -- 172.21.15.117:0/3271516032 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551822336 0 0) 0x7fdca4148640 con 0x7fdca40beaf0 2023-07-19T20:45:22.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.455+0000 7fdca37fe700 1 -- 172.21.15.117:0/3271516032 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc940035b0 con 0x7fdca40beaf0 2023-07-19T20:45:22.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.455+0000 7fdca8e9d700 1 -- 172.21.15.117:0/3271516032 >> v1:172.21.15.124:6789/0 conn(0x7fdca40c06d0 legacy=0x7fdca406ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:22.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.455+0000 7fdca8e9d700 1 -- 172.21.15.117:0/3271516032 >> v1:172.21.15.117:6789/0 conn(0x7fdca40beaf0 legacy=0x7fdca406a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:22.455 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.455+0000 7fdca37fe700 1 -- 172.21.15.117:0/3271516032 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3874464192 0 0) 0x7fdc940035b0 con 0x7fdca40beaf0 2023-07-19T20:45:22.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.455+0000 7fdca8e9d700 1 -- 172.21.15.117:0/3271516032 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca40bf010 con 0x7fdca40c0300 2023-07-19T20:45:22.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.456+0000 7fdca8e9d700 1 --2- 172.21.15.117:0/3271516032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdca40c0300 0x7fdca414ec00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009840 tx=0x7fdc98009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa19383eb31651e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:22.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.456+0000 7fdca37fe700 1 -- 172.21.15.117:0/3271516032 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90001670 con 0x7fdca40c0300 2023-07-19T20:45:22.456 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.456+0000 7fdca37fe700 1 -- 172.21.15.117:0/3271516032 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc98004030 con 0x7fdca40c0300 2023-07-19T20:45:22.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.456+0000 7fdca37fe700 1 -- 172.21.15.117:0/3271516032 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980043a0 con 0x7fdca40c0300 2023-07-19T20:45:22.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.456+0000 7fdcab101700 1 -- 172.21.15.117:0/3271516032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdca40c0300 msgr2=0x7fdca414ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:22.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.456+0000 7fdcab101700 1 --2- 172.21.15.117:0/3271516032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdca40c0300 0x7fdca414ec00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009840 tx=0x7fdc98009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:22.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.456+0000 7fdcab101700 1 -- 172.21.15.117:0/3271516032 shutdown_connections 2023-07-19T20:45:22.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.456+0000 7fdcab101700 1 --2- 172.21.15.117:0/3271516032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdca40c0300 0x7fdca414ec00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.456+0000 7fdcab101700 1 -- 172.21.15.117:0/3271516032 >> 172.21.15.117:0/3271516032 conn(0x7fdca40a2800 msgr2=0x7fdca40a2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:22.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.456+0000 7fdcab101700 1 -- 172.21.15.117:0/3271516032 shutdown_connections 2023-07-19T20:45:22.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.456+0000 7fdcab101700 1 -- 172.21.15.117:0/3271516032 wait complete. 2023-07-19T20:45:22.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.457+0000 7fdcab101700 1 Processor -- start 2023-07-19T20:45:22.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.457+0000 7fdcab101700 1 -- start start 2023-07-19T20:45:22.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.458+0000 7fdcab101700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdca40beaf0 0x7fdca41e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:22.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.458+0000 7fdcab101700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca40c0300 0x7fdca40a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:22.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.458+0000 7fdcab101700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdca40c06d0 0x7fdca40a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:22.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.458+0000 7fdcab101700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40a52c0 con 0x7fdca40c0300 2023-07-19T20:45:22.460 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.458+0000 7fdcab101700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40b8020 con 0x7fdca40c06d0 2023-07-19T20:45:22.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.458+0000 7fdcab101700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40a4c90 con 0x7fdca40beaf0 2023-07-19T20:45:22.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.458+0000 7fdca3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca40c0300 0x7fdca40a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:22.461 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.458+0000 7fdca3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca40c0300 0x7fdca40a56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47322/0 (socket says 172.21.15.117:47322) 2023-07-19T20:45:22.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.458+0000 7fdca3fff700 1 -- 172.21.15.117:0/244637239 learned_addr learned my addr 172.21.15.117:0/244637239 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:22.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.458+0000 7fdca969e700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdca40c06d0 0x7fdca40a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:22.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.458+0000 7fdca8e9d700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdca40beaf0 0x7fdca41e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:22.462 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.459+0000 7fdca3fff700 1 -- 172.21.15.117:0/244637239 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdca40beaf0 msgr2=0x7fdca41e3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:22.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.459+0000 7fdca3fff700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdca40beaf0 0x7fdca41e3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.463 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.459+0000 7fdca3fff700 1 -- 172.21.15.117:0/244637239 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdca40c06d0 msgr2=0x7fdca40a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:22.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.459+0000 7fdca3fff700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdca40c06d0 0x7fdca40a5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.459+0000 7fdca3fff700 1 -- 172.21.15.117:0/244637239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc980094a0 con 0x7fdca40c0300 2023-07-19T20:45:22.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.459+0000 7fdca969e700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdca40c06d0 0x7fdca40a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:22.464 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.459+0000 7fdca3fff700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca40c0300 0x7fdca40a56e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000c730 tx=0x7fdc9000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:22.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.459+0000 7fdca17fa700 1 -- 172.21.15.117:0/244637239 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90007560 con 0x7fdca40c0300 2023-07-19T20:45:22.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.459+0000 7fdca17fa700 1 -- 172.21.15.117:0/244637239 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc900076c0 con 0x7fdca40c0300 2023-07-19T20:45:22.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.459+0000 7fdcab101700 1 -- 172.21.15.117:0/244637239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca40b8d00 con 0x7fdca40c0300 2023-07-19T20:45:22.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.459+0000 7fdca17fa700 1 -- 172.21.15.117:0/244637239 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90004ab0 con 0x7fdca40c0300 2023-07-19T20:45:22.465 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.459+0000 7fdcab101700 1 -- 172.21.15.117:0/244637239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca40a4ee0 con 0x7fdca40c0300 2023-07-19T20:45:22.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.460+0000 7fdcab101700 1 -- 172.21.15.117:0/244637239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca40a5400 con 0x7fdca40c0300 2023-07-19T20:45:22.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.461+0000 7fdca17fa700 1 -- 172.21.15.117:0/244637239 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fdc90004c10 con 0x7fdca40c0300 2023-07-19T20:45:22.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.461+0000 7fdca17fa700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdc8806a660 0x7fdc8806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:22.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.461+0000 7fdca17fa700 1 -- 172.21.15.117:0/244637239 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdc900889e0 con 0x7fdca40c0300 2023-07-19T20:45:22.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.461+0000 7fdca8e9d700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdc8806a660 0x7fdc8806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:22.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.461+0000 7fdca8e9d700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdc8806a660 0x7fdc8806cb10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdc980090b0 tx=0x7fdc98008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:22.469 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.465+0000 7fdca17fa700 1 -- 172.21.15.117:0/244637239 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fdc900542a0 con 0x7fdca40c0300 2023-07-19T20:45:22.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.650+0000 7fdcab101700 1 -- 172.21.15.117:0/244637239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdca40a5400 con 0x7fdca40c0300 2023-07-19T20:45:22.977 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.983+0000 7fdca17fa700 1 -- 172.21.15.117:0/244637239 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdca40a5400 con 0x7fdca40c0300 2023-07-19T20:45:22.981 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.987+0000 7fdcab101700 1 -- 172.21.15.117:0/244637239 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdc8806a660 msgr2=0x7fdc8806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:22.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.987+0000 7fdcab101700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdc8806a660 0x7fdc8806cb10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdc980090b0 tx=0x7fdc98008030 comp rx=0 tx=0).stop 2023-07-19T20:45:22.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.987+0000 7fdcab101700 1 -- 172.21.15.117:0/244637239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca40c0300 msgr2=0x7fdca40a56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:22.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.987+0000 7fdcab101700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca40c0300 0x7fdca40a56e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000c730 tx=0x7fdc9000caf0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.982 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.987+0000 7fdcab101700 1 -- 172.21.15.117:0/244637239 shutdown_connections 2023-07-19T20:45:22.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.987+0000 7fdcab101700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fdc8806a660 0x7fdc8806cb10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.987+0000 7fdcab101700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdca40c06d0 0x7fdca40a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.987+0000 7fdcab101700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdca40beaf0 0x7fdca41e3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.983 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.987+0000 7fdcab101700 1 --2- 172.21.15.117:0/244637239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca40c0300 0x7fdca40a56e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:22.984 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.987+0000 7fdcab101700 1 -- 172.21.15.117:0/244637239 >> 172.21.15.117:0/244637239 conn(0x7fdca40a2800 msgr2=0x7fdca4147d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:22.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.988+0000 7fdcab101700 1 -- 172.21.15.117:0/244637239 shutdown_connections 2023-07-19T20:45:22.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:22.988+0000 7fdcab101700 1 -- 172.21.15.117:0/244637239 wait complete. 2023-07-19T20:45:22.986 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_metadata' created 2023-07-19T20:45:22.995 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-19T20:45:23.126 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.132+0000 7f7e7436c700 1 Processor -- start 2023-07-19T20:45:23.126 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.132+0000 7f7e7436c700 1 -- start start 2023-07-19T20:45:23.127 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.133+0000 7f7e7436c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7e6c09fc80 0x7f7e6c14a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:23.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.133+0000 7f7e7436c700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e6c0bc5b0 con 0x7f7e6c0a0050 2023-07-19T20:45:23.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.133+0000 7f7e7436c700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e6c14df30 con 0x7f7e6c14ea10 2023-07-19T20:45:23.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.133+0000 7f7e7436c700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6c0bcad0 con 0x7f7e6c09fc80 2023-07-19T20:45:23.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.133+0000 7f7e72909700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7e6c0a0050 0x7f7e6c0b9620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:43156/0 (socket says 172.21.15.117:43156) 2023-07-19T20:45:23.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.133+0000 7f7e72909700 1 -- 172.21.15.117:0/2709286971 learned_addr learned my addr 172.21.15.117:0/2709286971 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:23.128 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.134+0000 7f7e72108700 1 --2- 172.21.15.117:0/2709286971 >> v2:172.21.15.124:3300/0 conn(0x7f7e6c09fc80 0x7f7e6c14a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:23.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.134+0000 7f7e71106700 1 -- 172.21.15.117:0/2709286971 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215703029 0 0) 0x7f7e6c0bc5b0 con 0x7f7e6c0a0050 2023-07-19T20:45:23.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.134+0000 7f7e71106700 1 -- 172.21.15.117:0/2709286971 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e580035b0 con 0x7f7e6c0a0050 2023-07-19T20:45:23.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.134+0000 7f7e72108700 1 -- 172.21.15.117:0/2709286971 >> v1:172.21.15.124:6789/0 conn(0x7f7e6c14ea10 legacy=0x7f7e6c0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:23.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.134+0000 7f7e72108700 1 -- 172.21.15.117:0/2709286971 >> v1:172.21.15.117:6789/0 conn(0x7f7e6c0a0050 legacy=0x7f7e6c0b9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:23.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.134+0000 7f7e72108700 1 -- 172.21.15.117:0/2709286971 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c14e210 con 0x7f7e6c09fc80 2023-07-19T20:45:23.130 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.134+0000 7f7e72108700 1 --2- 172.21.15.117:0/2709286971 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e6c09fc80 0x7f7e6c14a8c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009840 tx=0x7f7e5c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=702e49ce9d27bc81 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:23.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.134+0000 7f7e71106700 1 -- 172.21.15.117:0/2709286971 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c011830 con 0x7f7e6c09fc80 2023-07-19T20:45:23.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.134+0000 7f7e71106700 1 -- 172.21.15.117:0/2709286971 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c011990 con 0x7f7e6c09fc80 2023-07-19T20:45:23.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.134+0000 7f7e71106700 1 -- 172.21.15.117:0/2709286971 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c011d20 con 0x7f7e6c09fc80 2023-07-19T20:45:23.135 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.135+0000 7f7e7436c700 1 -- 172.21.15.117:0/2709286971 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e6c09fc80 msgr2=0x7f7e6c14a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:23.135 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.135+0000 7f7e7436c700 1 --2- 172.21.15.117:0/2709286971 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e6c09fc80 0x7f7e6c14a8c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009840 tx=0x7f7e5c009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:23.135 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.135+0000 7f7e7436c700 1 -- 172.21.15.117:0/2709286971 shutdown_connections 2023-07-19T20:45:23.135 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.135+0000 7f7e7436c700 1 --2- 172.21.15.117:0/2709286971 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e6c09fc80 0x7f7e6c14a8c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:23.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.135+0000 7f7e7436c700 1 -- 172.21.15.117:0/2709286971 >> 172.21.15.117:0/2709286971 conn(0x7f7e6c06c2c0 msgr2=0x7f7e6c09f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:23.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.135+0000 7f7e7436c700 1 -- 172.21.15.117:0/2709286971 shutdown_connections 2023-07-19T20:45:23.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.135+0000 7f7e7436c700 1 -- 172.21.15.117:0/2709286971 wait complete. 2023-07-19T20:45:23.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.136+0000 7f7e7436c700 1 Processor -- start 2023-07-19T20:45:23.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.136+0000 7f7e7436c700 1 -- start start 2023-07-19T20:45:23.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e7436c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e6c09fc80 0x7f7e6c0bdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:23.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e7436c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e6c0a0050 0x7f7e6c14d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:23.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e7436c700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e6c14ea10 0x7f7e6c144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:23.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e7436c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c0be0f0 con 0x7f7e6c09fc80 2023-07-19T20:45:23.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e7436c700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c0be7d0 con 0x7f7e6c0a0050 2023-07-19T20:45:23.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e7436c700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c0be580 con 0x7f7e6c14ea10 2023-07-19T20:45:23.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e72108700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e6c09fc80 0x7f7e6c0bdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:23.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e72108700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e6c09fc80 0x7f7e6c0bdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47324/0 (socket says 172.21.15.117:47324) 2023-07-19T20:45:23.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e72108700 1 -- 172.21.15.117:0/1328947396 learned_addr learned my addr 172.21.15.117:0/1328947396 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:23.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e71907700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e6c0a0050 0x7f7e6c14d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:23.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e72909700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e6c14ea10 0x7f7e6c144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:23.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e72108700 1 -- 172.21.15.117:0/1328947396 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e6c14ea10 msgr2=0x7f7e6c144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:23.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e72108700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e6c14ea10 0x7f7e6c144010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:23.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e72108700 1 -- 172.21.15.117:0/1328947396 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e6c0a0050 msgr2=0x7f7e6c14d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:23.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e72108700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e6c0a0050 0x7f7e6c14d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:23.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e72108700 1 -- 172.21.15.117:0/1328947396 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c0094a0 con 0x7f7e6c09fc80 2023-07-19T20:45:23.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e72909700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e6c14ea10 0x7f7e6c144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:23.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e72108700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e6c09fc80 0x7f7e6c0bdbb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009fd0 tx=0x7f7e5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:23.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e62ffd700 1 -- 172.21.15.117:0/1328947396 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0036a0 con 0x7f7e6c09fc80 2023-07-19T20:45:23.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e62ffd700 1 -- 172.21.15.117:0/1328947396 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c01e070 con 0x7f7e6c09fc80 2023-07-19T20:45:23.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e7436c700 1 -- 172.21.15.117:0/1328947396 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6c1490c0 con 0x7f7e6c09fc80 2023-07-19T20:45:23.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e62ffd700 1 -- 172.21.15.117:0/1328947396 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c003a40 con 0x7f7e6c09fc80 2023-07-19T20:45:23.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.137+0000 7f7e7436c700 1 -- 172.21.15.117:0/1328947396 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6c14cac0 con 0x7f7e6c09fc80 2023-07-19T20:45:23.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.138+0000 7f7e7436c700 1 -- 172.21.15.117:0/1328947396 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6c14c680 con 0x7f7e6c09fc80 2023-07-19T20:45:23.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.139+0000 7f7e62ffd700 1 -- 172.21.15.117:0/1328947396 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f7e5c003ba0 con 0x7f7e6c09fc80 2023-07-19T20:45:23.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.139+0000 7f7e62ffd700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7e5006a660 0x7f7e5006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:23.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.139+0000 7f7e71907700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7e5006a660 0x7f7e5006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:23.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.139+0000 7f7e62ffd700 1 -- 172.21.15.117:0/1328947396 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f7e5c089950 con 0x7f7e6c09fc80 2023-07-19T20:45:23.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.140+0000 7f7e71907700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7e5006a660 0x7f7e5006cb10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c1e4d00 tx=0x7f7e68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:23.141 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.144+0000 7f7e62ffd700 1 -- 172.21.15.117:0/1328947396 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7e6c14c680 con 0x7f7e6c09fc80 2023-07-19T20:45:23.328 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.330+0000 7f7e7436c700 1 -- 172.21.15.117:0/1328947396 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7e6c14c680 con 0x7f7e6c09fc80 2023-07-19T20:45:23.980 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.986+0000 7f7e62ffd700 1 -- 172.21.15.117:0/1328947396 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7e6c14c680 con 0x7f7e6c09fc80 2023-07-19T20:45:23.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.991+0000 7f7e7436c700 1 -- 172.21.15.117:0/1328947396 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7e5006a660 msgr2=0x7f7e5006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:23.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.991+0000 7f7e7436c700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7e5006a660 0x7f7e5006cb10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c1e4d00 tx=0x7f7e68009040 comp rx=0 tx=0).stop 2023-07-19T20:45:23.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.991+0000 7f7e7436c700 1 -- 172.21.15.117:0/1328947396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e6c09fc80 msgr2=0x7f7e6c0bdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:23.985 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.991+0000 7f7e7436c700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e6c09fc80 0x7f7e6c0bdbb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009fd0 tx=0x7f7e5c004750 comp rx=0 tx=0).stop 2023-07-19T20:45:23.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.992+0000 7f7e7436c700 1 -- 172.21.15.117:0/1328947396 shutdown_connections 2023-07-19T20:45:23.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.992+0000 7f7e7436c700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7e5006a660 0x7f7e5006cb10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:23.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.992+0000 7f7e7436c700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e6c14ea10 0x7f7e6c144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:23.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.992+0000 7f7e7436c700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e6c09fc80 0x7f7e6c0bdbb0 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009fd0 tx=0x7f7e5c004750 comp rx=0 tx=0).stop 2023-07-19T20:45:23.986 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.992+0000 7f7e7436c700 1 --2- 172.21.15.117:0/1328947396 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e6c0a0050 0x7f7e6c14d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:23.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.992+0000 7f7e7436c700 1 -- 172.21.15.117:0/1328947396 >> 172.21.15.117:0/1328947396 conn(0x7f7e6c06c2c0 msgr2=0x7f7e6c06cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:23.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.994+0000 7f7e7436c700 1 -- 172.21.15.117:0/1328947396 shutdown_connections 2023-07-19T20:45:23.987 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:23.994+0000 7f7e7436c700 1 -- 172.21.15.117:0/1328947396 wait complete. 2023-07-19T20:45:23.989 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_data' created 2023-07-19T20:45:24.009 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-19T20:45:24.134 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.140+0000 7f4166a34700 1 Processor -- start 2023-07-19T20:45:24.134 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.140+0000 7f4166a34700 1 -- start start 2023-07-19T20:45:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.141+0000 7f4166a34700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f41600bd1d0 0x7f4160072540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.141+0000 7f4166a34700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f416006d840 0x7f41600bb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.141+0000 7f4166a34700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416006cf40 con 0x7f41600bbc20 2023-07-19T20:45:24.137 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.141+0000 7f4166a34700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416006d360 con 0x7f416006d840 2023-07-19T20:45:24.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.141+0000 7f4166a34700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4160072a80 con 0x7f41600bd1d0 2023-07-19T20:45:24.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.141+0000 7f415f7fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f416006d840 0x7f41600bb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.141+0000 7f4164fd1700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f41600bbc20 0x7f416014b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:43158/0 (socket says 172.21.15.117:43158) 2023-07-19T20:45:24.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.141+0000 7f4164fd1700 1 -- 172.21.15.117:0/2572304551 learned_addr learned my addr 172.21.15.117:0/2572304551 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:24.138 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.141+0000 7f415ffff700 1 --2- 172.21.15.117:0/2572304551 >> v2:172.21.15.124:3300/0 conn(0x7f41600bd1d0 0x7f4160072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f415f7fe700 1 -- 172.21.15.117:0/2572304551 >> v2:172.21.15.124:3300/0 conn(0x7f41600bd1d0 msgr2=0x7f4160072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:24.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f415f7fe700 1 --2- 172.21.15.117:0/2572304551 >> v2:172.21.15.124:3300/0 conn(0x7f41600bd1d0 0x7f4160072540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f415f7fe700 1 -- 172.21.15.117:0/2572304551 >> v1:172.21.15.117:6789/0 conn(0x7f41600bbc20 legacy=0x7f416014b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f415f7fe700 1 -- 172.21.15.117:0/2572304551 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41600ba560 con 0x7f416006d840 2023-07-19T20:45:24.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f415ffff700 1 --2- 172.21.15.117:0/2572304551 >> v2:172.21.15.124:3300/0 conn(0x7f41600bd1d0 0x7f4160072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:24.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f415f7fe700 1 --2- 172.21.15.117:0/2572304551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f416006d840 0x7f41600bb6e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4154009840 tx=0x7f4154009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce6f31cc92df2ef server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:24.139 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f415effd700 1 -- 172.21.15.117:0/2572304551 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154011830 con 0x7f416006d840 2023-07-19T20:45:24.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f415effd700 1 -- 172.21.15.117:0/2572304551 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4154011990 con 0x7f416006d840 2023-07-19T20:45:24.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f415effd700 1 -- 172.21.15.117:0/2572304551 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154011d20 con 0x7f416006d840 2023-07-19T20:45:24.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f4166a34700 1 -- 172.21.15.117:0/2572304551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f416006d840 msgr2=0x7f41600bb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f4166a34700 1 --2- 172.21.15.117:0/2572304551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f416006d840 0x7f41600bb6e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4154009840 tx=0x7f4154009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:24.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f4166a34700 1 -- 172.21.15.117:0/2572304551 shutdown_connections 2023-07-19T20:45:24.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f4166a34700 1 --2- 172.21.15.117:0/2572304551 >> v2:172.21.15.124:3300/0 conn(0x7f41600bd1d0 0x7f4160072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f4166a34700 1 --2- 172.21.15.117:0/2572304551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f416006d840 0x7f41600bb6e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.140 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f4166a34700 1 -- 172.21.15.117:0/2572304551 >> 172.21.15.117:0/2572304551 conn(0x7f416009f570 msgr2=0x7f416009f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:24.141 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f4166a34700 1 -- 172.21.15.117:0/2572304551 shutdown_connections 2023-07-19T20:45:24.141 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.142+0000 7f4166a34700 1 -- 172.21.15.117:0/2572304551 wait complete. 2023-07-19T20:45:24.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.143+0000 7f4166a34700 1 Processor -- start 2023-07-19T20:45:24.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.144+0000 7f4166a34700 1 -- start start 2023-07-19T20:45:24.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.144+0000 7f4166a34700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f416006d840 0x7f416009bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.144+0000 7f4166a34700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41600bbc20 0x7f41601e0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.144+0000 7f4166a34700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41600bd1d0 0x7f41601e05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.144+0000 7f4166a34700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41601e0b00 con 0x7f416006d840 2023-07-19T20:45:24.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.144+0000 7f4166a34700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416013fcf0 con 0x7f41600bbc20 2023-07-19T20:45:24.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.144+0000 7f4166a34700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4160149c20 con 0x7f41600bd1d0 2023-07-19T20:45:24.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.144+0000 7f415ffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f416006d840 0x7f416009bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.144+0000 7f415ffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f416006d840 0x7f416009bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47328/0 (socket says 172.21.15.117:47328) 2023-07-19T20:45:24.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.144+0000 7f415ffff700 1 -- 172.21.15.117:0/1762479856 learned_addr learned my addr 172.21.15.117:0/1762479856 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:24.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.145+0000 7f415f7fe700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41600bbc20 0x7f41601e0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.145+0000 7f4164fd1700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41600bd1d0 0x7f41601e05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.145+0000 7f415ffff700 1 -- 172.21.15.117:0/1762479856 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41600bd1d0 msgr2=0x7f41601e05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.145+0000 7f415ffff700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41600bd1d0 0x7f41601e05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.145+0000 7f415ffff700 1 -- 172.21.15.117:0/1762479856 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41600bbc20 msgr2=0x7f41601e0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.145+0000 7f415ffff700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41600bbc20 0x7f41601e0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.145+0000 7f415ffff700 1 -- 172.21.15.117:0/1762479856 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41540094a0 con 0x7f416006d840 2023-07-19T20:45:24.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.145+0000 7f4164fd1700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41600bd1d0 0x7f41601e05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:24.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.145+0000 7f415ffff700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f416006d840 0x7f416009bd20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f415000e810 tx=0x7f415000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:24.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.145+0000 7f415cff9700 1 -- 172.21.15.117:0/1762479856 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000c020 con 0x7f416006d840 2023-07-19T20:45:24.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.145+0000 7f415cff9700 1 -- 172.21.15.117:0/1762479856 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4150004250 con 0x7f416006d840 2023-07-19T20:45:24.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.145+0000 7f4166a34700 1 -- 172.21.15.117:0/1762479856 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41601405b0 con 0x7f416006d840 2023-07-19T20:45:24.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.145+0000 7f415cff9700 1 -- 172.21.15.117:0/1762479856 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41500036a0 con 0x7f416006d840 2023-07-19T20:45:24.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.145+0000 7f4166a34700 1 -- 172.21.15.117:0/1762479856 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41601498b0 con 0x7f416006d840 2023-07-19T20:45:24.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.146+0000 7f4166a34700 1 -- 172.21.15.117:0/1762479856 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4160067940 con 0x7f416006d840 2023-07-19T20:45:24.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.146+0000 7f415cff9700 1 -- 172.21.15.117:0/1762479856 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f4150003800 con 0x7f416006d840 2023-07-19T20:45:24.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.147+0000 7f415cff9700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f414c06a660 0x7f414c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.147+0000 7f415f7fe700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f414c06a660 0x7f414c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.147+0000 7f415cff9700 1 -- 172.21.15.117:0/1762479856 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f4150088540 con 0x7f416006d840 2023-07-19T20:45:24.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.147+0000 7f415f7fe700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f414c06a660 0x7f414c06cb10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f41540090b0 tx=0x7f4154008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:24.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.152+0000 7f415cff9700 1 -- 172.21.15.117:0/1762479856 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f4150053a30 con 0x7f416006d840 2023-07-19T20:45:24.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.381+0000 7f4166a34700 1 -- 172.21.15.117:0/1762479856 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f41600b8260 con 0x7f416006d840 2023-07-19T20:45:24.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.387+0000 7f415cff9700 1 -- 172.21.15.117:0/1762479856 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4150057050 con 0x7f416006d840 2023-07-19T20:45:24.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.392+0000 7f4166a34700 1 -- 172.21.15.117:0/1762479856 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f414c06a660 msgr2=0x7f414c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.392+0000 7f4166a34700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f414c06a660 0x7f414c06cb10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f41540090b0 tx=0x7f4154008030 comp rx=0 tx=0).stop 2023-07-19T20:45:24.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.392+0000 7f4166a34700 1 -- 172.21.15.117:0/1762479856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f416006d840 msgr2=0x7f416009bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.386 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.392+0000 7f4166a34700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f416006d840 0x7f416009bd20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f415000e810 tx=0x7f415000eb20 comp rx=0 tx=0).stop 2023-07-19T20:45:24.387 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.393+0000 7f4166a34700 1 -- 172.21.15.117:0/1762479856 shutdown_connections 2023-07-19T20:45:24.387 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.393+0000 7f4166a34700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f414c06a660 0x7f414c06cb10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.387 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.393+0000 7f4166a34700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41600bd1d0 0x7f41601e05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.387 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.393+0000 7f4166a34700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f416006d840 0x7f416009bd20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.388 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.393+0000 7f4166a34700 1 --2- 172.21.15.117:0/1762479856 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41600bbc20 0x7f41601e0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.388 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.393+0000 7f4166a34700 1 -- 172.21.15.117:0/1762479856 >> 172.21.15.117:0/1762479856 conn(0x7f416009f570 msgr2=0x7f41600b8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:24.388 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.393+0000 7f4166a34700 1 -- 172.21.15.117:0/1762479856 shutdown_connections 2023-07-19T20:45:24.388 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.393+0000 7f4166a34700 1 -- 172.21.15.117:0/1762479856 wait complete. 2023-07-19T20:45:24.389 INFO:teuthology.orchestra.run.smithi117.stderr:new fs with metadata pool 5 and data pool 6 2023-07-19T20:45:24.407 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:45:24.527 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.534+0000 7fcd49ee0700 1 Processor -- start 2023-07-19T20:45:24.528 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.534+0000 7fcd49ee0700 1 -- start start 2023-07-19T20:45:24.531 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.534+0000 7fcd49ee0700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fcd440c1470 0x7fcd440b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.531 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.534+0000 7fcd49ee0700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcd4414a660 0x7fcd44155260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.532 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.534+0000 7fcd49ee0700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd440bcd00 con 0x7fcd440b9370 2023-07-19T20:45:24.532 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.534+0000 7fcd49ee0700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd440b8710 con 0x7fcd440c1470 2023-07-19T20:45:24.533 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.534+0000 7fcd49ee0700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440b8bd0 con 0x7fcd4414a660 2023-07-19T20:45:24.533 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd43fff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcd4414a660 0x7fcd44155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.533 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd437fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fcd440c1470 0x7fcd440b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.533 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd43fff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcd4414a660 0x7fcd44155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:39100/0 (socket says 172.21.15.117:39100) 2023-07-19T20:45:24.534 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd43fff700 1 -- 172.21.15.117:0/2206281224 learned_addr learned my addr 172.21.15.117:0/2206281224 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:24.534 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd42ffd700 1 --1- 172.21.15.117:0/2206281224 >> v1:172.21.15.124:6789/0 conn(0x7fcd440b9370 0x7fcd44149f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.117:45928/0 (socket says 172.21.15.117:45928) 2023-07-19T20:45:24.534 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd427fc700 1 -- 172.21.15.117:0/2206281224 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048352090 0 0) 0x7fcd440bcd00 con 0x7fcd440b9370 2023-07-19T20:45:24.535 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd427fc700 1 -- 172.21.15.117:0/2206281224 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd2c0035b0 con 0x7fcd440b9370 2023-07-19T20:45:24.535 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd43fff700 1 -- 172.21.15.117:0/2206281224 >> v2:172.21.15.124:3300/0 conn(0x7fcd440c1470 msgr2=0x7fcd440b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:24.535 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd43fff700 1 --2- 172.21.15.117:0/2206281224 >> v2:172.21.15.124:3300/0 conn(0x7fcd440c1470 0x7fcd440b8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.535 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd43fff700 1 -- 172.21.15.117:0/2206281224 >> v1:172.21.15.124:6789/0 conn(0x7fcd440b9370 legacy=0x7fcd44149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.536 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd43fff700 1 -- 172.21.15.117:0/2206281224 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd440bab50 con 0x7fcd4414a660 2023-07-19T20:45:24.537 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd437fe700 1 --2- 172.21.15.117:0/2206281224 >> v2:172.21.15.124:3300/0 conn(0x7fcd440c1470 0x7fcd440b8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:45:24.537 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd43fff700 1 --2- 172.21.15.117:0/2206281224 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcd4414a660 0x7fcd44155260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009e50 tx=0x7fcd3c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b8d20384e48a828 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:24.537 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd427fc700 1 -- 172.21.15.117:0/2206281224 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c00e070 con 0x7fcd4414a660 2023-07-19T20:45:24.537 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd427fc700 1 -- 172.21.15.117:0/2206281224 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c00b910 con 0x7fcd4414a660 2023-07-19T20:45:24.537 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.535+0000 7fcd427fc700 1 -- 172.21.15.117:0/2206281224 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c00bcc0 con 0x7fcd4414a660 2023-07-19T20:45:24.538 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.536+0000 7fcd49ee0700 1 -- 172.21.15.117:0/2206281224 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcd4414a660 msgr2=0x7fcd44155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.538 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.536+0000 7fcd49ee0700 1 --2- 172.21.15.117:0/2206281224 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcd4414a660 0x7fcd44155260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009e50 tx=0x7fcd3c00b330 comp rx=0 tx=0).stop 2023-07-19T20:45:24.538 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.536+0000 7fcd49ee0700 1 -- 172.21.15.117:0/2206281224 shutdown_connections 2023-07-19T20:45:24.538 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.536+0000 7fcd49ee0700 1 --2- 172.21.15.117:0/2206281224 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcd4414a660 0x7fcd44155260 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.539 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.536+0000 7fcd49ee0700 1 --2- 172.21.15.117:0/2206281224 >> v2:172.21.15.124:3300/0 conn(0x7fcd440c1470 0x7fcd440b8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.539 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.536+0000 7fcd49ee0700 1 -- 172.21.15.117:0/2206281224 >> 172.21.15.117:0/2206281224 conn(0x7fcd44072920 msgr2=0x7fcd440c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:24.539 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.536+0000 7fcd49ee0700 1 -- 172.21.15.117:0/2206281224 shutdown_connections 2023-07-19T20:45:24.539 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.536+0000 7fcd49ee0700 1 -- 172.21.15.117:0/2206281224 wait complete. 2023-07-19T20:45:24.539 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.537+0000 7fcd49ee0700 1 Processor -- start 2023-07-19T20:45:24.540 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.537+0000 7fcd49ee0700 1 -- start start 2023-07-19T20:45:24.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd49ee0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd440b9370 0x7fcd441d6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd49ee0700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd440c1470 0x7fcd441d42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd49ee0700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcd4414a660 0x7fcd441d4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd49ee0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd441d5360 con 0x7fcd440b9370 2023-07-19T20:45:24.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd49ee0700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd441d2f50 con 0x7fcd440c1470 2023-07-19T20:45:24.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd49ee0700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd441d7290 con 0x7fcd4414a660 2023-07-19T20:45:24.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd437fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd440b9370 0x7fcd441d6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd437fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd440b9370 0x7fcd441d6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47340/0 (socket says 172.21.15.117:47340) 2023-07-19T20:45:24.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd437fe700 1 -- 172.21.15.117:0/1673517783 learned_addr learned my addr 172.21.15.117:0/1673517783 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:24.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd42ffd700 1 --2- 172.21.15.117:0/1673517783 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd440c1470 0x7fcd441d42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd43fff700 1 --2- 172.21.15.117:0/1673517783 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcd4414a660 0x7fcd441d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd437fe700 1 -- 172.21.15.117:0/1673517783 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcd4414a660 msgr2=0x7fcd441d4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd437fe700 1 --2- 172.21.15.117:0/1673517783 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcd4414a660 0x7fcd441d4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd437fe700 1 -- 172.21.15.117:0/1673517783 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd440c1470 msgr2=0x7fcd441d42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd437fe700 1 --2- 172.21.15.117:0/1673517783 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd440c1470 0x7fcd441d42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.538+0000 7fcd437fe700 1 -- 172.21.15.117:0/1673517783 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd380094a0 con 0x7fcd440b9370 2023-07-19T20:45:24.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.539+0000 7fcd437fe700 1 --2- 172.21.15.117:0/1673517783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd440b9370 0x7fcd441d6750 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800ec10 tx=0x7fcd3800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:24.548 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.539+0000 7fcd2bfff700 1 -- 172.21.15.117:0/1673517783 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800c7f0 con 0x7fcd440b9370 2023-07-19T20:45:24.548 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.539+0000 7fcd2bfff700 1 -- 172.21.15.117:0/1673517783 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3800c950 con 0x7fcd440b9370 2023-07-19T20:45:24.548 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.539+0000 7fcd2bfff700 1 -- 172.21.15.117:0/1673517783 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800ccc0 con 0x7fcd440b9370 2023-07-19T20:45:24.548 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.539+0000 7fcd49ee0700 1 -- 172.21.15.117:0/1673517783 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3c009b30 con 0x7fcd440b9370 2023-07-19T20:45:24.548 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.539+0000 7fcd49ee0700 1 -- 172.21.15.117:0/1673517783 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd441d74e0 con 0x7fcd440b9370 2023-07-19T20:45:24.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.540+0000 7fcd49ee0700 1 -- 172.21.15.117:0/1673517783 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd44074890 con 0x7fcd440b9370 2023-07-19T20:45:24.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.540+0000 7fcd2bfff700 1 -- 172.21.15.117:0/1673517783 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fcd38013470 con 0x7fcd440b9370 2023-07-19T20:45:24.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.541+0000 7fcd2bfff700 1 --2- 172.21.15.117:0/1673517783 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcd3006a660 0x7fcd3006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.541+0000 7fcd42ffd700 1 --2- 172.21.15.117:0/1673517783 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcd3006a660 0x7fcd3006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.541+0000 7fcd2bfff700 1 -- 172.21.15.117:0/1673517783 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd38088b40 con 0x7fcd440b9370 2023-07-19T20:45:24.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.541+0000 7fcd42ffd700 1 --2- 172.21.15.117:0/1673517783 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcd3006a660 0x7fcd3006cb10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcd440b8f30 tx=0x7fcd34007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:24.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.545+0000 7fcd2bfff700 1 -- 172.21.15.117:0/1673517783 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fcd38053f40 con 0x7fcd440b9370 2023-07-19T20:45:24.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.733+0000 7fcd49ee0700 1 -- 172.21.15.117:0/1673517783 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd441d2c40 con 0x7fcd440b9370 2023-07-19T20:45:24.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.735+0000 7fcd2bfff700 1 -- 172.21.15.117:0/1673517783 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+17982 (secure 0 0 0) 0x7fcd38057560 con 0x7fcd440b9370 2023-07-19T20:45:24.729 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:24.730 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":32,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:45:24.382777+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:45:22.668739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-19T20:45:23.348232+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:45:24.732 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.737+0000 7fcd49ee0700 1 -- 172.21.15.117:0/1673517783 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcd3006a660 msgr2=0x7fcd3006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.732 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.737+0000 7fcd49ee0700 1 --2- 172.21.15.117:0/1673517783 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcd3006a660 0x7fcd3006cb10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcd440b8f30 tx=0x7fcd34007dc0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.737+0000 7fcd49ee0700 1 -- 172.21.15.117:0/1673517783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd440b9370 msgr2=0x7fcd441d6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.737+0000 7fcd49ee0700 1 --2- 172.21.15.117:0/1673517783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd440b9370 0x7fcd441d6750 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800ec10 tx=0x7fcd3800ef20 comp rx=0 tx=0).stop 2023-07-19T20:45:24.733 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.737+0000 7fcd49ee0700 1 -- 172.21.15.117:0/1673517783 shutdown_connections 2023-07-19T20:45:24.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.737+0000 7fcd49ee0700 1 --2- 172.21.15.117:0/1673517783 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fcd3006a660 0x7fcd3006cb10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.737+0000 7fcd49ee0700 1 --2- 172.21.15.117:0/1673517783 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcd4414a660 0x7fcd441d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.737+0000 7fcd49ee0700 1 --2- 172.21.15.117:0/1673517783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd440b9370 0x7fcd441d6750 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.734 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.737+0000 7fcd49ee0700 1 --2- 172.21.15.117:0/1673517783 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd440c1470 0x7fcd441d42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.737+0000 7fcd49ee0700 1 -- 172.21.15.117:0/1673517783 >> 172.21.15.117:0/1673517783 conn(0x7fcd44072920 msgr2=0x7fcd440bdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:24.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.737+0000 7fcd49ee0700 1 -- 172.21.15.117:0/1673517783 shutdown_connections 2023-07-19T20:45:24.735 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.737+0000 7fcd49ee0700 1 -- 172.21.15.117:0/1673517783 wait complete. 2023-07-19T20:45:24.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:45:24.863 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.870+0000 7f52feaa6700 1 Processor -- start 2023-07-19T20:45:24.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.870+0000 7f52feaa6700 1 -- start start 2023-07-19T20:45:24.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52feaa6700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f52f8142bd0 0x7f52f80baa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52feaa6700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f80b86d0 con 0x7f52f80b9610 2023-07-19T20:45:24.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52feaa6700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f80b5960 con 0x7f52f80b9e10 2023-07-19T20:45:24.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52feaa6700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f80b8b60 con 0x7f52f8142bd0 2023-07-19T20:45:24.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f7fff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f52f80b9610 0x7f52f814bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:43168/0 (socket says 172.21.15.117:43168) 2023-07-19T20:45:24.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f7fff700 1 -- 172.21.15.117:0/2883356687 learned_addr learned my addr 172.21.15.117:0/2883356687 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:24.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52fc842700 1 --2- 172.21.15.117:0/2883356687 >> v2:172.21.15.124:3300/0 conn(0x7f52f8142bd0 0x7f52f80baa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377997451 0 0) 0x7f52f80b86d0 con 0x7f52f80b9610 2023-07-19T20:45:24.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e80035b0 con 0x7f52f80b9610 2023-07-19T20:45:24.872 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335608018 0 0) 0x7f52f80b5960 con 0x7f52f80b9e10 2023-07-19T20:45:24.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52f80b86d0 con 0x7f52f80b9e10 2023-07-19T20:45:24.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1205432017 0 0) 0x7f52e80035b0 con 0x7f52f80b9610 2023-07-19T20:45:24.873 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 >> v2:172.21.15.124:3300/0 conn(0x7f52f8142bd0 msgr2=0x7f52f80baa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:24.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 --2- 172.21.15.117:0/2883356687 >> v2:172.21.15.124:3300/0 conn(0x7f52f8142bd0 0x7f52f80baa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 >> v1:172.21.15.124:6789/0 conn(0x7f52f80b9e10 legacy=0x7f52f8152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f80b9b30 con 0x7f52f80b9610 2023-07-19T20:45:24.874 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f52e4001670 con 0x7f52f80b9610 2023-07-19T20:45:24.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 >> v1:172.21.15.117:6789/0 conn(0x7f52f80b9610 legacy=0x7f52f814bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 --2- 172.21.15.117:0/2883356687 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f52e8003be0 0x7f52e8003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 --2- 172.21.15.117:0/2883356687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52e8004850 0x7f52e8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.875 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 --2- 172.21.15.117:0/2883356687 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52e8005250 0x7f52e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f80b8b60 con 0x7f52e8004850 2023-07-19T20:45:24.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e800c160 con 0x7f52e8005250 2023-07-19T20:45:24.876 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e800c320 con 0x7f52e8003be0 2023-07-19T20:45:24.877 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52f7fff700 1 --2- 172.21.15.117:0/2883356687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52e8004850 0x7f52e8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.877 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52fc842700 1 --2- 172.21.15.117:0/2883356687 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f52e8003be0 0x7f52e8003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.877 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.871+0000 7f52fd043700 1 --2- 172.21.15.117:0/2883356687 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52e8005250 0x7f52e800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.877 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52f7fff700 1 -- 172.21.15.117:0/2883356687 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f52e8003be0 msgr2=0x7f52e8003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:24.878 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52f7fff700 1 --2- 172.21.15.117:0/2883356687 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f52e8003be0 0x7f52e8003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.878 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52f7fff700 1 -- 172.21.15.117:0/2883356687 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52e8005250 msgr2=0x7f52e800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:24.878 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52f7fff700 1 --2- 172.21.15.117:0/2883356687 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52e8005250 0x7f52e800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.879 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52f7fff700 1 -- 172.21.15.117:0/2883356687 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e80035b0 con 0x7f52e8004850 2023-07-19T20:45:24.879 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52fd043700 1 -- 172.21.15.117:0/2883356687 reap_dead start 2023-07-19T20:45:24.879 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52f7fff700 1 --2- 172.21.15.117:0/2883356687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52e8004850 0x7f52e8004cc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f52f80b9a60 tx=0x7f52e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f83beb9c6b01acf server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:24.880 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400cbf0 con 0x7f52e8004850 2023-07-19T20:45:24.880 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e400cd50 con 0x7f52e8004850 2023-07-19T20:45:24.880 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52f77fe700 1 -- 172.21.15.117:0/2883356687 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4005ba0 con 0x7f52e8004850 2023-07-19T20:45:24.881 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52feaa6700 1 -- 172.21.15.117:0/2883356687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52e8004850 msgr2=0x7f52e8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.881 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52feaa6700 1 --2- 172.21.15.117:0/2883356687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52e8004850 0x7f52e8004cc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f52f80b9a60 tx=0x7f52e8005880 comp rx=0 tx=0).stop 2023-07-19T20:45:24.882 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52feaa6700 1 -- 172.21.15.117:0/2883356687 shutdown_connections 2023-07-19T20:45:24.882 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52feaa6700 1 --2- 172.21.15.117:0/2883356687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52e8004850 0x7f52e8004cc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.882 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52feaa6700 1 -- 172.21.15.117:0/2883356687 >> 172.21.15.117:0/2883356687 conn(0x7f52f80be4b0 msgr2=0x7f52f80ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:24.882 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52feaa6700 1 -- 172.21.15.117:0/2883356687 shutdown_connections 2023-07-19T20:45:24.882 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.872+0000 7f52feaa6700 1 -- 172.21.15.117:0/2883356687 wait complete. 2023-07-19T20:45:24.883 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.873+0000 7f52feaa6700 1 Processor -- start 2023-07-19T20:45:24.883 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.874+0000 7f52feaa6700 1 -- start start 2023-07-19T20:45:24.883 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.874+0000 7f52feaa6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52e8004850 0x7f52f80b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.884 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.874+0000 7f52feaa6700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f52f81d3060 0x7f52f8070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.884 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.874+0000 7f52feaa6700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52f80712d0 0x7f52f80bb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.884 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.874+0000 7f52feaa6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f80b7500 con 0x7f52e8004850 2023-07-19T20:45:24.884 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.874+0000 7f52feaa6700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f806fde0 con 0x7f52f80712d0 2023-07-19T20:45:24.884 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.874+0000 7f52feaa6700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f8071770 con 0x7f52f81d3060 2023-07-19T20:45:24.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.874+0000 7f52fc842700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52e8004850 0x7f52f80b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.874+0000 7f52fc842700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52e8004850 0x7f52f80b6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47360/0 (socket says 172.21.15.117:47360) 2023-07-19T20:45:24.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.874+0000 7f52fc842700 1 -- 172.21.15.117:0/1162562231 learned_addr learned my addr 172.21.15.117:0/1162562231 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:24.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.874+0000 7f52f7fff700 1 --2- 172.21.15.117:0/1162562231 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f52f81d3060 0x7f52f8070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.874+0000 7f52fd043700 1 --2- 172.21.15.117:0/1162562231 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52f80712d0 0x7f52f80bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.875+0000 7f52fc842700 1 -- 172.21.15.117:0/1162562231 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f52f81d3060 msgr2=0x7f52f8070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.875+0000 7f52fc842700 1 --2- 172.21.15.117:0/1162562231 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f52f81d3060 0x7f52f8070d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.875+0000 7f52fc842700 1 -- 172.21.15.117:0/1162562231 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52f80712d0 msgr2=0x7f52f80bb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:24.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.875+0000 7f52fc842700 1 --2- 172.21.15.117:0/1162562231 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52f80712d0 0x7f52f80bb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:24.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.875+0000 7f52fc842700 1 -- 172.21.15.117:0/1162562231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f8142140 con 0x7f52e8004850 2023-07-19T20:45:24.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.875+0000 7f52fc842700 1 --2- 172.21.15.117:0/1162562231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52e8004850 0x7f52f80b6fc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f52ec011aa0 tx=0x7f52ec011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:24.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.875+0000 7f52f57fa700 1 -- 172.21.15.117:0/1162562231 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec011ee0 con 0x7f52e8004850 2023-07-19T20:45:24.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.875+0000 7f52f57fa700 1 -- 172.21.15.117:0/1162562231 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec00f940 con 0x7f52e8004850 2023-07-19T20:45:24.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.875+0000 7f52feaa6700 1 -- 172.21.15.117:0/1162562231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f806fff0 con 0x7f52e8004850 2023-07-19T20:45:24.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.875+0000 7f52f57fa700 1 -- 172.21.15.117:0/1162562231 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00fcd0 con 0x7f52e8004850 2023-07-19T20:45:24.886 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.875+0000 7f52feaa6700 1 -- 172.21.15.117:0/1162562231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f80705b0 con 0x7f52e8004850 2023-07-19T20:45:24.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.876+0000 7f52feaa6700 1 -- 172.21.15.117:0/1162562231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f8067940 con 0x7f52e8004850 2023-07-19T20:45:24.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.876+0000 7f52f57fa700 1 -- 172.21.15.117:0/1162562231 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f52ec014440 con 0x7f52e8004850 2023-07-19T20:45:24.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.877+0000 7f52f57fa700 1 --2- 172.21.15.117:0/1162562231 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f52dc06a660 0x7f52dc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:24.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.877+0000 7f52f57fa700 1 -- 172.21.15.117:0/1162562231 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f52ec089090 con 0x7f52e8004850 2023-07-19T20:45:24.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.877+0000 7f52f7fff700 1 --2- 172.21.15.117:0/1162562231 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f52dc06a660 0x7f52dc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:24.887 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.877+0000 7f52f7fff700 1 --2- 172.21.15.117:0/1162562231 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f52dc06a660 0x7f52dc06cb10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52f80baeb0 tx=0x7f52e4007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:24.888 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:24.881+0000 7f52f57fa700 1 -- 172.21.15.117:0/1162562231 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f52ec054550 con 0x7f52e8004850 2023-07-19T20:45:25.065 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.071+0000 7f52feaa6700 1 -- 172.21.15.117:0/1162562231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52f80b93f0 con 0x7f52e8004850 2023-07-19T20:45:25.066 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.073+0000 7f52f57fa700 1 -- 172.21.15.117:0/1162562231 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+17982 (secure 0 0 0) 0x7f52ec057b70 con 0x7f52e8004850 2023-07-19T20:45:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:25.067 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":32,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:45:24.382777+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:45:22.668739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-19T20:45:23.348232+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:45:25.068 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.075+0000 7f52feaa6700 1 -- 172.21.15.117:0/1162562231 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f52dc06a660 msgr2=0x7f52dc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:25.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.075+0000 7f52feaa6700 1 --2- 172.21.15.117:0/1162562231 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f52dc06a660 0x7f52dc06cb10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52f80baeb0 tx=0x7f52e4007000 comp rx=0 tx=0).stop 2023-07-19T20:45:25.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.075+0000 7f52feaa6700 1 -- 172.21.15.117:0/1162562231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52e8004850 msgr2=0x7f52f80b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:25.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.075+0000 7f52feaa6700 1 --2- 172.21.15.117:0/1162562231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52e8004850 0x7f52f80b6fc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f52ec011aa0 tx=0x7f52ec011db0 comp rx=0 tx=0).stop 2023-07-19T20:45:25.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.075+0000 7f52feaa6700 1 -- 172.21.15.117:0/1162562231 shutdown_connections 2023-07-19T20:45:25.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.075+0000 7f52feaa6700 1 --2- 172.21.15.117:0/1162562231 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f52dc06a660 0x7f52dc06cb10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:25.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.075+0000 7f52feaa6700 1 --2- 172.21.15.117:0/1162562231 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52f80712d0 0x7f52f80bb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:25.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.075+0000 7f52feaa6700 1 --2- 172.21.15.117:0/1162562231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52e8004850 0x7f52f80b6fc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:25.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.075+0000 7f52feaa6700 1 --2- 172.21.15.117:0/1162562231 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f52f81d3060 0x7f52f8070d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:25.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.075+0000 7f52feaa6700 1 -- 172.21.15.117:0/1162562231 >> 172.21.15.117:0/1162562231 conn(0x7f52f80be4b0 msgr2=0x7f52f813f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:25.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.075+0000 7f52feaa6700 1 -- 172.21.15.117:0/1162562231 shutdown_connections 2023-07-19T20:45:25.072 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.075+0000 7f52feaa6700 1 -- 172.21.15.117:0/1162562231 wait complete. 2023-07-19T20:45:25.081 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-19T20:45:25.206 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.212+0000 7f6613b32700 1 Processor -- start 2023-07-19T20:45:25.206 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.212+0000 7f6613b32700 1 -- start start 2023-07-19T20:45:25.213 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f6613b32700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f660c0b9340 0x7f660c0bbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:25.214 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f6613b32700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f660c0bc140 0x7f660c06b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:25.214 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f6613b32700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660c06d1b0 con 0x7f660c0b9710 2023-07-19T20:45:25.214 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f6613b32700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c09beb0 con 0x7f660c0bc140 2023-07-19T20:45:25.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f6613b32700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c09c090 con 0x7f660c0b9340 2023-07-19T20:45:25.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f66110cd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f660c0bc140 0x7f660c06b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:25.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f66120cf700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f660c0b9710 0x7f660c06bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:43174/0 (socket says 172.21.15.117:43174) 2023-07-19T20:45:25.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f66110cd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f660c0bc140 0x7f660c06b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47362/0 (socket says 172.21.15.117:47362) 2023-07-19T20:45:25.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f66110cd700 1 -- 172.21.15.117:0/2345148480 learned_addr learned my addr 172.21.15.117:0/2345148480 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:25.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f66118ce700 1 --2- 172.21.15.117:0/2345148480 >> v2:172.21.15.124:3300/0 conn(0x7f660c0b9340 0x7f660c0bbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:25.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f66110cd700 1 -- 172.21.15.117:0/2345148480 >> v2:172.21.15.124:3300/0 conn(0x7f660c0b9340 msgr2=0x7f660c0bbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:25.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f66110cd700 1 --2- 172.21.15.117:0/2345148480 >> v2:172.21.15.124:3300/0 conn(0x7f660c0b9340 0x7f660c0bbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:25.217 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f66110cd700 1 -- 172.21.15.117:0/2345148480 >> v1:172.21.15.117:6789/0 conn(0x7f660c0b9710 legacy=0x7f660c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:25.217 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f66108cc700 1 -- 172.21.15.117:0/2345148480 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063562204 0 0) 0x7f660c06d1b0 con 0x7f660c0b9710 2023-07-19T20:45:25.219 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.213+0000 7f66110cd700 1 -- 172.21.15.117:0/2345148480 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c0b7e60 con 0x7f660c0bc140 2023-07-19T20:45:25.219 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.214+0000 7f66110cd700 1 --2- 172.21.15.117:0/2345148480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660c0bc140 0x7f660c06b730 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f660c06e9f0 tx=0x7f6608009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8f071b5bfbd27b server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:25.219 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.214+0000 7f66108cc700 1 -- 172.21.15.117:0/2345148480 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608011830 con 0x7f660c0bc140 2023-07-19T20:45:25.220 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.214+0000 7f66108cc700 1 -- 172.21.15.117:0/2345148480 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6608011990 con 0x7f660c0bc140 2023-07-19T20:45:25.220 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.214+0000 7f66108cc700 1 -- 172.21.15.117:0/2345148480 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608011d20 con 0x7f660c0bc140 2023-07-19T20:45:25.220 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.214+0000 7f6613b32700 1 -- 172.21.15.117:0/2345148480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660c0bc140 msgr2=0x7f660c06b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:25.220 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.214+0000 7f6613b32700 1 --2- 172.21.15.117:0/2345148480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660c0bc140 0x7f660c06b730 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f660c06e9f0 tx=0x7f6608009bd0 comp rx=0 tx=0).stop 2023-07-19T20:45:25.220 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.214+0000 7f6613b32700 1 -- 172.21.15.117:0/2345148480 shutdown_connections 2023-07-19T20:45:25.220 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.214+0000 7f6613b32700 1 --2- 172.21.15.117:0/2345148480 >> v2:172.21.15.124:3300/0 conn(0x7f660c0b9340 0x7f660c0bbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:25.221 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.214+0000 7f6613b32700 1 --2- 172.21.15.117:0/2345148480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660c0bc140 0x7f660c06b730 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:25.221 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.214+0000 7f6613b32700 1 -- 172.21.15.117:0/2345148480 >> 172.21.15.117:0/2345148480 conn(0x7f660c09f150 msgr2=0x7f660c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:25.221 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.214+0000 7f6613b32700 1 -- 172.21.15.117:0/2345148480 shutdown_connections 2023-07-19T20:45:25.221 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.214+0000 7f6613b32700 1 -- 172.21.15.117:0/2345148480 wait complete. 2023-07-19T20:45:25.221 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.216+0000 7f6613b32700 1 Processor -- start 2023-07-19T20:45:25.221 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.216+0000 7f6613b32700 1 -- start start 2023-07-19T20:45:25.221 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.216+0000 7f6613b32700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f660c0b9340 0x7f660c09b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:25.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f6613b32700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f660c0b9710 0x7f660c1c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:25.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f6613b32700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660c0bc140 0x7f660c1e3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:25.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f6613b32700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c1c9540 con 0x7f660c0bc140 2023-07-19T20:45:25.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f6613b32700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c1dffd0 con 0x7f660c0b9340 2023-07-19T20:45:25.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f6613b32700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c09a410 con 0x7f660c0b9710 2023-07-19T20:45:25.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f66120cf700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660c0bc140 0x7f660c1e3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:25.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f66120cf700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660c0bc140 0x7f660c1e3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47366/0 (socket says 172.21.15.117:47366) 2023-07-19T20:45:25.222 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f66120cf700 1 -- 172.21.15.117:0/2822613410 learned_addr learned my addr 172.21.15.117:0/2822613410 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:25.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f66110cd700 1 --2- 172.21.15.117:0/2822613410 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f660c0b9710 0x7f660c1c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:25.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f66118ce700 1 --2- 172.21.15.117:0/2822613410 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f660c0b9340 0x7f660c09b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:25.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f66120cf700 1 -- 172.21.15.117:0/2822613410 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f660c0b9710 msgr2=0x7f660c1c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:25.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f66120cf700 1 --2- 172.21.15.117:0/2822613410 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f660c0b9710 0x7f660c1c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:25.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f66120cf700 1 -- 172.21.15.117:0/2822613410 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f660c0b9340 msgr2=0x7f660c09b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:25.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f66120cf700 1 --2- 172.21.15.117:0/2822613410 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f660c0b9340 0x7f660c09b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:25.223 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f66120cf700 1 -- 172.21.15.117:0/2822613410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6608009550 con 0x7f660c0bc140 2023-07-19T20:45:25.224 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f66120cf700 1 --2- 172.21.15.117:0/2822613410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660c0bc140 0x7f660c1e3520 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6604002230 tx=0x7f660400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:25.224 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f66027fc700 1 -- 172.21.15.117:0/2822613410 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660400ac20 con 0x7f660c0bc140 2023-07-19T20:45:25.224 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f66027fc700 1 -- 172.21.15.117:0/2822613410 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660400ada0 con 0x7f660c0bc140 2023-07-19T20:45:25.224 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f6613b32700 1 -- 172.21.15.117:0/2822613410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660c1e04a0 con 0x7f660c0bc140 2023-07-19T20:45:25.224 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f66027fc700 1 -- 172.21.15.117:0/2822613410 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604007310 con 0x7f660c0bc140 2023-07-19T20:45:25.224 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.217+0000 7f6613b32700 1 -- 172.21.15.117:0/2822613410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c1e3a60 con 0x7f660c0bc140 2023-07-19T20:45:25.224 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.218+0000 7f6613b32700 1 -- 172.21.15.117:0/2822613410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660c1e02b0 con 0x7f660c0bc140 2023-07-19T20:45:25.225 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.219+0000 7f66027fc700 1 -- 172.21.15.117:0/2822613410 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f6604007470 con 0x7f660c0bc140 2023-07-19T20:45:25.225 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.219+0000 7f66027fc700 1 --2- 172.21.15.117:0/2822613410 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f65f006a690 0x7f65f006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:25.225 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.219+0000 7f66027fc700 1 -- 172.21.15.117:0/2822613410 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6604088a20 con 0x7f660c0bc140 2023-07-19T20:45:25.225 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.219+0000 7f66118ce700 1 --2- 172.21.15.117:0/2822613410 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f65f006a690 0x7f65f006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:25.225 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.219+0000 7f66118ce700 1 --2- 172.21.15.117:0/2822613410 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f65f006a690 0x7f65f006cb40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00ac70 tx=0x7f65fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:25.226 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.223+0000 7f66027fc700 1 -- 172.21.15.117:0/2822613410 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f6604053d90 con 0x7f660c0bc140 2023-07-19T20:45:25.447 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:25.454+0000 7f6613b32700 1 -- 172.21.15.117:0/2822613410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f660c074890 con 0x7f660c0bc140 2023-07-19T20:45:26.391 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.397+0000 7f66027fc700 1 -- 172.21.15.117:0/2822613410 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6604018070 con 0x7f660c0bc140 2023-07-19T20:45:26.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.400+0000 7f6613b32700 1 -- 172.21.15.117:0/2822613410 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f65f006a690 msgr2=0x7f65f006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:26.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.400+0000 7f6613b32700 1 --2- 172.21.15.117:0/2822613410 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f65f006a690 0x7f65f006cb40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00ac70 tx=0x7f65fc008040 comp rx=0 tx=0).stop 2023-07-19T20:45:26.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.400+0000 7f6613b32700 1 -- 172.21.15.117:0/2822613410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660c0bc140 msgr2=0x7f660c1e3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:26.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.400+0000 7f6613b32700 1 --2- 172.21.15.117:0/2822613410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660c0bc140 0x7f660c1e3520 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6604002230 tx=0x7f660400a060 comp rx=0 tx=0).stop 2023-07-19T20:45:26.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.400+0000 7f6613b32700 1 -- 172.21.15.117:0/2822613410 shutdown_connections 2023-07-19T20:45:26.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.400+0000 7f6613b32700 1 --2- 172.21.15.117:0/2822613410 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f65f006a690 0x7f65f006cb40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:26.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.400+0000 7f6613b32700 1 --2- 172.21.15.117:0/2822613410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660c0bc140 0x7f660c1e3520 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:26.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.400+0000 7f6613b32700 1 --2- 172.21.15.117:0/2822613410 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f660c0b9340 0x7f660c09b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:26.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.400+0000 7f6613b32700 1 --2- 172.21.15.117:0/2822613410 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f660c0b9710 0x7f660c1c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:26.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.400+0000 7f6613b32700 1 -- 172.21.15.117:0/2822613410 >> 172.21.15.117:0/2822613410 conn(0x7f660c09f150 msgr2=0x7f660c1cb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:26.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.400+0000 7f6613b32700 1 -- 172.21.15.117:0/2822613410 shutdown_connections 2023-07-19T20:45:26.395 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.400+0000 7f6613b32700 1 -- 172.21.15.117:0/2822613410 wait complete. 2023-07-19T20:45:26.409 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-19T20:45:26.409 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-19T20:45:26.541 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.548+0000 7f25e72a9700 1 Processor -- start 2023-07-19T20:45:26.541 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.548+0000 7f25e72a9700 1 -- start start 2023-07-19T20:45:26.543 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.548+0000 7f25e72a9700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f25e006b7e0 0x7f25e006c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:26.543 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.548+0000 7f25e72a9700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f25e01482c0 0x7f25e0141a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:26.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.548+0000 7f25e72a9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e0147720 con 0x7f25e0141610 2023-07-19T20:45:26.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25e72a9700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e00b3920 con 0x7f25e006b7e0 2023-07-19T20:45:26.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25e72a9700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e00b91a0 con 0x7f25e01482c0 2023-07-19T20:45:26.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25e5045700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f25e006b7e0 0x7f25e006c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:26.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25e4844700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f25e0141610 0x7f25e0147bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:43180/0 (socket says 172.21.15.117:43180) 2023-07-19T20:45:26.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25e4844700 1 -- 172.21.15.117:0/3552699171 learned_addr learned my addr 172.21.15.117:0/3552699171 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:26.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25e5846700 1 --2- 172.21.15.117:0/3552699171 >> v2:172.21.15.124:3300/0 conn(0x7f25e01482c0 0x7f25e0141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:26.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25d7fff700 1 -- 172.21.15.117:0/3552699171 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346876592 0 0) 0x7f25e0147720 con 0x7f25e0141610 2023-07-19T20:45:26.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25d7fff700 1 -- 172.21.15.117:0/3552699171 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25cc0035b0 con 0x7f25e0141610 2023-07-19T20:45:26.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25e5045700 1 -- 172.21.15.117:0/3552699171 >> v2:172.21.15.124:3300/0 conn(0x7f25e01482c0 msgr2=0x7f25e0141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:26.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25e5045700 1 --2- 172.21.15.117:0/3552699171 >> v2:172.21.15.124:3300/0 conn(0x7f25e01482c0 0x7f25e0141a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:26.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25e5045700 1 -- 172.21.15.117:0/3552699171 >> v1:172.21.15.117:6789/0 conn(0x7f25e0141610 legacy=0x7f25e0147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:26.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25e5045700 1 -- 172.21.15.117:0/3552699171 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e00b9480 con 0x7f25e006b7e0 2023-07-19T20:45:26.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25e5846700 1 --2- 172.21.15.117:0/3552699171 >> v2:172.21.15.124:3300/0 conn(0x7f25e01482c0 0x7f25e0141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:26.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25e5045700 1 --2- 172.21.15.117:0/3552699171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e006b7e0 0x7f25e006c790 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f25e006ef00 tx=0x7f25dc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab2579d3a63ab89 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:26.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25d7fff700 1 -- 172.21.15.117:0/3552699171 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc011830 con 0x7f25e006b7e0 2023-07-19T20:45:26.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25d7fff700 1 -- 172.21.15.117:0/3552699171 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc011990 con 0x7f25e006b7e0 2023-07-19T20:45:26.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.549+0000 7f25d7fff700 1 -- 172.21.15.117:0/3552699171 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc011d20 con 0x7f25e006b7e0 2023-07-19T20:45:26.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.550+0000 7f25e72a9700 1 -- 172.21.15.117:0/3552699171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e006b7e0 msgr2=0x7f25e006c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:26.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.550+0000 7f25e72a9700 1 --2- 172.21.15.117:0/3552699171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e006b7e0 0x7f25e006c790 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f25e006ef00 tx=0x7f25dc009b20 comp rx=0 tx=0).stop 2023-07-19T20:45:26.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.550+0000 7f25e72a9700 1 -- 172.21.15.117:0/3552699171 shutdown_connections 2023-07-19T20:45:26.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.550+0000 7f25e72a9700 1 --2- 172.21.15.117:0/3552699171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e006b7e0 0x7f25e006c790 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:26.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.550+0000 7f25e72a9700 1 --2- 172.21.15.117:0/3552699171 >> v2:172.21.15.124:3300/0 conn(0x7f25e01482c0 0x7f25e0141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:26.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.550+0000 7f25e72a9700 1 -- 172.21.15.117:0/3552699171 >> 172.21.15.117:0/3552699171 conn(0x7f25e00bdc50 msgr2=0x7f25e006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:26.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.550+0000 7f25e72a9700 1 -- 172.21.15.117:0/3552699171 shutdown_connections 2023-07-19T20:45:26.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.550+0000 7f25e72a9700 1 -- 172.21.15.117:0/3552699171 wait complete. 2023-07-19T20:45:26.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.551+0000 7f25e72a9700 1 Processor -- start 2023-07-19T20:45:26.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.551+0000 7f25e72a9700 1 -- start start 2023-07-19T20:45:26.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.551+0000 7f25e72a9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25e006b7e0 0x7f25e0138930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:26.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.551+0000 7f25e72a9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e0141610 0x7f25e0071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:26.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e72a9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f25e01482c0 0x7f25e01e1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:26.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e72a9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0138e70 con 0x7f25e0141610 2023-07-19T20:45:26.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e72a9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e006ff50 con 0x7f25e006b7e0 2023-07-19T20:45:26.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e72a9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e006f9d0 con 0x7f25e01482c0 2023-07-19T20:45:26.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e4844700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e0141610 0x7f25e0071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:26.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e4844700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e0141610 0x7f25e0071ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47388/0 (socket says 172.21.15.117:47388) 2023-07-19T20:45:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e4844700 1 -- 172.21.15.117:0/974579419 learned_addr learned my addr 172.21.15.117:0/974579419 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e4844700 1 -- 172.21.15.117:0/974579419 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f25e01482c0 msgr2=0x7f25e01e1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e5846700 1 --2- 172.21.15.117:0/974579419 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f25e01482c0 0x7f25e01e1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e5045700 1 --2- 172.21.15.117:0/974579419 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25e006b7e0 0x7f25e0138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e4844700 1 --2- 172.21.15.117:0/974579419 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f25e01482c0 0x7f25e01e1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e4844700 1 -- 172.21.15.117:0/974579419 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25e006b7e0 msgr2=0x7f25e0138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:26.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e4844700 1 --2- 172.21.15.117:0/974579419 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25e006b7e0 0x7f25e0138930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:26.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e4844700 1 -- 172.21.15.117:0/974579419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc0094a0 con 0x7f25e0141610 2023-07-19T20:45:26.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e4844700 1 --2- 172.21.15.117:0/974579419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e0141610 0x7f25e0071ad0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f25d000c700 tx=0x7f25d000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:26.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25d5ffb700 1 -- 172.21.15.117:0/974579419 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0005d70 con 0x7f25e0141610 2023-07-19T20:45:26.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25d5ffb700 1 -- 172.21.15.117:0/974579419 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d00070d0 con 0x7f25e0141610 2023-07-19T20:45:26.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e72a9700 1 -- 172.21.15.117:0/974579419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e00a2b70 con 0x7f25e0141610 2023-07-19T20:45:26.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25d5ffb700 1 -- 172.21.15.117:0/974579419 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0007460 con 0x7f25e0141610 2023-07-19T20:45:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.552+0000 7f25e72a9700 1 -- 172.21.15.117:0/974579419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e014ba30 con 0x7f25e0141610 2023-07-19T20:45:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.553+0000 7f25e72a9700 1 -- 172.21.15.117:0/974579419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e0067940 con 0x7f25e0141610 2023-07-19T20:45:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.554+0000 7f25d5ffb700 1 -- 172.21.15.117:0/974579419 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f25d00075c0 con 0x7f25e0141610 2023-07-19T20:45:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.554+0000 7f25d5ffb700 1 --2- 172.21.15.117:0/974579419 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f25c406a660 0x7f25c406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.554+0000 7f25d5ffb700 1 -- 172.21.15.117:0/974579419 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f25d0088080 con 0x7f25e0141610 2023-07-19T20:45:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.554+0000 7f25e5045700 1 --2- 172.21.15.117:0/974579419 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f25c406a660 0x7f25c406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.554+0000 7f25e5045700 1 --2- 172.21.15.117:0/974579419 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f25c406a660 0x7f25c406cb10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0090b0 tx=0x7f25dc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:26.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.558+0000 7f25d5ffb700 1 -- 172.21.15.117:0/974579419 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f25d0053490 con 0x7f25e0141610 2023-07-19T20:45:26.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:26.790+0000 7f25e72a9700 1 -- 172.21.15.117:0/974579419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f25e00b3e90 con 0x7f25e0141610 2023-07-19T20:45:27.394 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.401+0000 7f25d5ffb700 1 -- 172.21.15.117:0/974579419 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f25d0056ab0 con 0x7f25e0141610 2023-07-19T20:45:27.396 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.403+0000 7f25e72a9700 1 -- 172.21.15.117:0/974579419 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f25c406a660 msgr2=0x7f25c406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:27.397 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.403+0000 7f25e72a9700 1 --2- 172.21.15.117:0/974579419 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f25c406a660 0x7f25c406cb10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0090b0 tx=0x7f25dc008030 comp rx=0 tx=0).stop 2023-07-19T20:45:27.397 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.403+0000 7f25e72a9700 1 -- 172.21.15.117:0/974579419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e0141610 msgr2=0x7f25e0071ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:27.397 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.403+0000 7f25e72a9700 1 --2- 172.21.15.117:0/974579419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e0141610 0x7f25e0071ad0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f25d000c700 tx=0x7f25d000cac0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.397 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.403+0000 7f25e72a9700 1 -- 172.21.15.117:0/974579419 shutdown_connections 2023-07-19T20:45:27.397 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.403+0000 7f25e72a9700 1 --2- 172.21.15.117:0/974579419 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f25c406a660 0x7f25c406cb10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.397 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.403+0000 7f25e72a9700 1 --2- 172.21.15.117:0/974579419 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f25e01482c0 0x7f25e01e1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.403+0000 7f25e72a9700 1 --2- 172.21.15.117:0/974579419 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25e006b7e0 0x7f25e0138930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.403+0000 7f25e72a9700 1 --2- 172.21.15.117:0/974579419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e0141610 0x7f25e0071ad0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.403+0000 7f25e72a9700 1 -- 172.21.15.117:0/974579419 >> 172.21.15.117:0/974579419 conn(0x7f25e00bdc50 msgr2=0x7f25e00b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:27.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.403+0000 7f25e72a9700 1 -- 172.21.15.117:0/974579419 shutdown_connections 2023-07-19T20:45:27.398 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.403+0000 7f25e72a9700 1 -- 172.21.15.117:0/974579419 wait complete. 2023-07-19T20:45:27.413 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-19T20:45:27.413 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-19T20:45:27.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.542+0000 7f92764b3700 1 Processor -- start 2023-07-19T20:45:27.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.542+0000 7f92764b3700 1 -- start start 2023-07-19T20:45:27.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.543+0000 7f92764b3700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f92701447e0 0x7f92700b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.543+0000 7f92764b3700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f927006baf0 0x7f9270070110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.543+0000 7f92764b3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f927006f560 0x7f92700b7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.543+0000 7f92764b3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9270070db0 con 0x7f927006f560 2023-07-19T20:45:27.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.543+0000 7f92764b3700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927006b6a0 con 0x7f927006baf0 2023-07-19T20:45:27.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.543+0000 7f92764b3700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92700b9770 con 0x7f92701447e0 2023-07-19T20:45:27.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.543+0000 7f9274a50700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f927006f560 0x7f92700b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.543+0000 7f9274a50700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f927006f560 0x7f92700b7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47404/0 (socket says 172.21.15.117:47404) 2023-07-19T20:45:27.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.543+0000 7f9274a50700 1 -- 172.21.15.117:0/2836546140 learned_addr learned my addr 172.21.15.117:0/2836546140 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:27.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.543+0000 7f926ffff700 1 --2- 172.21.15.117:0/2836546140 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f92701447e0 0x7f92700b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.543+0000 7f926f7fe700 1 --2- 172.21.15.117:0/2836546140 >> v2:172.21.15.124:3300/0 conn(0x7f927006baf0 0x7f9270070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.543+0000 7f9274a50700 1 -- 172.21.15.117:0/2836546140 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f92701447e0 msgr2=0x7f92700b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:27.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.543+0000 7f9274a50700 1 --2- 172.21.15.117:0/2836546140 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f92701447e0 0x7f92700b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f9274a50700 1 -- 172.21.15.117:0/2836546140 >> v2:172.21.15.124:3300/0 conn(0x7f927006baf0 msgr2=0x7f9270070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:27.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f9274a50700 1 --2- 172.21.15.117:0/2836546140 >> v2:172.21.15.124:3300/0 conn(0x7f927006baf0 0x7f9270070110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f9274a50700 1 -- 172.21.15.117:0/2836546140 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92700b8a70 con 0x7f927006f560 2023-07-19T20:45:27.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f926f7fe700 1 --2- 172.21.15.117:0/2836546140 >> v2:172.21.15.124:3300/0 conn(0x7f927006baf0 0x7f9270070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:27.547 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f9274a50700 1 --2- 172.21.15.117:0/2836546140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f927006f560 0x7f92700b7940 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9270066c00 tx=0x7f926800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c647e31219fd3514 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:27.548 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f926effd700 1 -- 172.21.15.117:0/2836546140 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268010070 con 0x7f927006f560 2023-07-19T20:45:27.548 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f926effd700 1 -- 172.21.15.117:0/2836546140 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926800dad0 con 0x7f927006f560 2023-07-19T20:45:27.548 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f926effd700 1 -- 172.21.15.117:0/2836546140 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926800de60 con 0x7f927006f560 2023-07-19T20:45:27.548 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f92764b3700 1 -- 172.21.15.117:0/2836546140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f927006f560 msgr2=0x7f92700b7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:27.548 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f92764b3700 1 --2- 172.21.15.117:0/2836546140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f927006f560 0x7f92700b7940 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9270066c00 tx=0x7f926800d430 comp rx=0 tx=0).stop 2023-07-19T20:45:27.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f92764b3700 1 -- 172.21.15.117:0/2836546140 shutdown_connections 2023-07-19T20:45:27.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f92764b3700 1 --2- 172.21.15.117:0/2836546140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f927006f560 0x7f92700b7940 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f92764b3700 1 --2- 172.21.15.117:0/2836546140 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f92701447e0 0x7f92700b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f92764b3700 1 --2- 172.21.15.117:0/2836546140 >> v2:172.21.15.124:3300/0 conn(0x7f927006baf0 0x7f9270070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f92764b3700 1 -- 172.21.15.117:0/2836546140 >> 172.21.15.117:0/2836546140 conn(0x7f92700bdc00 msgr2=0x7f92700b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:27.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f92764b3700 1 -- 172.21.15.117:0/2836546140 shutdown_connections 2023-07-19T20:45:27.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.544+0000 7f92764b3700 1 -- 172.21.15.117:0/2836546140 wait complete. 2023-07-19T20:45:27.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.546+0000 7f92764b3700 1 Processor -- start 2023-07-19T20:45:27.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.546+0000 7f92764b3700 1 -- start start 2023-07-19T20:45:27.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f92764b3700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f927006baf0 0x7f9270146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f92764b3700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f927006f560 0x7f92701473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f92764b3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92701447e0 0x7f92701dc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f92764b3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9270145420 con 0x7f92701447e0 2023-07-19T20:45:27.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f92764b3700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92700b4520 con 0x7f927006baf0 2023-07-19T20:45:27.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f92764b3700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9270145640 con 0x7f927006f560 2023-07-19T20:45:27.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f9274a50700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92701447e0 0x7f92701dc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f926ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f927006baf0 0x7f9270146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f9274a50700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92701447e0 0x7f92701dc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47406/0 (socket says 172.21.15.117:47406) 2023-07-19T20:45:27.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f926ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f927006baf0 0x7f9270146230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.117:49150/0 (socket says 172.21.15.117:49150) 2023-07-19T20:45:27.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f9274a50700 1 -- 172.21.15.117:0/151572690 learned_addr learned my addr 172.21.15.117:0/151572690 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:27.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f926f7fe700 1 --2- 172.21.15.117:0/151572690 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f927006f560 0x7f92701473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f9274a50700 1 -- 172.21.15.117:0/151572690 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f927006f560 msgr2=0x7f92701473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:27.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f9274a50700 1 --2- 172.21.15.117:0/151572690 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f927006f560 0x7f92701473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f9274a50700 1 -- 172.21.15.117:0/151572690 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f927006baf0 msgr2=0x7f9270146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:27.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f9274a50700 1 --2- 172.21.15.117:0/151572690 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f927006baf0 0x7f9270146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f9274a50700 1 -- 172.21.15.117:0/151572690 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926800bd40 con 0x7f92701447e0 2023-07-19T20:45:27.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f9274a50700 1 --2- 172.21.15.117:0/151572690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92701447e0 0x7f92701dc0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f92700671a0 tx=0x7f9268004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:27.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.547+0000 7f926cff9700 1 -- 172.21.15.117:0/151572690 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268004550 con 0x7f92701447e0 2023-07-19T20:45:27.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.548+0000 7f926cff9700 1 -- 172.21.15.117:0/151572690 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92680046d0 con 0x7f92701447e0 2023-07-19T20:45:27.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.548+0000 7f926cff9700 1 -- 172.21.15.117:0/151572690 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926801f440 con 0x7f92701447e0 2023-07-19T20:45:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.548+0000 7f92764b3700 1 -- 172.21.15.117:0/151572690 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9270145920 con 0x7f92701447e0 2023-07-19T20:45:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.548+0000 7f92764b3700 1 -- 172.21.15.117:0/151572690 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9270146950 con 0x7f92701447e0 2023-07-19T20:45:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.548+0000 7f92764b3700 1 -- 172.21.15.117:0/151572690 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9270067940 con 0x7f92701447e0 2023-07-19T20:45:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.549+0000 7f926cff9700 1 -- 172.21.15.117:0/151572690 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f926801f5a0 con 0x7f92701447e0 2023-07-19T20:45:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.549+0000 7f926cff9700 1 --2- 172.21.15.117:0/151572690 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f925c06a690 0x7f925c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.549+0000 7f926ffff700 1 --2- 172.21.15.117:0/151572690 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f925c06a690 0x7f925c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.549+0000 7f926cff9700 1 -- 172.21.15.117:0/151572690 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f926808c5e0 con 0x7f92701447e0 2023-07-19T20:45:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.550+0000 7f926ffff700 1 --2- 172.21.15.117:0/151572690 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f925c06a690 0x7f925c06cb40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9260009b40 tx=0x7f9260009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:27.554 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.554+0000 7f926cff9700 1 -- 172.21.15.117:0/151572690 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f926805b500 con 0x7f92701447e0 2023-07-19T20:45:27.774 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.779+0000 7f92764b3700 1 -- 172.21.15.117:0/151572690 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f927006c0a0 con 0x7f92701447e0 2023-07-19T20:45:27.774 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.780+0000 7f926cff9700 1 -- 172.21.15.117:0/151572690 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3894 (secure 0 0 0) 0x7f926805b090 con 0x7f92701447e0 2023-07-19T20:45:27.775 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:27.775 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6833/536497381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":536497381},{"type":"v1","addr":"172.21.15.124:6833","nonce":536497381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2489302759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2489302759},{"type":"v1","addr":"172.21.15.117:6836","nonce":2489302759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-19T20:45:24.383082+0000","modified":"2023-07-19T20:45:27.396889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4923":{"gid":4923,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/337131599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":337131599},{"type":"v1","addr":"172.21.15.117:6837","nonce":337131599}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-19T20:45:27.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.782+0000 7f92764b3700 1 -- 172.21.15.117:0/151572690 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f925c06a690 msgr2=0x7f925c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:27.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.782+0000 7f92764b3700 1 --2- 172.21.15.117:0/151572690 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f925c06a690 0x7f925c06cb40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9260009b40 tx=0x7f9260009210 comp rx=0 tx=0).stop 2023-07-19T20:45:27.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.782+0000 7f92764b3700 1 -- 172.21.15.117:0/151572690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92701447e0 msgr2=0x7f92701dc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:27.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.782+0000 7f92764b3700 1 --2- 172.21.15.117:0/151572690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92701447e0 0x7f92701dc0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f92700671a0 tx=0x7f9268004ad0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.782+0000 7f92764b3700 1 -- 172.21.15.117:0/151572690 shutdown_connections 2023-07-19T20:45:27.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.782+0000 7f92764b3700 1 --2- 172.21.15.117:0/151572690 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f925c06a690 0x7f925c06cb40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.782+0000 7f92764b3700 1 --2- 172.21.15.117:0/151572690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92701447e0 0x7f92701dc0a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.782+0000 7f92764b3700 1 --2- 172.21.15.117:0/151572690 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f927006baf0 0x7f9270146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.782+0000 7f92764b3700 1 --2- 172.21.15.117:0/151572690 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f927006f560 0x7f92701473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.782+0000 7f92764b3700 1 -- 172.21.15.117:0/151572690 >> 172.21.15.117:0/151572690 conn(0x7f92700bdc00 msgr2=0x7f92701427f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:27.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.782+0000 7f92764b3700 1 -- 172.21.15.117:0/151572690 shutdown_connections 2023-07-19T20:45:27.779 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.782+0000 7f92764b3700 1 -- 172.21.15.117:0/151572690 wait complete. 2023-07-19T20:45:27.779 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 15 2023-07-19T20:45:27.787 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-19T20:45:27.868 INFO:tasks.ceph.mds.c.smithi117.stderr:2023-07-19T20:45:27.874+0000 7f0b6174a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-19T20:45:27.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.914+0000 7fc5cbf5f700 1 Processor -- start 2023-07-19T20:45:27.911 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.914+0000 7fc5cbf5f700 1 -- start start 2023-07-19T20:45:27.912 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.915+0000 7fc5cbf5f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc5c40b5300 0x7fc5c4147710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.912 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.915+0000 7fc5cbf5f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c40b6390 con 0x7fc5c41417f0 2023-07-19T20:45:27.912 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.915+0000 7fc5cbf5f700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c40b8fd0 con 0x7fc5c40bd360 2023-07-19T20:45:27.912 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.915+0000 7fc5cbf5f700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4072620 con 0x7fc5c40b5300 2023-07-19T20:45:27.912 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.915+0000 7fc5c9cfb700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fc5c41417f0 0x7fc5c40b88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:43196/0 (socket says 172.21.15.117:43196) 2023-07-19T20:45:27.912 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.915+0000 7fc5c9cfb700 1 -- 172.21.15.117:0/4181151521 learned_addr learned my addr 172.21.15.117:0/4181151521 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:27.912 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.915+0000 7fc5c94fa700 1 --2- 172.21.15.117:0/4181151521 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc5c40b5300 0x7fc5c4147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.912 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.915+0000 7fc5c8cf9700 1 -- 172.21.15.117:0/4181151521 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631522879 0 0) 0x7fc5c40b6390 con 0x7fc5c41417f0 2023-07-19T20:45:27.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.915+0000 7fc5c8cf9700 1 -- 172.21.15.117:0/4181151521 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5b00035b0 con 0x7fc5c41417f0 2023-07-19T20:45:27.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 -- 172.21.15.117:0/4181151521 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1869430032 0 0) 0x7fc5b00035b0 con 0x7fc5c41417f0 2023-07-19T20:45:27.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 -- 172.21.15.117:0/4181151521 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc5c40b5300 msgr2=0x7fc5c4147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:27.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 --2- 172.21.15.117:0/4181151521 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc5c40b5300 0x7fc5c4147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 -- 172.21.15.117:0/4181151521 >> v1:172.21.15.124:6789/0 conn(0x7fc5c40bd360 legacy=0x7fc5c4151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:27.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 -- 172.21.15.117:0/4181151521 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c4141bc0 con 0x7fc5c41417f0 2023-07-19T20:45:27.913 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 -- 172.21.15.117:0/4181151521 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7fc5b4001670 con 0x7fc5c41417f0 2023-07-19T20:45:27.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 -- 172.21.15.117:0/4181151521 >> v1:172.21.15.117:6789/0 conn(0x7fc5c41417f0 legacy=0x7fc5c40b88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:27.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 --2- 172.21.15.117:0/4181151521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5b0003a30 0x7fc5b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 --2- 172.21.15.117:0/4181151521 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc5c40b5300 0x7fc5b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 --2- 172.21.15.117:0/4181151521 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5b0004d90 0x7fc5b0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 -- 172.21.15.117:0/4181151521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4072620 con 0x7fc5b0003a30 2023-07-19T20:45:27.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 -- 172.21.15.117:0/4181151521 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b000ba10 con 0x7fc5b0004d90 2023-07-19T20:45:27.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 -- 172.21.15.117:0/4181151521 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b000bba0 con 0x7fc5c40b5300 2023-07-19T20:45:27.914 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c9cfb700 1 --2- 172.21.15.117:0/4181151521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5b0003a30 0x7fc5b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c94fa700 1 --2- 172.21.15.117:0/4181151521 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc5c40b5300 0x7fc5b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5ca4fc700 1 --2- 172.21.15.117:0/4181151521 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5b0004d90 0x7fc5b0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c9cfb700 1 -- 172.21.15.117:0/4181151521 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc5c40b5300 msgr2=0x7fc5b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:27.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c9cfb700 1 --2- 172.21.15.117:0/4181151521 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc5c40b5300 0x7fc5b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c9cfb700 1 -- 172.21.15.117:0/4181151521 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5b0004d90 msgr2=0x7fc5b0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:27.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c9cfb700 1 --2- 172.21.15.117:0/4181151521 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5b0004d90 0x7fc5b0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c9cfb700 1 -- 172.21.15.117:0/4181151521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b00035b0 con 0x7fc5b0003a30 2023-07-19T20:45:27.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5ca4fc700 1 --2- 172.21.15.117:0/4181151521 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5b0004d90 0x7fc5b0005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:27.916 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c9cfb700 1 --2- 172.21.15.117:0/4181151521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5b0003a30 0x7fc5b0003e00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400c2f0 tx=0x7fc5b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc3668f57faea6a server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:27.916 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 -- 172.21.15.117:0/4181151521 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b400ce30 con 0x7fc5b0003a30 2023-07-19T20:45:27.916 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 -- 172.21.15.117:0/4181151521 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b4005960 con 0x7fc5b0003a30 2023-07-19T20:45:27.916 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.916+0000 7fc5c8cf9700 1 -- 172.21.15.117:0/4181151521 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4005cf0 con 0x7fc5b0003a30 2023-07-19T20:45:27.916 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.917+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/4181151521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5b0003a30 msgr2=0x7fc5b0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:27.916 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.917+0000 7fc5cbf5f700 1 --2- 172.21.15.117:0/4181151521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5b0003a30 0x7fc5b0003e00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400c2f0 tx=0x7fc5b0005880 comp rx=0 tx=0).stop 2023-07-19T20:45:27.917 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.917+0000 7fc5ca4fc700 1 -- 172.21.15.117:0/4181151521 reap_dead start 2023-07-19T20:45:27.917 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.917+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/4181151521 shutdown_connections 2023-07-19T20:45:27.917 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.917+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/4181151521 >> 172.21.15.117:0/4181151521 conn(0x7fc5c406b1f0 msgr2=0x7fc5c40bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:27.917 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.917+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/4181151521 shutdown_connections 2023-07-19T20:45:27.917 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.917+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/4181151521 wait complete. 2023-07-19T20:45:27.919 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.918+0000 7fc5cbf5f700 1 Processor -- start 2023-07-19T20:45:27.920 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.918+0000 7fc5cbf5f700 1 -- start start 2023-07-19T20:45:27.920 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.919+0000 7fc5cbf5f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5b0003a30 0x7fc5c4144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.920 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.919+0000 7fc5cbf5f700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc5c4142290 0x7fc5c40b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.920 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.919+0000 7fc5cbf5f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5c406f950 0x7fc5c41d0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.919+0000 7fc5cbf5f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c41e1800 con 0x7fc5b0003a30 2023-07-19T20:45:27.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.919+0000 7fc5cbf5f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40b78a0 con 0x7fc5c406f950 2023-07-19T20:45:27.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.919+0000 7fc5cbf5f700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c413d5d0 con 0x7fc5c4142290 2023-07-19T20:45:27.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.919+0000 7fc5c9cfb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5b0003a30 0x7fc5c4144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.919+0000 7fc5c9cfb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5b0003a30 0x7fc5c4144510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47432/0 (socket says 172.21.15.117:47432) 2023-07-19T20:45:27.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.919+0000 7fc5c9cfb700 1 -- 172.21.15.117:0/320054418 learned_addr learned my addr 172.21.15.117:0/320054418 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:27.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.919+0000 7fc5c94fa700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc5c4142290 0x7fc5c40b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.921 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.919+0000 7fc5ca4fc700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5c406f950 0x7fc5c41d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.922 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.920+0000 7fc5c9cfb700 1 -- 172.21.15.117:0/320054418 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc5c4142290 msgr2=0x7fc5c40b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:27.922 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.920+0000 7fc5c9cfb700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc5c4142290 0x7fc5c40b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.922 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.920+0000 7fc5c9cfb700 1 -- 172.21.15.117:0/320054418 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5c406f950 msgr2=0x7fc5c41d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:27.922 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.920+0000 7fc5c9cfb700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5c406f950 0x7fc5c41d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:27.922 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.920+0000 7fc5c9cfb700 1 -- 172.21.15.117:0/320054418 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c41e1c20 con 0x7fc5b0003a30 2023-07-19T20:45:27.922 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.920+0000 7fc5ca4fc700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5c406f950 0x7fc5c41d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:27.922 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.920+0000 7fc5c9cfb700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5b0003a30 0x7fc5c4144510 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4001930 tx=0x7fc5b4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:27.923 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.920+0000 7fc5ba7fc700 1 -- 172.21.15.117:0/320054418 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4001660 con 0x7fc5b0003a30 2023-07-19T20:45:27.923 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.920+0000 7fc5ba7fc700 1 -- 172.21.15.117:0/320054418 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b4004a80 con 0x7fc5b0003a30 2023-07-19T20:45:27.923 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.920+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/320054418 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c41e0e60 con 0x7fc5b0003a30 2023-07-19T20:45:27.923 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.920+0000 7fc5ba7fc700 1 -- 172.21.15.117:0/320054418 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4004e30 con 0x7fc5b0003a30 2023-07-19T20:45:27.923 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.920+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/320054418 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c41e1420 con 0x7fc5b0003a30 2023-07-19T20:45:27.923 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.921+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/320054418 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c4074890 con 0x7fc5b0003a30 2023-07-19T20:45:27.923 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.922+0000 7fc5ba7fc700 1 -- 172.21.15.117:0/320054418 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7fc5b40070d0 con 0x7fc5b0003a30 2023-07-19T20:45:27.923 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.922+0000 7fc5ba7fc700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc5a806a660 0x7fc5a806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:27.924 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.922+0000 7fc5ba7fc700 1 -- 172.21.15.117:0/320054418 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc5b408a330 con 0x7fc5b0003a30 2023-07-19T20:45:27.924 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.922+0000 7fc5c94fa700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc5a806a660 0x7fc5a806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:27.924 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.922+0000 7fc5c94fa700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc5a806a660 0x7fc5a806cb10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40b7e10 tx=0x7fc5c0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:27.924 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:27.926+0000 7fc5ba7fc700 1 -- 172.21.15.117:0/320054418 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fc5b4055960 con 0x7fc5b0003a30 2023-07-19T20:45:28.106 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.112+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/320054418 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5c41e1a70 con 0x7fc5b0003a30 2023-07-19T20:45:28.107 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.113+0000 7fc5ba7fc700 1 -- 172.21.15.117:0/320054418 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+17969 (secure 0 0 0) 0x7fc5b4007da0 con 0x7fc5b0003a30 2023-07-19T20:45:28.107 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:28.108 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":33,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","created":"2023-07-19T20:44:19.969861+0000","modified":"2023-07-19T20:45:25.384444+0000","last_up_change":"2023-07-19T20:44:30.104224+0000","last_in_change":"2023-07-19T20:44:22.543491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-19T20:44:31.325778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-19T20:44:31.728215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-19T20:45:22.668739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-19T20:45:23.348232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba167591-6958-4ea1-9575-8c134f47ca2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":146436},{"type":"v1","addr":"172.21.15.117:6822","nonce":146436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":146436},{"type":"v1","addr":"172.21.15.117:6826","nonce":146436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":146436},{"type":"v1","addr":"172.21.15.117:6831","nonce":146436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":146436},{"type":"v1","addr":"172.21.15.117:6829","nonce":146436}]},"public_addr":"172.21.15.117:6822/146436","cluster_addr":"172.21.15.117:6826/146436","heartbeat_back_addr":"172.21.15.117:6831/146436","heartbeat_front_addr":"172.21.15.117:6829/146436","state":["exists","up"]},{"osd":1,"uuid":"a7edc950-d9a1-4925-86bc-0ebc219286e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":146435},{"type":"v1","addr":"172.21.15.117:6801","nonce":146435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":146435},{"type":"v1","addr":"172.21.15.117:6803","nonce":146435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":146435},{"type":"v1","addr":"172.21.15.117:6807","nonce":146435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":146435},{"type":"v1","addr":"172.21.15.117:6805","nonce":146435}]},"public_addr":"172.21.15.117:6801/146435","cluster_addr":"172.21.15.117:6803/146435","heartbeat_back_addr":"172.21.15.117:6807/146435","heartbeat_front_addr":"172.21.15.117:6805/146435","state":["exists","up"]},{"osd":2,"uuid":"4c86c33f-bb95-445e-a0ba-c0a3496f2950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":146434},{"type":"v1","addr":"172.21.15.117:6809","nonce":146434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":146434},{"type":"v1","addr":"172.21.15.117:6811","nonce":146434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":146434},{"type":"v1","addr":"172.21.15.117:6815","nonce":146434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":146434},{"type":"v1","addr":"172.21.15.117:6813","nonce":146434}]},"public_addr":"172.21.15.117:6809/146434","cluster_addr":"172.21.15.117:6811/146434","heartbeat_back_addr":"172.21.15.117:6815/146434","heartbeat_front_addr":"172.21.15.117:6813/146434","state":["exists","up"]},{"osd":3,"uuid":"0413180f-4fcb-489b-88f3-41aa9da56f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":146439},{"type":"v1","addr":"172.21.15.117:6817","nonce":146439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":146439},{"type":"v1","addr":"172.21.15.117:6819","nonce":146439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":146439},{"type":"v1","addr":"172.21.15.117:6827","nonce":146439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":146439},{"type":"v1","addr":"172.21.15.117:6823","nonce":146439}]},"public_addr":"172.21.15.117:6817/146439","cluster_addr":"172.21.15.117:6819/146439","heartbeat_back_addr":"172.21.15.117:6827/146439","heartbeat_front_addr":"172.21.15.117:6823/146439","state":["exists","up"]},{"osd":4,"uuid":"502d6efe-acca-481d-b687-77abcb04d6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6801","nonce":146672},{"type":"v1","addr":"172.21.15.124:6802","nonce":146672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":146672},{"type":"v1","addr":"172.21.15.124:6806","nonce":146672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":146672},{"type":"v1","addr":"172.21.15.124:6814","nonce":146672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":146672},{"type":"v1","addr":"172.21.15.124:6810","nonce":146672}]},"public_addr":"172.21.15.124:6802/146672","cluster_addr":"172.21.15.124:6806/146672","heartbeat_back_addr":"172.21.15.124:6814/146672","heartbeat_front_addr":"172.21.15.124:6810/146672","state":["exists","up"]},{"osd":5,"uuid":"b61c5e81-f13c-400b-a487-1ee6eee91e52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":146673},{"type":"v1","addr":"172.21.15.124:6803","nonce":146673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":146673},{"type":"v1","addr":"172.21.15.124:6807","nonce":146673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6813","nonce":146673},{"type":"v1","addr":"172.21.15.124:6815","nonce":146673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":146673},{"type":"v1","addr":"172.21.15.124:6811","nonce":146673}]},"public_addr":"172.21.15.124:6803/146673","cluster_addr":"172.21.15.124:6807/146673","heartbeat_back_addr":"172.21.15.124:6815/146673","heartbeat_front_addr":"172.21.15.124:6811/146673","state":["exists","up"]},{"osd":6,"uuid":"be4b9fa8-aee2-4782-87fd-be0d15345a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":146674},{"type":"v1","addr":"172.21.15.124:6817","nonce":146674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":146674},{"type":"v1","addr":"172.21.15.124:6819","nonce":146674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":146674},{"type":"v1","addr":"172.21.15.124:6823","nonce":146674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":146674},{"type":"v1","addr":"172.21.15.124:6821","nonce":146674}]},"public_addr":"172.21.15.124:6817/146674","cluster_addr":"172.21.15.124:6819/146674","heartbeat_back_addr":"172.21.15.124:6823/146674","heartbeat_front_addr":"172.21.15.124:6821/146674","state":["exists","up"]},{"osd":7,"uuid":"0da848ac-6f07-41b0-a967-204445959863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":146717},{"type":"v1","addr":"172.21.15.124:6825","nonce":146717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":146717},{"type":"v1","addr":"172.21.15.124:6827","nonce":146717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":146717},{"type":"v1","addr":"172.21.15.124:6831","nonce":146717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":146717},{"type":"v1","addr":"172.21.15.124:6829","nonce":146717}]},"public_addr":"172.21.15.124:6825/146717","cluster_addr":"172.21.15.124:6827/146717","heartbeat_back_addr":"172.21.15.124:6831/146717","heartbeat_front_addr":"172.21.15.124:6829/146717","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.688655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:29.362116+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.695399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.692433+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.722750+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.682765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.705228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-19T20:44:27.729849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-19T20:45:28.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.115+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/320054418 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc5a806a660 msgr2=0x7fc5a806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.115+0000 7fc5cbf5f700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc5a806a660 0x7fc5a806cb10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40b7e10 tx=0x7fc5c0009210 comp rx=0 tx=0).stop 2023-07-19T20:45:28.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.115+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/320054418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5b0003a30 msgr2=0x7fc5c4144510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.115+0000 7fc5cbf5f700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5b0003a30 0x7fc5c4144510 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4001930 tx=0x7fc5b4001a00 comp rx=0 tx=0).stop 2023-07-19T20:45:28.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.115+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/320054418 shutdown_connections 2023-07-19T20:45:28.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.115+0000 7fc5cbf5f700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7fc5a806a660 0x7fc5a806cb10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.115+0000 7fc5cbf5f700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5c406f950 0x7fc5c41d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.115+0000 7fc5cbf5f700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5b0003a30 0x7fc5c4144510 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.115+0000 7fc5cbf5f700 1 --2- 172.21.15.117:0/320054418 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc5c4142290 0x7fc5c40b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.115+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/320054418 >> 172.21.15.117:0/320054418 conn(0x7fc5c406b1f0 msgr2=0x7fc5c40b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:28.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.115+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/320054418 shutdown_connections 2023-07-19T20:45:28.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.115+0000 7fc5cbf5f700 1 -- 172.21.15.117:0/320054418 wait complete. 2023-07-19T20:45:28.121 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-19T20:45:28.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-19T20:45:28.243 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.249+0000 7f7e87817700 1 Processor -- start 2023-07-19T20:45:28.243 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.250+0000 7f7e87817700 1 -- start start 2023-07-19T20:45:28.245 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.250+0000 7f7e87817700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7e800c1470 0x7f7e800b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:28.245 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.250+0000 7f7e87817700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e8014a660 0x7f7e80155260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:28.245 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.250+0000 7f7e87817700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e800bcd00 con 0x7f7e800b9370 2023-07-19T20:45:28.245 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.250+0000 7f7e87817700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e800b8710 con 0x7f7e800c1470 2023-07-19T20:45:28.245 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.250+0000 7f7e87817700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e800b8bd0 con 0x7f7e8014a660 2023-07-19T20:45:28.246 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.251+0000 7f7e85db4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e8014a660 0x7f7e80155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:28.246 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.251+0000 7f7e855b3700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7e800c1470 0x7f7e800b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:28.246 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.251+0000 7f7e85db4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e8014a660 0x7f7e80155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:39206/0 (socket says 172.21.15.117:39206) 2023-07-19T20:45:28.246 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.251+0000 7f7e85db4700 1 -- 172.21.15.117:0/4095968569 learned_addr learned my addr 172.21.15.117:0/4095968569 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:28.246 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.251+0000 7f7e85db4700 1 -- 172.21.15.117:0/4095968569 >> v2:172.21.15.124:3300/0 conn(0x7f7e800c1470 msgr2=0x7f7e800b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:28.246 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.251+0000 7f7e85db4700 1 --2- 172.21.15.117:0/4095968569 >> v2:172.21.15.124:3300/0 conn(0x7f7e800c1470 0x7f7e800b8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.246 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.251+0000 7f7e85db4700 1 -- 172.21.15.117:0/4095968569 >> v1:172.21.15.124:6789/0 conn(0x7f7e800b9370 legacy=0x7f7e80149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.246 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.251+0000 7f7e85db4700 1 -- 172.21.15.117:0/4095968569 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e800bab50 con 0x7f7e8014a660 2023-07-19T20:45:28.247 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.251+0000 7f7e85db4700 1 --2- 172.21.15.117:0/4095968569 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e8014a660 0x7f7e80155260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009e50 tx=0x7f7e7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6966490bcf20d65 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:28.247 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.251+0000 7f7e77fff700 1 -- 172.21.15.117:0/4095968569 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800e070 con 0x7f7e8014a660 2023-07-19T20:45:28.247 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.251+0000 7f7e77fff700 1 -- 172.21.15.117:0/4095968569 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7800b910 con 0x7f7e8014a660 2023-07-19T20:45:28.247 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.251+0000 7f7e77fff700 1 -- 172.21.15.117:0/4095968569 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800bcc0 con 0x7f7e8014a660 2023-07-19T20:45:28.251 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.252+0000 7f7e87817700 1 -- 172.21.15.117:0/4095968569 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e8014a660 msgr2=0x7f7e80155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.251 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.252+0000 7f7e87817700 1 --2- 172.21.15.117:0/4095968569 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e8014a660 0x7f7e80155260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009e50 tx=0x7f7e7800b330 comp rx=0 tx=0).stop 2023-07-19T20:45:28.251 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.252+0000 7f7e87817700 1 -- 172.21.15.117:0/4095968569 shutdown_connections 2023-07-19T20:45:28.251 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.252+0000 7f7e87817700 1 --2- 172.21.15.117:0/4095968569 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e8014a660 0x7f7e80155260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.252 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.252+0000 7f7e87817700 1 --2- 172.21.15.117:0/4095968569 >> v2:172.21.15.124:3300/0 conn(0x7f7e800c1470 0x7f7e800b8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.252 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.252+0000 7f7e87817700 1 -- 172.21.15.117:0/4095968569 >> 172.21.15.117:0/4095968569 conn(0x7f7e80072920 msgr2=0x7f7e800c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:28.252 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.252+0000 7f7e87817700 1 -- 172.21.15.117:0/4095968569 shutdown_connections 2023-07-19T20:45:28.252 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.252+0000 7f7e87817700 1 -- 172.21.15.117:0/4095968569 wait complete. 2023-07-19T20:45:28.252 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.253+0000 7f7e87817700 1 Processor -- start 2023-07-19T20:45:28.254 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.253+0000 7f7e87817700 1 -- start start 2023-07-19T20:45:28.254 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e87817700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e800b9370 0x7f7e800b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:28.254 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e87817700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e800c1470 0x7f7e801d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:28.254 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e87817700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e8014a660 0x7f7e80144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:28.254 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e87817700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e800b63c0 con 0x7f7e800b9370 2023-07-19T20:45:28.254 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e87817700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e801d6130 con 0x7f7e800c1470 2023-07-19T20:45:28.254 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e87817700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e801d0f80 con 0x7f7e8014a660 2023-07-19T20:45:28.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e855b3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e800b9370 0x7f7e800b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:28.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e855b3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e800b9370 0x7f7e800b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47448/0 (socket says 172.21.15.117:47448) 2023-07-19T20:45:28.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e855b3700 1 -- 172.21.15.117:0/504941291 learned_addr learned my addr 172.21.15.117:0/504941291 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:28.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e84db2700 1 --2- 172.21.15.117:0/504941291 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e800c1470 0x7f7e801d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:28.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e85db4700 1 --2- 172.21.15.117:0/504941291 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e8014a660 0x7f7e80144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:28.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e855b3700 1 -- 172.21.15.117:0/504941291 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e8014a660 msgr2=0x7f7e80144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e855b3700 1 --2- 172.21.15.117:0/504941291 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e8014a660 0x7f7e80144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.256 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e855b3700 1 -- 172.21.15.117:0/504941291 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e800c1470 msgr2=0x7f7e801d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.256 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e855b3700 1 --2- 172.21.15.117:0/504941291 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e800c1470 0x7f7e801d0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.256 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e855b3700 1 -- 172.21.15.117:0/504941291 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e78009b30 con 0x7f7e800b9370 2023-07-19T20:45:28.256 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e855b3700 1 --2- 172.21.15.117:0/504941291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e800b9370 0x7f7e800b5e80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00e9b0 tx=0x7f7e7c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:28.256 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e75ffb700 1 -- 172.21.15.117:0/504941291 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c009710 con 0x7f7e800b9370 2023-07-19T20:45:28.256 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e75ffb700 1 -- 172.21.15.117:0/504941291 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c00ee50 con 0x7f7e800b9370 2023-07-19T20:45:28.257 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.254+0000 7f7e75ffb700 1 -- 172.21.15.117:0/504941291 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c00ca50 con 0x7f7e800b9370 2023-07-19T20:45:28.257 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.255+0000 7f7e87817700 1 -- 172.21.15.117:0/504941291 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e80149950 con 0x7f7e800b9370 2023-07-19T20:45:28.257 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.255+0000 7f7e87817700 1 -- 172.21.15.117:0/504941291 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e801e31c0 con 0x7f7e800b9370 2023-07-19T20:45:28.257 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.256+0000 7f7e87817700 1 -- 172.21.15.117:0/504941291 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e801e2d40 con 0x7f7e800b9370 2023-07-19T20:45:28.257 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.256+0000 7f7e75ffb700 1 -- 172.21.15.117:0/504941291 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f7e7c00cbb0 con 0x7f7e800b9370 2023-07-19T20:45:28.257 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.256+0000 7f7e75ffb700 1 --2- 172.21.15.117:0/504941291 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7e6406a660 0x7f7e6406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:28.258 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.256+0000 7f7e75ffb700 1 -- 172.21.15.117:0/504941291 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e7c088a70 con 0x7f7e800b9370 2023-07-19T20:45:28.258 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.256+0000 7f7e84db2700 1 --2- 172.21.15.117:0/504941291 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7e6406a660 0x7f7e6406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:28.258 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.257+0000 7f7e84db2700 1 --2- 172.21.15.117:0/504941291 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7e6406a660 0x7f7e6406cb10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7e800b41b0 tx=0x7f7e70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:28.258 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.261+0000 7f7e75ffb700 1 -- 172.21.15.117:0/504941291 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7e801e2d40 con 0x7f7e800b9370 2023-07-19T20:45:28.438 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.444+0000 7f7e87817700 1 -- 172.21.15.117:0/504941291 --> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e8006a960 con 0x7f7e6406a660 2023-07-19T20:45:28.446 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.452+0000 7f7e75ffb700 1 -- 172.21.15.117:0/504941291 <== mgr.4107 v2:172.21.15.117:6832/146126 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286891 (secure 0 0 0) 0x7f7e70001560 con 0x7f7e6406a660 2023-07-19T20:45:28.449 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:28.450 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.455+0000 7f7e87817700 1 -- 172.21.15.117:0/504941291 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7e6406a660 msgr2=0x7f7e6406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.450 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.455+0000 7f7e87817700 1 --2- 172.21.15.117:0/504941291 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7e6406a660 0x7f7e6406cb10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7e800b41b0 tx=0x7f7e70009040 comp rx=0 tx=0).stop 2023-07-19T20:45:28.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.455+0000 7f7e87817700 1 -- 172.21.15.117:0/504941291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e800b9370 msgr2=0x7f7e800b5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.455+0000 7f7e87817700 1 --2- 172.21.15.117:0/504941291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e800b9370 0x7f7e800b5e80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00e9b0 tx=0x7f7e7c00ecc0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.455+0000 7f7e87817700 1 -- 172.21.15.117:0/504941291 shutdown_connections 2023-07-19T20:45:28.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.455+0000 7f7e87817700 1 --2- 172.21.15.117:0/504941291 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f7e6406a660 0x7f7e6406cb10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.455+0000 7f7e87817700 1 --2- 172.21.15.117:0/504941291 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e8014a660 0x7f7e80144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.455+0000 7f7e87817700 1 --2- 172.21.15.117:0/504941291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e800b9370 0x7f7e800b5e80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.451 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.456+0000 7f7e87817700 1 --2- 172.21.15.117:0/504941291 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e800c1470 0x7f7e801d0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.456+0000 7f7e87817700 1 -- 172.21.15.117:0/504941291 >> 172.21.15.117:0/504941291 conn(0x7f7e80072920 msgr2=0x7f7e800bea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:28.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.456+0000 7f7e87817700 1 -- 172.21.15.117:0/504941291 shutdown_connections 2023-07-19T20:45:28.452 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.456+0000 7f7e87817700 1 -- 172.21.15.117:0/504941291 wait complete. 2023-07-19T20:45:28.452 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2023-07-19T20:45:28.462 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-07-19T20:45:27.695942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219640,"kb_used_data":4024,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755080,"statfs":{"total":773094113280,"available":772869201920,"internally_reserved":0,"allocated":4120576,"data_stored":2339036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.713414"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391997+0000","last_change":"2023-07-19T20:45:24.399143+0000","last_active":"2023-07-19T20:45:25.391997+0000","last_peered":"2023-07-19T20:45:25.391997+0000","last_clean":"2023-07-19T20:45:25.391997+0000","last_became_active":"2023-07-19T20:45:24.398902+0000","last_became_peered":"2023-07-19T20:45:24.398902+0000","last_unstale":"2023-07-19T20:45:25.391997+0000","last_undegraded":"2023-07-19T20:45:25.391997+0000","last_fullsized":"2023-07-19T20:45:25.391997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:10:53.202958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391818+0000","last_change":"2023-07-19T20:45:24.404631+0000","last_active":"2023-07-19T20:45:25.391818+0000","last_peered":"2023-07-19T20:45:25.391818+0000","last_clean":"2023-07-19T20:45:25.391818+0000","last_became_active":"2023-07-19T20:45:24.404357+0000","last_became_peered":"2023-07-19T20:45:24.404357+0000","last_unstale":"2023-07-19T20:45:25.391818+0000","last_undegraded":"2023-07-19T20:45:25.391818+0000","last_fullsized":"2023-07-19T20:45:25.391818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:07:21.898747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.406341+0000","last_change":"2023-07-19T20:45:24.405231+0000","last_active":"2023-07-19T20:45:24.406341+0000","last_peered":"2023-07-19T20:45:24.406341+0000","last_clean":"2023-07-19T20:45:24.406341+0000","last_became_active":"2023-07-19T20:45:24.404949+0000","last_became_peered":"2023-07-19T20:45:24.404949+0000","last_unstale":"2023-07-19T20:45:24.406341+0000","last_undegraded":"2023-07-19T20:45:24.406341+0000","last_fullsized":"2023-07-19T20:45:24.406341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:12:25.703062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.414343+0000","last_change":"2023-07-19T20:45:24.412694+0000","last_active":"2023-07-19T20:45:24.414343+0000","last_peered":"2023-07-19T20:45:24.414343+0000","last_clean":"2023-07-19T20:45:24.414343+0000","last_became_active":"2023-07-19T20:45:24.412445+0000","last_became_peered":"2023-07-19T20:45:24.412445+0000","last_unstale":"2023-07-19T20:45:24.414343+0000","last_undegraded":"2023-07-19T20:45:24.414343+0000","last_fullsized":"2023-07-19T20:45:24.414343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:57:13.516312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.411847+0000","last_change":"2023-07-19T20:45:24.404663+0000","last_active":"2023-07-19T20:45:24.411847+0000","last_peered":"2023-07-19T20:45:24.411847+0000","last_clean":"2023-07-19T20:45:24.411847+0000","last_became_active":"2023-07-19T20:45:24.402920+0000","last_became_peered":"2023-07-19T20:45:24.402920+0000","last_unstale":"2023-07-19T20:45:24.411847+0000","last_undegraded":"2023-07-19T20:45:24.411847+0000","last_fullsized":"2023-07-19T20:45:24.411847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:34:25.896006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.401379+0000","last_change":"2023-07-19T20:45:24.400832+0000","last_active":"2023-07-19T20:45:24.401379+0000","last_peered":"2023-07-19T20:45:24.401379+0000","last_clean":"2023-07-19T20:45:24.401379+0000","last_became_active":"2023-07-19T20:45:24.400622+0000","last_became_peered":"2023-07-19T20:45:24.400622+0000","last_unstale":"2023-07-19T20:45:24.401379+0000","last_undegraded":"2023-07-19T20:45:24.401379+0000","last_fullsized":"2023-07-19T20:45:24.401379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:36:08.846684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390536+0000","last_change":"2023-07-19T20:45:24.406203+0000","last_active":"2023-07-19T20:45:25.390536+0000","last_peered":"2023-07-19T20:45:25.390536+0000","last_clean":"2023-07-19T20:45:25.390536+0000","last_became_active":"2023-07-19T20:45:24.405920+0000","last_became_peered":"2023-07-19T20:45:24.405920+0000","last_unstale":"2023-07-19T20:45:25.390536+0000","last_undegraded":"2023-07-19T20:45:25.390536+0000","last_fullsized":"2023-07-19T20:45:25.390536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:07:21.898747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391594+0000","last_change":"2023-07-19T20:45:24.396462+0000","last_active":"2023-07-19T20:45:25.391594+0000","last_peered":"2023-07-19T20:45:25.391594+0000","last_clean":"2023-07-19T20:45:25.391594+0000","last_became_active":"2023-07-19T20:45:24.396210+0000","last_became_peered":"2023-07-19T20:45:24.396210+0000","last_unstale":"2023-07-19T20:45:25.391594+0000","last_undegraded":"2023-07-19T20:45:25.391594+0000","last_fullsized":"2023-07-19T20:45:25.391594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:16:21.260694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.398465+0000","last_change":"2023-07-19T20:45:24.396328+0000","last_active":"2023-07-19T20:45:24.398465+0000","last_peered":"2023-07-19T20:45:24.398465+0000","last_clean":"2023-07-19T20:45:24.398465+0000","last_became_active":"2023-07-19T20:45:24.396069+0000","last_became_peered":"2023-07-19T20:45:24.396069+0000","last_unstale":"2023-07-19T20:45:24.398465+0000","last_undegraded":"2023-07-19T20:45:24.398465+0000","last_fullsized":"2023-07-19T20:45:24.398465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:25:18.765616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391483+0000","last_change":"2023-07-19T20:45:24.406863+0000","last_active":"2023-07-19T20:45:25.391483+0000","last_peered":"2023-07-19T20:45:25.391483+0000","last_clean":"2023-07-19T20:45:25.391483+0000","last_became_active":"2023-07-19T20:45:24.406581+0000","last_became_peered":"2023-07-19T20:45:24.406581+0000","last_unstale":"2023-07-19T20:45:25.391483+0000","last_undegraded":"2023-07-19T20:45:25.391483+0000","last_fullsized":"2023-07-19T20:45:25.391483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:25:41.220126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391146+0000","last_change":"2023-07-19T20:45:24.403306+0000","last_active":"2023-07-19T20:45:25.391146+0000","last_peered":"2023-07-19T20:45:25.391146+0000","last_clean":"2023-07-19T20:45:25.391146+0000","last_became_active":"2023-07-19T20:45:24.402631+0000","last_became_peered":"2023-07-19T20:45:24.402631+0000","last_unstale":"2023-07-19T20:45:25.391146+0000","last_undegraded":"2023-07-19T20:45:25.391146+0000","last_fullsized":"2023-07-19T20:45:25.391146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:01:10.625888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.404461+0000","last_change":"2023-07-19T20:45:24.402435+0000","last_active":"2023-07-19T20:45:24.404461+0000","last_peered":"2023-07-19T20:45:24.404461+0000","last_clean":"2023-07-19T20:45:24.404461+0000","last_became_active":"2023-07-19T20:45:24.402185+0000","last_became_peered":"2023-07-19T20:45:24.402185+0000","last_unstale":"2023-07-19T20:45:24.404461+0000","last_undegraded":"2023-07-19T20:45:24.404461+0000","last_fullsized":"2023-07-19T20:45:24.404461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:25:41.220126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390980+0000","last_change":"2023-07-19T20:45:24.407103+0000","last_active":"2023-07-19T20:45:25.390980+0000","last_peered":"2023-07-19T20:45:25.390980+0000","last_clean":"2023-07-19T20:45:25.390980+0000","last_became_active":"2023-07-19T20:45:24.406819+0000","last_became_peered":"2023-07-19T20:45:24.406819+0000","last_unstale":"2023-07-19T20:45:25.390980+0000","last_undegraded":"2023-07-19T20:45:25.390980+0000","last_fullsized":"2023-07-19T20:45:25.390980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:10:41.848465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390545+0000","last_change":"2023-07-19T20:45:24.411427+0000","last_active":"2023-07-19T20:45:25.390545+0000","last_peered":"2023-07-19T20:45:25.390545+0000","last_clean":"2023-07-19T20:45:25.390545+0000","last_became_active":"2023-07-19T20:45:24.411136+0000","last_became_peered":"2023-07-19T20:45:24.411136+0000","last_unstale":"2023-07-19T20:45:25.390545+0000","last_undegraded":"2023-07-19T20:45:25.390545+0000","last_fullsized":"2023-07-19T20:45:25.390545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:56:16.159993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390078+0000","last_change":"2023-07-19T20:45:24.399199+0000","last_active":"2023-07-19T20:45:25.390078+0000","last_peered":"2023-07-19T20:45:25.390078+0000","last_clean":"2023-07-19T20:45:25.390078+0000","last_became_active":"2023-07-19T20:45:24.398911+0000","last_became_peered":"2023-07-19T20:45:24.398911+0000","last_unstale":"2023-07-19T20:45:25.390078+0000","last_undegraded":"2023-07-19T20:45:25.390078+0000","last_fullsized":"2023-07-19T20:45:25.390078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:43:26.720724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.720923+0000","last_change":"2023-07-19T20:45:24.415431+0000","last_active":"2023-07-19T20:45:25.720923+0000","last_peered":"2023-07-19T20:45:25.720923+0000","last_clean":"2023-07-19T20:45:25.720923+0000","last_became_active":"2023-07-19T20:45:24.415148+0000","last_became_peered":"2023-07-19T20:45:24.415148+0000","last_unstale":"2023-07-19T20:45:25.720923+0000","last_undegraded":"2023-07-19T20:45:25.720923+0000","last_fullsized":"2023-07-19T20:45:25.720923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:55:52.728537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721293+0000","last_change":"2023-07-19T20:45:24.415222+0000","last_active":"2023-07-19T20:45:25.721293+0000","last_peered":"2023-07-19T20:45:25.721293+0000","last_clean":"2023-07-19T20:45:25.721293+0000","last_became_active":"2023-07-19T20:45:24.414948+0000","last_became_peered":"2023-07-19T20:45:24.414948+0000","last_unstale":"2023-07-19T20:45:25.721293+0000","last_undegraded":"2023-07-19T20:45:25.721293+0000","last_fullsized":"2023-07-19T20:45:25.721293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:25:41.220126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.413087+0000","last_change":"2023-07-19T20:45:24.408911+0000","last_active":"2023-07-19T20:45:24.413087+0000","last_peered":"2023-07-19T20:45:24.413087+0000","last_clean":"2023-07-19T20:45:24.413087+0000","last_became_active":"2023-07-19T20:45:24.408494+0000","last_became_peered":"2023-07-19T20:45:24.408494+0000","last_unstale":"2023-07-19T20:45:24.413087+0000","last_undegraded":"2023-07-19T20:45:24.413087+0000","last_fullsized":"2023-07-19T20:45:24.413087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T20:58:36.217136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.411884+0000","last_change":"2023-07-19T20:45:24.410394+0000","last_active":"2023-07-19T20:45:24.411884+0000","last_peered":"2023-07-19T20:45:24.411884+0000","last_clean":"2023-07-19T20:45:24.411884+0000","last_became_active":"2023-07-19T20:45:24.410044+0000","last_became_peered":"2023-07-19T20:45:24.410044+0000","last_unstale":"2023-07-19T20:45:24.411884+0000","last_undegraded":"2023-07-19T20:45:24.411884+0000","last_fullsized":"2023-07-19T20:45:24.411884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:14:02.012710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.412907+0000","last_change":"2023-07-19T20:45:24.409127+0000","last_active":"2023-07-19T20:45:24.412907+0000","last_peered":"2023-07-19T20:45:24.412907+0000","last_clean":"2023-07-19T20:45:24.412907+0000","last_became_active":"2023-07-19T20:45:24.408477+0000","last_became_peered":"2023-07-19T20:45:24.408477+0000","last_unstale":"2023-07-19T20:45:24.412907+0000","last_undegraded":"2023-07-19T20:45:24.412907+0000","last_fullsized":"2023-07-19T20:45:24.412907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:36:08.846684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391142+0000","last_change":"2023-07-19T20:45:24.401726+0000","last_active":"2023-07-19T20:45:25.391142+0000","last_peered":"2023-07-19T20:45:25.391142+0000","last_clean":"2023-07-19T20:45:25.391142+0000","last_became_active":"2023-07-19T20:45:24.401454+0000","last_became_peered":"2023-07-19T20:45:24.401454+0000","last_unstale":"2023-07-19T20:45:25.391142+0000","last_undegraded":"2023-07-19T20:45:25.391142+0000","last_fullsized":"2023-07-19T20:45:25.391142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:12:25.703062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390349+0000","last_change":"2023-07-19T20:45:24.403342+0000","last_active":"2023-07-19T20:45:25.390349+0000","last_peered":"2023-07-19T20:45:25.390349+0000","last_clean":"2023-07-19T20:45:25.390349+0000","last_became_active":"2023-07-19T20:45:24.403051+0000","last_became_peered":"2023-07-19T20:45:24.403051+0000","last_unstale":"2023-07-19T20:45:25.390349+0000","last_undegraded":"2023-07-19T20:45:25.390349+0000","last_fullsized":"2023-07-19T20:45:25.390349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:14:05.320776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721053+0000","last_change":"2023-07-19T20:45:24.413329+0000","last_active":"2023-07-19T20:45:25.721053+0000","last_peered":"2023-07-19T20:45:25.721053+0000","last_clean":"2023-07-19T20:45:25.721053+0000","last_became_active":"2023-07-19T20:45:24.413067+0000","last_became_peered":"2023-07-19T20:45:24.413067+0000","last_unstale":"2023-07-19T20:45:25.721053+0000","last_undegraded":"2023-07-19T20:45:25.721053+0000","last_fullsized":"2023-07-19T20:45:25.721053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:25:18.765616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.412938+0000","last_change":"2023-07-19T20:45:24.412257+0000","last_active":"2023-07-19T20:45:24.412938+0000","last_peered":"2023-07-19T20:45:24.412938+0000","last_clean":"2023-07-19T20:45:24.412938+0000","last_became_active":"2023-07-19T20:45:24.411836+0000","last_became_peered":"2023-07-19T20:45:24.411836+0000","last_unstale":"2023-07-19T20:45:24.412938+0000","last_undegraded":"2023-07-19T20:45:24.412938+0000","last_fullsized":"2023-07-19T20:45:24.412938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:44:37.542202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.413189+0000","last_change":"2023-07-19T20:45:24.408896+0000","last_active":"2023-07-19T20:45:24.413189+0000","last_peered":"2023-07-19T20:45:24.413189+0000","last_clean":"2023-07-19T20:45:24.413189+0000","last_became_active":"2023-07-19T20:45:24.408255+0000","last_became_peered":"2023-07-19T20:45:24.408255+0000","last_unstale":"2023-07-19T20:45:24.413189+0000","last_undegraded":"2023-07-19T20:45:24.413189+0000","last_fullsized":"2023-07-19T20:45:24.413189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:57:13.516312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.413964+0000","last_change":"2023-07-19T20:45:24.410764+0000","last_active":"2023-07-19T20:45:24.413964+0000","last_peered":"2023-07-19T20:45:24.413964+0000","last_clean":"2023-07-19T20:45:24.413964+0000","last_became_active":"2023-07-19T20:45:24.410520+0000","last_became_peered":"2023-07-19T20:45:24.410520+0000","last_unstale":"2023-07-19T20:45:24.413964+0000","last_undegraded":"2023-07-19T20:45:24.413964+0000","last_fullsized":"2023-07-19T20:45:24.413964+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:24:18.972463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.418003+0000","last_change":"2023-07-19T20:45:24.412739+0000","last_active":"2023-07-19T20:45:24.418003+0000","last_peered":"2023-07-19T20:45:24.418003+0000","last_clean":"2023-07-19T20:45:24.418003+0000","last_became_active":"2023-07-19T20:45:24.412499+0000","last_became_peered":"2023-07-19T20:45:24.412499+0000","last_unstale":"2023-07-19T20:45:24.418003+0000","last_undegraded":"2023-07-19T20:45:24.418003+0000","last_fullsized":"2023-07-19T20:45:24.418003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:30:53.102605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390152+0000","last_change":"2023-07-19T20:45:24.405038+0000","last_active":"2023-07-19T20:45:25.390152+0000","last_peered":"2023-07-19T20:45:25.390152+0000","last_clean":"2023-07-19T20:45:25.390152+0000","last_became_active":"2023-07-19T20:45:24.404764+0000","last_became_peered":"2023-07-19T20:45:24.404764+0000","last_unstale":"2023-07-19T20:45:25.390152+0000","last_undegraded":"2023-07-19T20:45:25.390152+0000","last_fullsized":"2023-07-19T20:45:25.390152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:10:03.774290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.412956+0000","last_change":"2023-07-19T20:45:24.407292+0000","last_active":"2023-07-19T20:45:24.412956+0000","last_peered":"2023-07-19T20:45:24.412956+0000","last_clean":"2023-07-19T20:45:24.412956+0000","last_became_active":"2023-07-19T20:45:24.407038+0000","last_became_peered":"2023-07-19T20:45:24.407038+0000","last_unstale":"2023-07-19T20:45:24.412956+0000","last_undegraded":"2023-07-19T20:45:24.412956+0000","last_fullsized":"2023-07-19T20:45:24.412956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:08:43.082205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.413009+0000","last_change":"2023-07-19T20:45:24.407732+0000","last_active":"2023-07-19T20:45:24.413009+0000","last_peered":"2023-07-19T20:45:24.413009+0000","last_clean":"2023-07-19T20:45:24.413009+0000","last_became_active":"2023-07-19T20:45:24.407462+0000","last_became_peered":"2023-07-19T20:45:24.407462+0000","last_unstale":"2023-07-19T20:45:24.413009+0000","last_undegraded":"2023-07-19T20:45:24.413009+0000","last_fullsized":"2023-07-19T20:45:24.413009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:34:25.896006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721001+0000","last_change":"2023-07-19T20:45:24.412337+0000","last_active":"2023-07-19T20:45:25.721001+0000","last_peered":"2023-07-19T20:45:25.721001+0000","last_clean":"2023-07-19T20:45:25.721001+0000","last_became_active":"2023-07-19T20:45:24.412063+0000","last_became_peered":"2023-07-19T20:45:24.412063+0000","last_unstale":"2023-07-19T20:45:25.721001+0000","last_undegraded":"2023-07-19T20:45:25.721001+0000","last_fullsized":"2023-07-19T20:45:25.721001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:10:03.774290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.405180+0000","last_change":"2023-07-19T20:45:24.403095+0000","last_active":"2023-07-19T20:45:24.405180+0000","last_peered":"2023-07-19T20:45:24.405180+0000","last_clean":"2023-07-19T20:45:24.405180+0000","last_became_active":"2023-07-19T20:45:24.402868+0000","last_became_peered":"2023-07-19T20:45:24.402868+0000","last_unstale":"2023-07-19T20:45:24.405180+0000","last_undegraded":"2023-07-19T20:45:24.405180+0000","last_fullsized":"2023-07-19T20:45:24.405180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:30:53.102605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721316+0000","last_change":"2023-07-19T20:45:24.415437+0000","last_active":"2023-07-19T20:45:25.721316+0000","last_peered":"2023-07-19T20:45:25.721316+0000","last_clean":"2023-07-19T20:45:25.721316+0000","last_became_active":"2023-07-19T20:45:24.415161+0000","last_became_peered":"2023-07-19T20:45:24.415161+0000","last_unstale":"2023-07-19T20:45:25.721316+0000","last_undegraded":"2023-07-19T20:45:25.721316+0000","last_fullsized":"2023-07-19T20:45:25.721316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:43:26.720724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.418088+0000","last_change":"2023-07-19T20:45:24.000047+0000","last_active":"2023-07-19T20:45:24.418088+0000","last_peered":"2023-07-19T20:45:24.418088+0000","last_clean":"2023-07-19T20:45:24.418088+0000","last_became_active":"2023-07-19T20:45:23.999775+0000","last_became_peered":"2023-07-19T20:45:23.999775+0000","last_unstale":"2023-07-19T20:45:24.418088+0000","last_undegraded":"2023-07-19T20:45:24.418088+0000","last_fullsized":"2023-07-19T20:45:24.418088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:50:48.227491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.414119+0000","last_change":"2023-07-19T20:45:24.411945+0000","last_active":"2023-07-19T20:45:24.414119+0000","last_peered":"2023-07-19T20:45:24.414119+0000","last_clean":"2023-07-19T20:45:24.414119+0000","last_became_active":"2023-07-19T20:45:24.411756+0000","last_became_peered":"2023-07-19T20:45:24.411756+0000","last_unstale":"2023-07-19T20:45:24.414119+0000","last_undegraded":"2023-07-19T20:45:24.414119+0000","last_fullsized":"2023-07-19T20:45:24.414119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:12:28.101468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.406513+0000","last_change":"2023-07-19T20:45:23.997011+0000","last_active":"2023-07-19T20:45:24.406513+0000","last_peered":"2023-07-19T20:45:24.406513+0000","last_clean":"2023-07-19T20:45:24.406513+0000","last_became_active":"2023-07-19T20:45:23.996734+0000","last_became_peered":"2023-07-19T20:45:23.996734+0000","last_unstale":"2023-07-19T20:45:24.406513+0000","last_undegraded":"2023-07-19T20:45:24.406513+0000","last_fullsized":"2023-07-19T20:45:24.406513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:42:42.789583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390567+0000","last_change":"2023-07-19T20:45:24.409840+0000","last_active":"2023-07-19T20:45:25.390567+0000","last_peered":"2023-07-19T20:45:25.390567+0000","last_clean":"2023-07-19T20:45:25.390567+0000","last_became_active":"2023-07-19T20:45:24.409339+0000","last_became_peered":"2023-07-19T20:45:24.409339+0000","last_unstale":"2023-07-19T20:45:25.390567+0000","last_undegraded":"2023-07-19T20:45:25.390567+0000","last_fullsized":"2023-07-19T20:45:25.390567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:00:23.950242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.414072+0000","last_change":"2023-07-19T20:45:24.004599+0000","last_active":"2023-07-19T20:45:24.414072+0000","last_peered":"2023-07-19T20:45:24.414072+0000","last_clean":"2023-07-19T20:45:24.414072+0000","last_became_active":"2023-07-19T20:45:24.004334+0000","last_became_peered":"2023-07-19T20:45:24.004334+0000","last_unstale":"2023-07-19T20:45:24.414072+0000","last_undegraded":"2023-07-19T20:45:24.414072+0000","last_fullsized":"2023-07-19T20:45:24.414072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:43:12.013245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391807+0000","last_change":"2023-07-19T20:45:24.411882+0000","last_active":"2023-07-19T20:45:25.391807+0000","last_peered":"2023-07-19T20:45:25.391807+0000","last_clean":"2023-07-19T20:45:25.391807+0000","last_became_active":"2023-07-19T20:45:24.411542+0000","last_became_peered":"2023-07-19T20:45:24.411542+0000","last_unstale":"2023-07-19T20:45:25.391807+0000","last_undegraded":"2023-07-19T20:45:25.391807+0000","last_fullsized":"2023-07-19T20:45:25.391807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:33:50.523963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390633+0000","last_change":"2023-07-19T20:45:24.002572+0000","last_active":"2023-07-19T20:45:25.390633+0000","last_peered":"2023-07-19T20:45:25.390633+0000","last_clean":"2023-07-19T20:45:25.390633+0000","last_became_active":"2023-07-19T20:45:24.002288+0000","last_became_peered":"2023-07-19T20:45:24.002288+0000","last_unstale":"2023-07-19T20:45:25.390633+0000","last_undegraded":"2023-07-19T20:45:25.390633+0000","last_fullsized":"2023-07-19T20:45:25.390633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:13:59.622732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.406615+0000","last_change":"2023-07-19T20:45:24.406090+0000","last_active":"2023-07-19T20:45:24.406615+0000","last_peered":"2023-07-19T20:45:24.406615+0000","last_clean":"2023-07-19T20:45:24.406615+0000","last_became_active":"2023-07-19T20:45:24.405819+0000","last_became_peered":"2023-07-19T20:45:24.405819+0000","last_unstale":"2023-07-19T20:45:24.406615+0000","last_undegraded":"2023-07-19T20:45:24.406615+0000","last_fullsized":"2023-07-19T20:45:24.406615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:10:41.848465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"32'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391077+0000","last_change":"2023-07-19T20:45:23.997566+0000","last_active":"2023-07-19T20:45:25.391077+0000","last_peered":"2023-07-19T20:45:25.391077+0000","last_clean":"2023-07-19T20:45:25.391077+0000","last_became_active":"2023-07-19T20:45:23.996970+0000","last_became_peered":"2023-07-19T20:45:23.996970+0000","last_unstale":"2023-07-19T20:45:25.391077+0000","last_undegraded":"2023-07-19T20:45:25.391077+0000","last_fullsized":"2023-07-19T20:45:25.391077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:06:31.362206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390377+0000","last_change":"2023-07-19T20:45:24.402377+0000","last_active":"2023-07-19T20:45:25.390377+0000","last_peered":"2023-07-19T20:45:25.390377+0000","last_clean":"2023-07-19T20:45:25.390377+0000","last_became_active":"2023-07-19T20:45:24.402104+0000","last_became_peered":"2023-07-19T20:45:24.402104+0000","last_unstale":"2023-07-19T20:45:25.390377+0000","last_undegraded":"2023-07-19T20:45:25.390377+0000","last_fullsized":"2023-07-19T20:45:25.390377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:43:14.171374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"32'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721223+0000","last_change":"2023-07-19T20:45:24.004837+0000","last_active":"2023-07-19T20:45:25.721223+0000","last_peered":"2023-07-19T20:45:25.721223+0000","last_clean":"2023-07-19T20:45:25.721223+0000","last_became_active":"2023-07-19T20:45:24.004531+0000","last_became_peered":"2023-07-19T20:45:24.004531+0000","last_unstale":"2023-07-19T20:45:25.721223+0000","last_undegraded":"2023-07-19T20:45:25.721223+0000","last_fullsized":"2023-07-19T20:45:25.721223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:06:31.362206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390338+0000","last_change":"2023-07-19T20:45:24.402273+0000","last_active":"2023-07-19T20:45:25.390338+0000","last_peered":"2023-07-19T20:45:25.390338+0000","last_clean":"2023-07-19T20:45:25.390338+0000","last_became_active":"2023-07-19T20:45:24.401811+0000","last_became_peered":"2023-07-19T20:45:24.401811+0000","last_unstale":"2023-07-19T20:45:25.390338+0000","last_undegraded":"2023-07-19T20:45:25.390338+0000","last_fullsized":"2023-07-19T20:45:25.390338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:45:27.288078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.397361+0000","last_change":"2023-07-19T20:45:24.002033+0000","last_active":"2023-07-19T20:45:24.397361+0000","last_peered":"2023-07-19T20:45:24.397361+0000","last_clean":"2023-07-19T20:45:24.397361+0000","last_became_active":"2023-07-19T20:45:24.001831+0000","last_became_peered":"2023-07-19T20:45:24.001831+0000","last_unstale":"2023-07-19T20:45:24.397361+0000","last_undegraded":"2023-07-19T20:45:24.397361+0000","last_fullsized":"2023-07-19T20:45:24.397361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:43:46.194354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391837+0000","last_change":"2023-07-19T20:45:24.405824+0000","last_active":"2023-07-19T20:45:25.391837+0000","last_peered":"2023-07-19T20:45:25.391837+0000","last_clean":"2023-07-19T20:45:25.391837+0000","last_became_active":"2023-07-19T20:45:24.405531+0000","last_became_peered":"2023-07-19T20:45:24.405531+0000","last_unstale":"2023-07-19T20:45:25.391837+0000","last_undegraded":"2023-07-19T20:45:25.391837+0000","last_fullsized":"2023-07-19T20:45:25.391837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:58:17.309821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390254+0000","last_change":"2023-07-19T20:45:24.000623+0000","last_active":"2023-07-19T20:45:25.390254+0000","last_peered":"2023-07-19T20:45:25.390254+0000","last_clean":"2023-07-19T20:45:25.390254+0000","last_became_active":"2023-07-19T20:45:24.000374+0000","last_became_peered":"2023-07-19T20:45:24.000374+0000","last_unstale":"2023-07-19T20:45:25.390254+0000","last_undegraded":"2023-07-19T20:45:25.390254+0000","last_fullsized":"2023-07-19T20:45:25.390254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:50:40.422081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.414322+0000","last_change":"2023-07-19T20:45:24.412584+0000","last_active":"2023-07-19T20:45:24.414322+0000","last_peered":"2023-07-19T20:45:24.414322+0000","last_clean":"2023-07-19T20:45:24.414322+0000","last_became_active":"2023-07-19T20:45:24.412294+0000","last_became_peered":"2023-07-19T20:45:24.412294+0000","last_unstale":"2023-07-19T20:45:24.414322+0000","last_undegraded":"2023-07-19T20:45:24.414322+0000","last_fullsized":"2023-07-19T20:45:24.414322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:21:22.353776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391938+0000","last_change":"2023-07-19T20:45:23.997386+0000","last_active":"2023-07-19T20:45:25.391938+0000","last_peered":"2023-07-19T20:45:25.391938+0000","last_clean":"2023-07-19T20:45:25.391938+0000","last_became_active":"2023-07-19T20:45:23.997127+0000","last_became_peered":"2023-07-19T20:45:23.997127+0000","last_unstale":"2023-07-19T20:45:25.391938+0000","last_undegraded":"2023-07-19T20:45:25.391938+0000","last_fullsized":"2023-07-19T20:45:25.391938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:39:56.761677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721368+0000","last_change":"2023-07-19T20:45:24.411917+0000","last_active":"2023-07-19T20:45:25.721368+0000","last_peered":"2023-07-19T20:45:25.721368+0000","last_clean":"2023-07-19T20:45:25.721368+0000","last_became_active":"2023-07-19T20:45:24.411650+0000","last_became_peered":"2023-07-19T20:45:24.411650+0000","last_unstale":"2023-07-19T20:45:25.721368+0000","last_undegraded":"2023-07-19T20:45:25.721368+0000","last_fullsized":"2023-07-19T20:45:25.721368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:12:25.703062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391592+0000","last_change":"2023-07-19T20:45:23.999376+0000","last_active":"2023-07-19T20:45:25.391592+0000","last_peered":"2023-07-19T20:45:25.391592+0000","last_clean":"2023-07-19T20:45:25.391592+0000","last_became_active":"2023-07-19T20:45:23.999046+0000","last_became_peered":"2023-07-19T20:45:23.999046+0000","last_unstale":"2023-07-19T20:45:25.391592+0000","last_undegraded":"2023-07-19T20:45:25.391592+0000","last_fullsized":"2023-07-19T20:45:25.391592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:08:14.490724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.407627+0000","last_change":"2023-07-19T20:45:24.406955+0000","last_active":"2023-07-19T20:45:24.407627+0000","last_peered":"2023-07-19T20:45:24.407627+0000","last_clean":"2023-07-19T20:45:24.407627+0000","last_became_active":"2023-07-19T20:45:24.406733+0000","last_became_peered":"2023-07-19T20:45:24.406733+0000","last_unstale":"2023-07-19T20:45:24.407627+0000","last_undegraded":"2023-07-19T20:45:24.407627+0000","last_fullsized":"2023-07-19T20:45:24.407627+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:46:12.931341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"32'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391195+0000","last_change":"2023-07-19T20:45:24.002714+0000","last_active":"2023-07-19T20:45:25.391195+0000","last_peered":"2023-07-19T20:45:25.391195+0000","last_clean":"2023-07-19T20:45:25.391195+0000","last_became_active":"2023-07-19T20:45:24.002431+0000","last_became_peered":"2023-07-19T20:45:24.002431+0000","last_unstale":"2023-07-19T20:45:25.391195+0000","last_undegraded":"2023-07-19T20:45:25.391195+0000","last_fullsized":"2023-07-19T20:45:25.391195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:34:15.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391187+0000","last_change":"2023-07-19T20:45:24.403765+0000","last_active":"2023-07-19T20:45:25.391187+0000","last_peered":"2023-07-19T20:45:25.391187+0000","last_clean":"2023-07-19T20:45:25.391187+0000","last_became_active":"2023-07-19T20:45:24.402995+0000","last_became_peered":"2023-07-19T20:45:24.402995+0000","last_unstale":"2023-07-19T20:45:25.391187+0000","last_undegraded":"2023-07-19T20:45:25.391187+0000","last_fullsized":"2023-07-19T20:45:25.391187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:49:25.866235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"32'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391860+0000","last_change":"2023-07-19T20:45:24.001819+0000","last_active":"2023-07-19T20:45:25.391860+0000","last_peered":"2023-07-19T20:45:25.391860+0000","last_clean":"2023-07-19T20:45:25.391860+0000","last_became_active":"2023-07-19T20:45:24.001578+0000","last_became_peered":"2023-07-19T20:45:24.001578+0000","last_unstale":"2023-07-19T20:45:25.391860+0000","last_undegraded":"2023-07-19T20:45:25.391860+0000","last_fullsized":"2023-07-19T20:45:25.391860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:30:13.882308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.398503+0000","last_change":"2023-07-19T20:45:24.396814+0000","last_active":"2023-07-19T20:45:24.398503+0000","last_peered":"2023-07-19T20:45:24.398503+0000","last_clean":"2023-07-19T20:45:24.398503+0000","last_became_active":"2023-07-19T20:45:24.396581+0000","last_became_peered":"2023-07-19T20:45:24.396581+0000","last_unstale":"2023-07-19T20:45:24.398503+0000","last_undegraded":"2023-07-19T20:45:24.398503+0000","last_fullsized":"2023-07-19T20:45:24.398503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:32:13.690684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391927+0000","last_change":"2023-07-19T20:45:24.003430+0000","last_active":"2023-07-19T20:45:25.391927+0000","last_peered":"2023-07-19T20:45:25.391927+0000","last_clean":"2023-07-19T20:45:25.391927+0000","last_became_active":"2023-07-19T20:45:24.002623+0000","last_became_peered":"2023-07-19T20:45:24.002623+0000","last_unstale":"2023-07-19T20:45:25.391927+0000","last_undegraded":"2023-07-19T20:45:25.391927+0000","last_fullsized":"2023-07-19T20:45:25.391927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:40:01.536994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.392072+0000","last_change":"2023-07-19T20:45:24.399472+0000","last_active":"2023-07-19T20:45:25.392072+0000","last_peered":"2023-07-19T20:45:25.392072+0000","last_clean":"2023-07-19T20:45:25.392072+0000","last_became_active":"2023-07-19T20:45:24.399218+0000","last_became_peered":"2023-07-19T20:45:24.399218+0000","last_unstale":"2023-07-19T20:45:25.392072+0000","last_undegraded":"2023-07-19T20:45:25.392072+0000","last_fullsized":"2023-07-19T20:45:25.392072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:09:24.894596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.396262+0000","last_change":"2023-07-19T20:45:24.000346+0000","last_active":"2023-07-19T20:45:24.396262+0000","last_peered":"2023-07-19T20:45:24.396262+0000","last_clean":"2023-07-19T20:45:24.396262+0000","last_became_active":"2023-07-19T20:45:23.999926+0000","last_became_peered":"2023-07-19T20:45:23.999926+0000","last_unstale":"2023-07-19T20:45:24.396262+0000","last_undegraded":"2023-07-19T20:45:24.396262+0000","last_fullsized":"2023-07-19T20:45:24.396262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:32:31.842917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721048+0000","last_change":"2023-07-19T20:45:24.414428+0000","last_active":"2023-07-19T20:45:25.721048+0000","last_peered":"2023-07-19T20:45:25.721048+0000","last_clean":"2023-07-19T20:45:25.721048+0000","last_became_active":"2023-07-19T20:45:24.414161+0000","last_became_peered":"2023-07-19T20:45:24.414161+0000","last_unstale":"2023-07-19T20:45:25.721048+0000","last_undegraded":"2023-07-19T20:45:25.721048+0000","last_fullsized":"2023-07-19T20:45:25.721048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:32:13.690684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.396192+0000","last_change":"2023-07-19T20:45:24.003330+0000","last_active":"2023-07-19T20:45:24.396192+0000","last_peered":"2023-07-19T20:45:24.396192+0000","last_clean":"2023-07-19T20:45:24.396192+0000","last_became_active":"2023-07-19T20:45:24.003012+0000","last_became_peered":"2023-07-19T20:45:24.003012+0000","last_unstale":"2023-07-19T20:45:24.396192+0000","last_undegraded":"2023-07-19T20:45:24.396192+0000","last_fullsized":"2023-07-19T20:45:24.396192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:44:28.254565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391740+0000","last_change":"2023-07-19T20:45:24.399125+0000","last_active":"2023-07-19T20:45:25.391740+0000","last_peered":"2023-07-19T20:45:25.391740+0000","last_clean":"2023-07-19T20:45:25.391740+0000","last_became_active":"2023-07-19T20:45:24.398881+0000","last_became_peered":"2023-07-19T20:45:24.398881+0000","last_unstale":"2023-07-19T20:45:25.391740+0000","last_undegraded":"2023-07-19T20:45:25.391740+0000","last_fullsized":"2023-07-19T20:45:25.391740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:37:29.651664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'8","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721179+0000","last_change":"2023-07-19T20:45:24.003649+0000","last_active":"2023-07-19T20:45:25.721179+0000","last_peered":"2023-07-19T20:45:25.721179+0000","last_clean":"2023-07-19T20:45:25.721179+0000","last_became_active":"2023-07-19T20:45:24.003417+0000","last_became_peered":"2023-07-19T20:45:24.003417+0000","last_unstale":"2023-07-19T20:45:25.721179+0000","last_undegraded":"2023-07-19T20:45:25.721179+0000","last_fullsized":"2023-07-19T20:45:25.721179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:34:15.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391875+0000","last_change":"2023-07-19T20:45:24.408079+0000","last_active":"2023-07-19T20:45:25.391875+0000","last_peered":"2023-07-19T20:45:25.391875+0000","last_clean":"2023-07-19T20:45:25.391875+0000","last_became_active":"2023-07-19T20:45:24.407822+0000","last_became_peered":"2023-07-19T20:45:24.407822+0000","last_unstale":"2023-07-19T20:45:25.391875+0000","last_undegraded":"2023-07-19T20:45:25.391875+0000","last_fullsized":"2023-07-19T20:45:25.391875+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:10:03.774290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390979+0000","last_change":"2023-07-19T20:45:23.998164+0000","last_active":"2023-07-19T20:45:25.390979+0000","last_peered":"2023-07-19T20:45:25.390979+0000","last_clean":"2023-07-19T20:45:25.390979+0000","last_became_active":"2023-07-19T20:45:23.997893+0000","last_became_peered":"2023-07-19T20:45:23.997893+0000","last_unstale":"2023-07-19T20:45:25.390979+0000","last_undegraded":"2023-07-19T20:45:25.390979+0000","last_fullsized":"2023-07-19T20:45:25.390979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:06:04.751696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391084+0000","last_change":"2023-07-19T20:45:24.404432+0000","last_active":"2023-07-19T20:45:25.391084+0000","last_peered":"2023-07-19T20:45:25.391084+0000","last_clean":"2023-07-19T20:45:25.391084+0000","last_became_active":"2023-07-19T20:45:24.404184+0000","last_became_peered":"2023-07-19T20:45:24.404184+0000","last_unstale":"2023-07-19T20:45:25.391084+0000","last_undegraded":"2023-07-19T20:45:25.391084+0000","last_fullsized":"2023-07-19T20:45:25.391084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:16:21.260694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390768+0000","last_change":"2023-07-19T20:45:24.000332+0000","last_active":"2023-07-19T20:45:25.390768+0000","last_peered":"2023-07-19T20:45:25.390768+0000","last_clean":"2023-07-19T20:45:25.390768+0000","last_became_active":"2023-07-19T20:45:24.000041+0000","last_became_peered":"2023-07-19T20:45:24.000041+0000","last_unstale":"2023-07-19T20:45:25.390768+0000","last_undegraded":"2023-07-19T20:45:25.390768+0000","last_fullsized":"2023-07-19T20:45:25.390768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:23:26.998443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390676+0000","last_change":"2023-07-19T20:45:24.402419+0000","last_active":"2023-07-19T20:45:25.390676+0000","last_peered":"2023-07-19T20:45:25.390676+0000","last_clean":"2023-07-19T20:45:25.390676+0000","last_became_active":"2023-07-19T20:45:24.402149+0000","last_became_peered":"2023-07-19T20:45:24.402149+0000","last_unstale":"2023-07-19T20:45:25.390676+0000","last_undegraded":"2023-07-19T20:45:25.390676+0000","last_fullsized":"2023-07-19T20:45:25.390676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:25:54.857116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.410234+0000","last_change":"2023-07-19T20:45:23.999221+0000","last_active":"2023-07-19T20:45:24.410234+0000","last_peered":"2023-07-19T20:45:24.410234+0000","last_clean":"2023-07-19T20:45:24.410234+0000","last_became_active":"2023-07-19T20:45:23.998973+0000","last_became_peered":"2023-07-19T20:45:23.998973+0000","last_unstale":"2023-07-19T20:45:24.410234+0000","last_undegraded":"2023-07-19T20:45:24.410234+0000","last_fullsized":"2023-07-19T20:45:24.410234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:36:20.349126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.411759+0000","last_change":"2023-07-19T20:45:24.402382+0000","last_active":"2023-07-19T20:45:24.411759+0000","last_peered":"2023-07-19T20:45:24.411759+0000","last_clean":"2023-07-19T20:45:24.411759+0000","last_became_active":"2023-07-19T20:45:24.402140+0000","last_became_peered":"2023-07-19T20:45:24.402140+0000","last_unstale":"2023-07-19T20:45:24.411759+0000","last_undegraded":"2023-07-19T20:45:24.411759+0000","last_fullsized":"2023-07-19T20:45:24.411759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:32:32.851673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.397073+0000","last_change":"2023-07-19T20:45:23.996849+0000","last_active":"2023-07-19T20:45:24.397073+0000","last_peered":"2023-07-19T20:45:24.397073+0000","last_clean":"2023-07-19T20:45:24.397073+0000","last_became_active":"2023-07-19T20:45:23.996590+0000","last_became_peered":"2023-07-19T20:45:23.996590+0000","last_unstale":"2023-07-19T20:45:24.397073+0000","last_undegraded":"2023-07-19T20:45:24.397073+0000","last_fullsized":"2023-07-19T20:45:24.397073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:11:01.461690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.720980+0000","last_change":"2023-07-19T20:45:24.414472+0000","last_active":"2023-07-19T20:45:25.720980+0000","last_peered":"2023-07-19T20:45:25.720980+0000","last_clean":"2023-07-19T20:45:25.720980+0000","last_became_active":"2023-07-19T20:45:24.413930+0000","last_became_peered":"2023-07-19T20:45:24.413930+0000","last_unstale":"2023-07-19T20:45:25.720980+0000","last_undegraded":"2023-07-19T20:45:25.720980+0000","last_fullsized":"2023-07-19T20:45:25.720980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:43:14.171374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.404802+0000","last_change":"2023-07-19T20:45:24.001552+0000","last_active":"2023-07-19T20:45:24.404802+0000","last_peered":"2023-07-19T20:45:24.404802+0000","last_clean":"2023-07-19T20:45:24.404802+0000","last_became_active":"2023-07-19T20:45:24.001331+0000","last_became_peered":"2023-07-19T20:45:24.001331+0000","last_unstale":"2023-07-19T20:45:24.404802+0000","last_undegraded":"2023-07-19T20:45:24.404802+0000","last_fullsized":"2023-07-19T20:45:24.404802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:57:03.405855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.407634+0000","last_change":"2023-07-19T20:45:24.407056+0000","last_active":"2023-07-19T20:45:24.407634+0000","last_peered":"2023-07-19T20:45:24.407634+0000","last_clean":"2023-07-19T20:45:24.407634+0000","last_became_active":"2023-07-19T20:45:24.406795+0000","last_became_peered":"2023-07-19T20:45:24.406795+0000","last_unstale":"2023-07-19T20:45:24.407634+0000","last_undegraded":"2023-07-19T20:45:24.407634+0000","last_fullsized":"2023-07-19T20:45:24.407634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:55:52.728537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.390959+0000","last_change":"2023-07-19T20:45:23.998695+0000","last_active":"2023-07-19T20:45:24.390959+0000","last_peered":"2023-07-19T20:45:24.390959+0000","last_clean":"2023-07-19T20:45:24.390959+0000","last_became_active":"2023-07-19T20:45:23.998418+0000","last_became_peered":"2023-07-19T20:45:23.998418+0000","last_unstale":"2023-07-19T20:45:24.390959+0000","last_undegraded":"2023-07-19T20:45:24.390959+0000","last_fullsized":"2023-07-19T20:45:24.390959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:34:27.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390859+0000","last_change":"2023-07-19T20:45:24.408250+0000","last_active":"2023-07-19T20:45:25.390859+0000","last_peered":"2023-07-19T20:45:25.390859+0000","last_clean":"2023-07-19T20:45:25.390859+0000","last_became_active":"2023-07-19T20:45:24.408031+0000","last_became_peered":"2023-07-19T20:45:24.408031+0000","last_unstale":"2023-07-19T20:45:25.390859+0000","last_undegraded":"2023-07-19T20:45:25.390859+0000","last_fullsized":"2023-07-19T20:45:25.390859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:54:25.000020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721128+0000","last_change":"2023-07-19T20:45:23.998085+0000","last_active":"2023-07-19T20:45:25.721128+0000","last_peered":"2023-07-19T20:45:25.721128+0000","last_clean":"2023-07-19T20:45:25.721128+0000","last_became_active":"2023-07-19T20:45:23.997823+0000","last_became_peered":"2023-07-19T20:45:23.997823+0000","last_unstale":"2023-07-19T20:45:25.721128+0000","last_undegraded":"2023-07-19T20:45:25.721128+0000","last_fullsized":"2023-07-19T20:45:25.721128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:29:33.566430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391998+0000","last_change":"2023-07-19T20:45:24.405212+0000","last_active":"2023-07-19T20:45:25.391998+0000","last_peered":"2023-07-19T20:45:25.391998+0000","last_clean":"2023-07-19T20:45:25.391998+0000","last_became_active":"2023-07-19T20:45:24.404980+0000","last_became_peered":"2023-07-19T20:45:24.404980+0000","last_unstale":"2023-07-19T20:45:25.391998+0000","last_undegraded":"2023-07-19T20:45:25.391998+0000","last_fullsized":"2023-07-19T20:45:25.391998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T20:55:03.798131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.390481+0000","last_change":"2023-07-19T20:45:24.003965+0000","last_active":"2023-07-19T20:45:24.390481+0000","last_peered":"2023-07-19T20:45:24.390481+0000","last_clean":"2023-07-19T20:45:24.390481+0000","last_became_active":"2023-07-19T20:45:24.003682+0000","last_became_peered":"2023-07-19T20:45:24.003682+0000","last_unstale":"2023-07-19T20:45:24.390481+0000","last_undegraded":"2023-07-19T20:45:24.390481+0000","last_fullsized":"2023-07-19T20:45:24.390481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:45:21.375657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390645+0000","last_change":"2023-07-19T20:45:24.402104+0000","last_active":"2023-07-19T20:45:25.390645+0000","last_peered":"2023-07-19T20:45:25.390645+0000","last_clean":"2023-07-19T20:45:25.390645+0000","last_became_active":"2023-07-19T20:45:24.401494+0000","last_became_peered":"2023-07-19T20:45:24.401494+0000","last_unstale":"2023-07-19T20:45:25.390645+0000","last_undegraded":"2023-07-19T20:45:25.390645+0000","last_fullsized":"2023-07-19T20:45:25.390645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:20:17.786230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391040+0000","last_change":"2023-07-19T20:45:23.999169+0000","last_active":"2023-07-19T20:45:25.391040+0000","last_peered":"2023-07-19T20:45:25.391040+0000","last_clean":"2023-07-19T20:45:25.391040+0000","last_became_active":"2023-07-19T20:45:23.998862+0000","last_became_peered":"2023-07-19T20:45:23.998862+0000","last_unstale":"2023-07-19T20:45:25.391040+0000","last_undegraded":"2023-07-19T20:45:25.391040+0000","last_fullsized":"2023-07-19T20:45:25.391040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:23:28.594043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.390523+0000","last_change":"2023-07-19T20:44:33.123673+0000","last_active":"2023-07-19T20:45:24.390523+0000","last_peered":"2023-07-19T20:45:24.390523+0000","last_clean":"2023-07-19T20:45:24.390523+0000","last_became_active":"2023-07-19T20:44:33.123400+0000","last_became_peered":"2023-07-19T20:44:33.123400+0000","last_unstale":"2023-07-19T20:45:24.390523+0000","last_undegraded":"2023-07-19T20:45:24.390523+0000","last_fullsized":"2023-07-19T20:45:24.390523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:29:32.159769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721472+0000","last_change":"2023-07-19T20:45:24.412317+0000","last_active":"2023-07-19T20:45:25.721472+0000","last_peered":"2023-07-19T20:45:25.721472+0000","last_clean":"2023-07-19T20:45:25.721472+0000","last_became_active":"2023-07-19T20:45:24.411559+0000","last_became_peered":"2023-07-19T20:45:24.411559+0000","last_unstale":"2023-07-19T20:45:25.721472+0000","last_undegraded":"2023-07-19T20:45:25.721472+0000","last_fullsized":"2023-07-19T20:45:25.721472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:01:10.625888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391636+0000","last_change":"2023-07-19T20:45:24.000380+0000","last_active":"2023-07-19T20:45:25.391636+0000","last_peered":"2023-07-19T20:45:25.391636+0000","last_clean":"2023-07-19T20:45:25.391636+0000","last_became_active":"2023-07-19T20:45:24.000141+0000","last_became_peered":"2023-07-19T20:45:24.000141+0000","last_unstale":"2023-07-19T20:45:25.391636+0000","last_undegraded":"2023-07-19T20:45:25.391636+0000","last_fullsized":"2023-07-19T20:45:25.391636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:03.369424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.390348+0000","last_change":"2023-07-19T20:44:33.124105+0000","last_active":"2023-07-19T20:45:24.390348+0000","last_peered":"2023-07-19T20:45:24.390348+0000","last_clean":"2023-07-19T20:45:24.390348+0000","last_became_active":"2023-07-19T20:44:33.123795+0000","last_became_peered":"2023-07-19T20:44:33.123795+0000","last_unstale":"2023-07-19T20:45:24.390348+0000","last_undegraded":"2023-07-19T20:45:24.390348+0000","last_fullsized":"2023-07-19T20:45:24.390348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:14:19.759142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.413992+0000","last_change":"2023-07-19T20:45:24.410828+0000","last_active":"2023-07-19T20:45:24.413992+0000","last_peered":"2023-07-19T20:45:24.413992+0000","last_clean":"2023-07-19T20:45:24.413992+0000","last_became_active":"2023-07-19T20:45:24.410586+0000","last_became_peered":"2023-07-19T20:45:24.410586+0000","last_unstale":"2023-07-19T20:45:24.413992+0000","last_undegraded":"2023-07-19T20:45:24.413992+0000","last_fullsized":"2023-07-19T20:45:24.413992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:47:23.161714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391060+0000","last_change":"2023-07-19T20:45:23.998855+0000","last_active":"2023-07-19T20:45:25.391060+0000","last_peered":"2023-07-19T20:45:25.391060+0000","last_clean":"2023-07-19T20:45:25.391060+0000","last_became_active":"2023-07-19T20:45:23.998568+0000","last_became_peered":"2023-07-19T20:45:23.998568+0000","last_unstale":"2023-07-19T20:45:25.391060+0000","last_undegraded":"2023-07-19T20:45:25.391060+0000","last_fullsized":"2023-07-19T20:45:25.391060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:29:33.566430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-19T20:45:23.991557+0000","last_change":"2023-07-19T20:44:33.124619+0000","last_active":"2023-07-19T20:45:23.991557+0000","last_peered":"2023-07-19T20:45:23.991557+0000","last_clean":"2023-07-19T20:45:23.991557+0000","last_became_active":"2023-07-19T20:44:33.124278+0000","last_became_peered":"2023-07-19T20:44:33.124278+0000","last_unstale":"2023-07-19T20:45:23.991557+0000","last_undegraded":"2023-07-19T20:45:23.991557+0000","last_fullsized":"2023-07-19T20:45:23.991557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:57:12.956476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.402540+0000","last_change":"2023-07-19T20:44:33.129185+0000","last_active":"2023-07-19T20:45:24.402540+0000","last_peered":"2023-07-19T20:45:24.402540+0000","last_clean":"2023-07-19T20:45:24.402540+0000","last_became_active":"2023-07-19T20:44:33.128873+0000","last_became_peered":"2023-07-19T20:44:33.128873+0000","last_unstale":"2023-07-19T20:45:24.402540+0000","last_undegraded":"2023-07-19T20:45:24.402540+0000","last_fullsized":"2023-07-19T20:45:24.402540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:59:43.504158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721438+0000","last_change":"2023-07-19T20:45:24.412533+0000","last_active":"2023-07-19T20:45:25.721438+0000","last_peered":"2023-07-19T20:45:25.721438+0000","last_clean":"2023-07-19T20:45:25.721438+0000","last_became_active":"2023-07-19T20:45:24.411778+0000","last_became_peered":"2023-07-19T20:45:24.411778+0000","last_unstale":"2023-07-19T20:45:25.721438+0000","last_undegraded":"2023-07-19T20:45:25.721438+0000","last_fullsized":"2023-07-19T20:45:25.721438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:10:41.848465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.390830+0000","last_change":"2023-07-19T20:45:24.002028+0000","last_active":"2023-07-19T20:45:24.390830+0000","last_peered":"2023-07-19T20:45:24.390830+0000","last_clean":"2023-07-19T20:45:24.390830+0000","last_became_active":"2023-07-19T20:45:24.001785+0000","last_became_peered":"2023-07-19T20:45:24.001785+0000","last_unstale":"2023-07-19T20:45:24.390830+0000","last_undegraded":"2023-07-19T20:45:24.390830+0000","last_fullsized":"2023-07-19T20:45:24.390830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:47:41.710478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.400962+0000","last_change":"2023-07-19T20:44:33.746155+0000","last_active":"2023-07-19T20:45:24.400962+0000","last_peered":"2023-07-19T20:45:24.400962+0000","last_clean":"2023-07-19T20:45:24.400962+0000","last_became_active":"2023-07-19T20:44:33.745839+0000","last_became_peered":"2023-07-19T20:44:33.745839+0000","last_unstale":"2023-07-19T20:45:24.400962+0000","last_undegraded":"2023-07-19T20:45:24.400962+0000","last_fullsized":"2023-07-19T20:45:24.400962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:27:53.622247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390940+0000","last_change":"2023-07-19T20:45:24.405729+0000","last_active":"2023-07-19T20:45:25.390940+0000","last_peered":"2023-07-19T20:45:25.390940+0000","last_clean":"2023-07-19T20:45:25.390940+0000","last_became_active":"2023-07-19T20:45:24.405450+0000","last_became_peered":"2023-07-19T20:45:24.405450+0000","last_unstale":"2023-07-19T20:45:25.390940+0000","last_undegraded":"2023-07-19T20:45:25.390940+0000","last_fullsized":"2023-07-19T20:45:25.390940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:33:50.523963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721419+0000","last_change":"2023-07-19T20:45:24.004184+0000","last_active":"2023-07-19T20:45:25.721419+0000","last_peered":"2023-07-19T20:45:25.721419+0000","last_clean":"2023-07-19T20:45:25.721419+0000","last_became_active":"2023-07-19T20:45:24.003885+0000","last_became_peered":"2023-07-19T20:45:24.003885+0000","last_unstale":"2023-07-19T20:45:25.721419+0000","last_undegraded":"2023-07-19T20:45:25.721419+0000","last_fullsized":"2023-07-19T20:45:25.721419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:00:22.865793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.402456+0000","last_change":"2023-07-19T20:44:33.746397+0000","last_active":"2023-07-19T20:45:24.402456+0000","last_peered":"2023-07-19T20:45:24.402456+0000","last_clean":"2023-07-19T20:45:24.402456+0000","last_became_active":"2023-07-19T20:44:33.746140+0000","last_became_peered":"2023-07-19T20:44:33.746140+0000","last_unstale":"2023-07-19T20:45:24.402456+0000","last_undegraded":"2023-07-19T20:45:24.402456+0000","last_fullsized":"2023-07-19T20:45:24.402456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:56:34.826030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391911+0000","last_change":"2023-07-19T20:45:24.402514+0000","last_active":"2023-07-19T20:45:25.391911+0000","last_peered":"2023-07-19T20:45:25.391911+0000","last_clean":"2023-07-19T20:45:25.391911+0000","last_became_active":"2023-07-19T20:45:24.402284+0000","last_became_peered":"2023-07-19T20:45:24.402284+0000","last_unstale":"2023-07-19T20:45:25.391911+0000","last_undegraded":"2023-07-19T20:45:25.391911+0000","last_fullsized":"2023-07-19T20:45:25.391911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:54:25.000020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.387590+0000","last_change":"2023-07-19T20:45:24.002306+0000","last_active":"2023-07-19T20:45:24.387590+0000","last_peered":"2023-07-19T20:45:24.387590+0000","last_clean":"2023-07-19T20:45:24.387590+0000","last_became_active":"2023-07-19T20:45:24.002058+0000","last_became_peered":"2023-07-19T20:45:24.002058+0000","last_unstale":"2023-07-19T20:45:24.387590+0000","last_undegraded":"2023-07-19T20:45:24.387590+0000","last_fullsized":"2023-07-19T20:45:24.387590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:06:04.751696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.393924+0000","last_change":"2023-07-19T20:44:33.746552+0000","last_active":"2023-07-19T20:45:24.393924+0000","last_peered":"2023-07-19T20:45:24.393924+0000","last_clean":"2023-07-19T20:45:24.393924+0000","last_became_active":"2023-07-19T20:44:33.745934+0000","last_became_peered":"2023-07-19T20:44:33.745934+0000","last_unstale":"2023-07-19T20:45:24.393924+0000","last_undegraded":"2023-07-19T20:45:24.393924+0000","last_fullsized":"2023-07-19T20:45:24.393924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:19:16.931517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.413579+0000","last_change":"2023-07-19T20:45:24.410202+0000","last_active":"2023-07-19T20:45:24.413579+0000","last_peered":"2023-07-19T20:45:24.413579+0000","last_clean":"2023-07-19T20:45:24.413579+0000","last_became_active":"2023-07-19T20:45:24.409951+0000","last_became_peered":"2023-07-19T20:45:24.409951+0000","last_unstale":"2023-07-19T20:45:24.413579+0000","last_undegraded":"2023-07-19T20:45:24.413579+0000","last_fullsized":"2023-07-19T20:45:24.413579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T20:58:36.217136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.398733+0000","last_change":"2023-07-19T20:45:23.998984+0000","last_active":"2023-07-19T20:45:24.398733+0000","last_peered":"2023-07-19T20:45:24.398733+0000","last_clean":"2023-07-19T20:45:24.398733+0000","last_became_active":"2023-07-19T20:45:23.998707+0000","last_became_peered":"2023-07-19T20:45:23.998707+0000","last_unstale":"2023-07-19T20:45:24.398733+0000","last_undegraded":"2023-07-19T20:45:24.398733+0000","last_fullsized":"2023-07-19T20:45:24.398733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:11:01.461690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-19T20:45:23.993010+0000","last_change":"2023-07-19T20:44:33.746879+0000","last_active":"2023-07-19T20:45:23.993010+0000","last_peered":"2023-07-19T20:45:23.993010+0000","last_clean":"2023-07-19T20:45:23.993010+0000","last_became_active":"2023-07-19T20:44:33.746120+0000","last_became_peered":"2023-07-19T20:44:33.746120+0000","last_unstale":"2023-07-19T20:45:23.993010+0000","last_undegraded":"2023-07-19T20:45:23.993010+0000","last_fullsized":"2023-07-19T20:45:23.993010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:34:22.791863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.398488+0000","last_change":"2023-07-19T20:45:24.396350+0000","last_active":"2023-07-19T20:45:24.398488+0000","last_peered":"2023-07-19T20:45:24.398488+0000","last_clean":"2023-07-19T20:45:24.398488+0000","last_became_active":"2023-07-19T20:45:24.396103+0000","last_became_peered":"2023-07-19T20:45:24.396103+0000","last_unstale":"2023-07-19T20:45:24.398488+0000","last_undegraded":"2023-07-19T20:45:24.398488+0000","last_fullsized":"2023-07-19T20:45:24.398488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:43:26.720724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.387601+0000","last_change":"2023-07-19T20:45:23.999083+0000","last_active":"2023-07-19T20:45:24.387601+0000","last_peered":"2023-07-19T20:45:24.387601+0000","last_clean":"2023-07-19T20:45:24.387601+0000","last_became_active":"2023-07-19T20:45:23.998785+0000","last_became_peered":"2023-07-19T20:45:23.998785+0000","last_unstale":"2023-07-19T20:45:24.387601+0000","last_undegraded":"2023-07-19T20:45:24.387601+0000","last_fullsized":"2023-07-19T20:45:24.387601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:08:14.490724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-19T20:45:23.991781+0000","last_change":"2023-07-19T20:44:33.129202+0000","last_active":"2023-07-19T20:45:23.991781+0000","last_peered":"2023-07-19T20:45:23.991781+0000","last_clean":"2023-07-19T20:45:23.991781+0000","last_became_active":"2023-07-19T20:44:33.128920+0000","last_became_peered":"2023-07-19T20:44:33.128920+0000","last_unstale":"2023-07-19T20:45:23.991781+0000","last_undegraded":"2023-07-19T20:45:23.991781+0000","last_fullsized":"2023-07-19T20:45:23.991781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:43:18.861932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":966656,"data_stored":734776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":143356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":954368,"data_stored":733232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":142808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":141883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":151025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":376832,"data_stored":150031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":141925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-19T20:45:28.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-19T20:45:28.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.629+0000 7f2a6f592700 1 Processor -- start 2023-07-19T20:45:28.623 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.629+0000 7f2a6f592700 1 -- start start 2023-07-19T20:45:28.626 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.630+0000 7f2a6f592700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2a68154260 0x7f2a68156640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:28.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.630+0000 7f2a6f592700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a680bcd00 con 0x7f2a680c1470 2023-07-19T20:45:28.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.630+0000 7f2a6f592700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a680b8bd0 con 0x7f2a68149f50 2023-07-19T20:45:28.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.630+0000 7f2a6f592700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a680b8710 con 0x7f2a68154260 2023-07-19T20:45:28.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.630+0000 7f2a6d32e700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f2a680c1470 0x7f2a680b8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:43198/0 (socket says 172.21.15.117:43198) 2023-07-19T20:45:28.627 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.630+0000 7f2a6d32e700 1 -- 172.21.15.117:0/3040844038 learned_addr learned my addr 172.21.15.117:0/3040844038 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:28.628 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.630+0000 7f2a5ffff700 1 -- 172.21.15.117:0/3040844038 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797047454 0 0) 0x7f2a680bcd00 con 0x7f2a680c1470 2023-07-19T20:45:28.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.630+0000 7f2a6db2f700 1 --2- 172.21.15.117:0/3040844038 >> v2:172.21.15.124:3300/0 conn(0x7f2a68154260 0x7f2a68156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:28.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.630+0000 7f2a5ffff700 1 -- 172.21.15.117:0/3040844038 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a540035b0 con 0x7f2a680c1470 2023-07-19T20:45:28.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 -- 172.21.15.117:0/3040844038 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3143928393 0 0) 0x7f2a540035b0 con 0x7f2a680c1470 2023-07-19T20:45:28.629 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 -- 172.21.15.117:0/3040844038 >> v2:172.21.15.124:3300/0 conn(0x7f2a68154260 msgr2=0x7f2a68156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:28.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 --2- 172.21.15.117:0/3040844038 >> v2:172.21.15.124:3300/0 conn(0x7f2a68154260 0x7f2a68156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 -- 172.21.15.117:0/3040844038 >> v1:172.21.15.124:6789/0 conn(0x7f2a68149f50 legacy=0x7f2a6814a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 -- 172.21.15.117:0/3040844038 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a680bab50 con 0x7f2a680c1470 2023-07-19T20:45:28.630 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 -- 172.21.15.117:0/3040844038 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f2a58001670 con 0x7f2a680c1470 2023-07-19T20:45:28.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 -- 172.21.15.117:0/3040844038 >> v1:172.21.15.117:6789/0 conn(0x7f2a680c1470 legacy=0x7f2a680b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 --2- 172.21.15.117:0/3040844038 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2a54003a00 0x7f2a54003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:28.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 --2- 172.21.15.117:0/3040844038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a54004850 0x7f2a54004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:28.631 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 --2- 172.21.15.117:0/3040844038 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a54005200 0x7f2a5400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:28.632 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 -- 172.21.15.117:0/3040844038 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680b8710 con 0x7f2a54004850 2023-07-19T20:45:28.632 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 -- 172.21.15.117:0/3040844038 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5400c080 con 0x7f2a54005200 2023-07-19T20:45:28.632 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 -- 172.21.15.117:0/3040844038 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5400c240 con 0x7f2a54003a00 2023-07-19T20:45:28.632 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a6cb2d700 1 --2- 172.21.15.117:0/3040844038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a54004850 0x7f2a54004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:28.633 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a6d32e700 1 --2- 172.21.15.117:0/3040844038 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2a54003a00 0x7f2a54003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:28.633 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a6db2f700 1 --2- 172.21.15.117:0/3040844038 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a54005200 0x7f2a5400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:28.633 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a6cb2d700 1 -- 172.21.15.117:0/3040844038 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2a54003a00 msgr2=0x7f2a54003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:28.633 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a6cb2d700 1 --2- 172.21.15.117:0/3040844038 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2a54003a00 0x7f2a54003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.634 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a6cb2d700 1 -- 172.21.15.117:0/3040844038 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a54005200 msgr2=0x7f2a5400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:28.634 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a6cb2d700 1 --2- 172.21.15.117:0/3040844038 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a54005200 0x7f2a5400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.634 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a6cb2d700 1 -- 172.21.15.117:0/3040844038 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a540035b0 con 0x7f2a54004850 2023-07-19T20:45:28.634 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a6db2f700 1 -- 172.21.15.117:0/3040844038 reap_dead start 2023-07-19T20:45:28.635 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a6d32e700 1 --2- 172.21.15.117:0/3040844038 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2a54003a00 0x7f2a54003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:28.635 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a6cb2d700 1 --2- 172.21.15.117:0/3040844038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a54004850 0x7f2a54004cc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2a6814aae0 tx=0x7f2a54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77fd7f41679a5a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:28.635 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 -- 172.21.15.117:0/3040844038 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640052d0 con 0x7f2a54004850 2023-07-19T20:45:28.636 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 -- 172.21.15.117:0/3040844038 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a64005450 con 0x7f2a54004850 2023-07-19T20:45:28.636 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.631+0000 7f2a5ffff700 1 -- 172.21.15.117:0/3040844038 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640038c0 con 0x7f2a54004850 2023-07-19T20:45:28.636 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.632+0000 7f2a6f592700 1 -- 172.21.15.117:0/3040844038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a54004850 msgr2=0x7f2a54004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.637 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.632+0000 7f2a6f592700 1 --2- 172.21.15.117:0/3040844038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a54004850 0x7f2a54004cc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2a6814aae0 tx=0x7f2a54005880 comp rx=0 tx=0).stop 2023-07-19T20:45:28.637 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.632+0000 7f2a6f592700 1 -- 172.21.15.117:0/3040844038 shutdown_connections 2023-07-19T20:45:28.637 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.632+0000 7f2a6f592700 1 --2- 172.21.15.117:0/3040844038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a54004850 0x7f2a54004cc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.638 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.632+0000 7f2a6f592700 1 -- 172.21.15.117:0/3040844038 >> 172.21.15.117:0/3040844038 conn(0x7f2a68072920 msgr2=0x7f2a680c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:28.638 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.632+0000 7f2a6f592700 1 -- 172.21.15.117:0/3040844038 shutdown_connections 2023-07-19T20:45:28.638 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.632+0000 7f2a6f592700 1 -- 172.21.15.117:0/3040844038 wait complete. 2023-07-19T20:45:28.638 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.633+0000 7f2a6f592700 1 Processor -- start 2023-07-19T20:45:28.639 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.633+0000 7f2a6f592700 1 -- start start 2023-07-19T20:45:28.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6f592700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2a54004850 0x7f2a6814fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:28.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6f592700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a68151240 0x7f2a6814ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:28.643 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6f592700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a681e36d0 0x7f2a681e3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:28.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6f592700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6814d8d0 con 0x7f2a68151240 2023-07-19T20:45:28.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6f592700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6814d6c0 con 0x7f2a681e36d0 2023-07-19T20:45:28.644 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6f592700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a68150690 con 0x7f2a54004850 2023-07-19T20:45:28.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6cb2d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a68151240 0x7f2a6814ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:28.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6cb2d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a68151240 0x7f2a6814ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47462/0 (socket says 172.21.15.117:47462) 2023-07-19T20:45:28.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6cb2d700 1 -- 172.21.15.117:0/3840986262 learned_addr learned my addr 172.21.15.117:0/3840986262 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:28.645 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6d32e700 1 --2- 172.21.15.117:0/3840986262 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2a54004850 0x7f2a6814fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:28.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6db2f700 1 --2- 172.21.15.117:0/3840986262 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a681e36d0 0x7f2a681e3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:28.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6cb2d700 1 -- 172.21.15.117:0/3840986262 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2a54004850 msgr2=0x7f2a6814fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6cb2d700 1 --2- 172.21.15.117:0/3840986262 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2a54004850 0x7f2a6814fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6cb2d700 1 -- 172.21.15.117:0/3840986262 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a681e36d0 msgr2=0x7f2a681e3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6cb2d700 1 --2- 172.21.15.117:0/3840986262 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a681e36d0 0x7f2a681e3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.646 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6cb2d700 1 -- 172.21.15.117:0/3840986262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a68151770 con 0x7f2a68151240 2023-07-19T20:45:28.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a6cb2d700 1 --2- 172.21.15.117:0/3840986262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a68151240 0x7f2a6814ecc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2a64005040 tx=0x7f2a64001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:28.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a5dffb700 1 -- 172.21.15.117:0/3840986262 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64001290 con 0x7f2a68151240 2023-07-19T20:45:28.647 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a5dffb700 1 -- 172.21.15.117:0/3840986262 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a64007040 con 0x7f2a68151240 2023-07-19T20:45:28.648 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.634+0000 7f2a5dffb700 1 -- 172.21.15.117:0/3840986262 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640073f0 con 0x7f2a68151240 2023-07-19T20:45:28.648 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.635+0000 7f2a6f592700 1 -- 172.21.15.117:0/3840986262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6814e4c0 con 0x7f2a68151240 2023-07-19T20:45:28.648 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.635+0000 7f2a6f592700 1 -- 172.21.15.117:0/3840986262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a681503b0 con 0x7f2a68151240 2023-07-19T20:45:28.648 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.636+0000 7f2a6f592700 1 -- 172.21.15.117:0/3840986262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a680b7a10 con 0x7f2a68151240 2023-07-19T20:45:28.648 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.636+0000 7f2a5dffb700 1 -- 172.21.15.117:0/3840986262 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f2a64007550 con 0x7f2a68151240 2023-07-19T20:45:28.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.637+0000 7f2a5dffb700 1 --2- 172.21.15.117:0/3840986262 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2a4c06a660 0x7f2a4c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:28.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.637+0000 7f2a5dffb700 1 -- 172.21.15.117:0/3840986262 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a640891c0 con 0x7f2a68151240 2023-07-19T20:45:28.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.637+0000 7f2a6d32e700 1 --2- 172.21.15.117:0/3840986262 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2a4c06a660 0x7f2a4c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:28.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.637+0000 7f2a6d32e700 1 --2- 172.21.15.117:0/3840986262 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2a4c06a660 0x7f2a4c06cb10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2a58000c00 tx=0x7f2a58007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:28.649 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.641+0000 7f2a5dffb700 1 -- 172.21.15.117:0/3840986262 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2a64054650 con 0x7f2a68151240 2023-07-19T20:45:28.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.820+0000 7f2a6f592700 1 -- 172.21.15.117:0/3840986262 --> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a6806a960 con 0x7f2a4c06a660 2023-07-19T20:45:28.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.828+0000 7f2a5dffb700 1 -- 172.21.15.117:0/3840986262 <== mgr.4107 v2:172.21.15.117:6832/146126 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286891 (secure 0 0 0) 0x7f2a580049e0 con 0x7f2a4c06a660 2023-07-19T20:45:28.825 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:28.827 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.831+0000 7f2a6f592700 1 -- 172.21.15.117:0/3840986262 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2a4c06a660 msgr2=0x7f2a4c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.827 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.831+0000 7f2a6f592700 1 --2- 172.21.15.117:0/3840986262 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2a4c06a660 0x7f2a4c06cb10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2a58000c00 tx=0x7f2a58007040 comp rx=0 tx=0).stop 2023-07-19T20:45:28.828 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.831+0000 7f2a6f592700 1 -- 172.21.15.117:0/3840986262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a68151240 msgr2=0x7f2a6814ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:28.828 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.831+0000 7f2a6f592700 1 --2- 172.21.15.117:0/3840986262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a68151240 0x7f2a6814ecc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2a64005040 tx=0x7f2a64001120 comp rx=0 tx=0).stop 2023-07-19T20:45:28.828 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.831+0000 7f2a6f592700 1 -- 172.21.15.117:0/3840986262 shutdown_connections 2023-07-19T20:45:28.828 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.831+0000 7f2a6f592700 1 --2- 172.21.15.117:0/3840986262 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f2a4c06a660 0x7f2a4c06cb10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.828 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.831+0000 7f2a6f592700 1 --2- 172.21.15.117:0/3840986262 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a681e36d0 0x7f2a681e3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.828 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.831+0000 7f2a6f592700 1 --2- 172.21.15.117:0/3840986262 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2a54004850 0x7f2a6814fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.828 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.831+0000 7f2a6f592700 1 --2- 172.21.15.117:0/3840986262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a68151240 0x7f2a6814ecc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:28.829 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.831+0000 7f2a6f592700 1 -- 172.21.15.117:0/3840986262 >> 172.21.15.117:0/3840986262 conn(0x7f2a68072920 msgr2=0x7f2a680be8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:28.829 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.831+0000 7f2a6f592700 1 -- 172.21.15.117:0/3840986262 shutdown_connections 2023-07-19T20:45:28.829 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:28.831+0000 7f2a6f592700 1 -- 172.21.15.117:0/3840986262 wait complete. 2023-07-19T20:45:28.829 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2023-07-19T20:45:28.836 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-07-19T20:45:27.695942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219640,"kb_used_data":4024,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755080,"statfs":{"total":773094113280,"available":772869201920,"internally_reserved":0,"allocated":4120576,"data_stored":2339036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.713414"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391997+0000","last_change":"2023-07-19T20:45:24.399143+0000","last_active":"2023-07-19T20:45:25.391997+0000","last_peered":"2023-07-19T20:45:25.391997+0000","last_clean":"2023-07-19T20:45:25.391997+0000","last_became_active":"2023-07-19T20:45:24.398902+0000","last_became_peered":"2023-07-19T20:45:24.398902+0000","last_unstale":"2023-07-19T20:45:25.391997+0000","last_undegraded":"2023-07-19T20:45:25.391997+0000","last_fullsized":"2023-07-19T20:45:25.391997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:10:53.202958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391818+0000","last_change":"2023-07-19T20:45:24.404631+0000","last_active":"2023-07-19T20:45:25.391818+0000","last_peered":"2023-07-19T20:45:25.391818+0000","last_clean":"2023-07-19T20:45:25.391818+0000","last_became_active":"2023-07-19T20:45:24.404357+0000","last_became_peered":"2023-07-19T20:45:24.404357+0000","last_unstale":"2023-07-19T20:45:25.391818+0000","last_undegraded":"2023-07-19T20:45:25.391818+0000","last_fullsized":"2023-07-19T20:45:25.391818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:07:21.898747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.406341+0000","last_change":"2023-07-19T20:45:24.405231+0000","last_active":"2023-07-19T20:45:24.406341+0000","last_peered":"2023-07-19T20:45:24.406341+0000","last_clean":"2023-07-19T20:45:24.406341+0000","last_became_active":"2023-07-19T20:45:24.404949+0000","last_became_peered":"2023-07-19T20:45:24.404949+0000","last_unstale":"2023-07-19T20:45:24.406341+0000","last_undegraded":"2023-07-19T20:45:24.406341+0000","last_fullsized":"2023-07-19T20:45:24.406341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:12:25.703062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.414343+0000","last_change":"2023-07-19T20:45:24.412694+0000","last_active":"2023-07-19T20:45:24.414343+0000","last_peered":"2023-07-19T20:45:24.414343+0000","last_clean":"2023-07-19T20:45:24.414343+0000","last_became_active":"2023-07-19T20:45:24.412445+0000","last_became_peered":"2023-07-19T20:45:24.412445+0000","last_unstale":"2023-07-19T20:45:24.414343+0000","last_undegraded":"2023-07-19T20:45:24.414343+0000","last_fullsized":"2023-07-19T20:45:24.414343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:57:13.516312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.411847+0000","last_change":"2023-07-19T20:45:24.404663+0000","last_active":"2023-07-19T20:45:24.411847+0000","last_peered":"2023-07-19T20:45:24.411847+0000","last_clean":"2023-07-19T20:45:24.411847+0000","last_became_active":"2023-07-19T20:45:24.402920+0000","last_became_peered":"2023-07-19T20:45:24.402920+0000","last_unstale":"2023-07-19T20:45:24.411847+0000","last_undegraded":"2023-07-19T20:45:24.411847+0000","last_fullsized":"2023-07-19T20:45:24.411847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:34:25.896006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.401379+0000","last_change":"2023-07-19T20:45:24.400832+0000","last_active":"2023-07-19T20:45:24.401379+0000","last_peered":"2023-07-19T20:45:24.401379+0000","last_clean":"2023-07-19T20:45:24.401379+0000","last_became_active":"2023-07-19T20:45:24.400622+0000","last_became_peered":"2023-07-19T20:45:24.400622+0000","last_unstale":"2023-07-19T20:45:24.401379+0000","last_undegraded":"2023-07-19T20:45:24.401379+0000","last_fullsized":"2023-07-19T20:45:24.401379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:36:08.846684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390536+0000","last_change":"2023-07-19T20:45:24.406203+0000","last_active":"2023-07-19T20:45:25.390536+0000","last_peered":"2023-07-19T20:45:25.390536+0000","last_clean":"2023-07-19T20:45:25.390536+0000","last_became_active":"2023-07-19T20:45:24.405920+0000","last_became_peered":"2023-07-19T20:45:24.405920+0000","last_unstale":"2023-07-19T20:45:25.390536+0000","last_undegraded":"2023-07-19T20:45:25.390536+0000","last_fullsized":"2023-07-19T20:45:25.390536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:07:21.898747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391594+0000","last_change":"2023-07-19T20:45:24.396462+0000","last_active":"2023-07-19T20:45:25.391594+0000","last_peered":"2023-07-19T20:45:25.391594+0000","last_clean":"2023-07-19T20:45:25.391594+0000","last_became_active":"2023-07-19T20:45:24.396210+0000","last_became_peered":"2023-07-19T20:45:24.396210+0000","last_unstale":"2023-07-19T20:45:25.391594+0000","last_undegraded":"2023-07-19T20:45:25.391594+0000","last_fullsized":"2023-07-19T20:45:25.391594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:16:21.260694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.398465+0000","last_change":"2023-07-19T20:45:24.396328+0000","last_active":"2023-07-19T20:45:24.398465+0000","last_peered":"2023-07-19T20:45:24.398465+0000","last_clean":"2023-07-19T20:45:24.398465+0000","last_became_active":"2023-07-19T20:45:24.396069+0000","last_became_peered":"2023-07-19T20:45:24.396069+0000","last_unstale":"2023-07-19T20:45:24.398465+0000","last_undegraded":"2023-07-19T20:45:24.398465+0000","last_fullsized":"2023-07-19T20:45:24.398465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:25:18.765616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391483+0000","last_change":"2023-07-19T20:45:24.406863+0000","last_active":"2023-07-19T20:45:25.391483+0000","last_peered":"2023-07-19T20:45:25.391483+0000","last_clean":"2023-07-19T20:45:25.391483+0000","last_became_active":"2023-07-19T20:45:24.406581+0000","last_became_peered":"2023-07-19T20:45:24.406581+0000","last_unstale":"2023-07-19T20:45:25.391483+0000","last_undegraded":"2023-07-19T20:45:25.391483+0000","last_fullsized":"2023-07-19T20:45:25.391483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:25:41.220126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391146+0000","last_change":"2023-07-19T20:45:24.403306+0000","last_active":"2023-07-19T20:45:25.391146+0000","last_peered":"2023-07-19T20:45:25.391146+0000","last_clean":"2023-07-19T20:45:25.391146+0000","last_became_active":"2023-07-19T20:45:24.402631+0000","last_became_peered":"2023-07-19T20:45:24.402631+0000","last_unstale":"2023-07-19T20:45:25.391146+0000","last_undegraded":"2023-07-19T20:45:25.391146+0000","last_fullsized":"2023-07-19T20:45:25.391146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:01:10.625888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.404461+0000","last_change":"2023-07-19T20:45:24.402435+0000","last_active":"2023-07-19T20:45:24.404461+0000","last_peered":"2023-07-19T20:45:24.404461+0000","last_clean":"2023-07-19T20:45:24.404461+0000","last_became_active":"2023-07-19T20:45:24.402185+0000","last_became_peered":"2023-07-19T20:45:24.402185+0000","last_unstale":"2023-07-19T20:45:24.404461+0000","last_undegraded":"2023-07-19T20:45:24.404461+0000","last_fullsized":"2023-07-19T20:45:24.404461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:25:41.220126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390980+0000","last_change":"2023-07-19T20:45:24.407103+0000","last_active":"2023-07-19T20:45:25.390980+0000","last_peered":"2023-07-19T20:45:25.390980+0000","last_clean":"2023-07-19T20:45:25.390980+0000","last_became_active":"2023-07-19T20:45:24.406819+0000","last_became_peered":"2023-07-19T20:45:24.406819+0000","last_unstale":"2023-07-19T20:45:25.390980+0000","last_undegraded":"2023-07-19T20:45:25.390980+0000","last_fullsized":"2023-07-19T20:45:25.390980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:10:41.848465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390545+0000","last_change":"2023-07-19T20:45:24.411427+0000","last_active":"2023-07-19T20:45:25.390545+0000","last_peered":"2023-07-19T20:45:25.390545+0000","last_clean":"2023-07-19T20:45:25.390545+0000","last_became_active":"2023-07-19T20:45:24.411136+0000","last_became_peered":"2023-07-19T20:45:24.411136+0000","last_unstale":"2023-07-19T20:45:25.390545+0000","last_undegraded":"2023-07-19T20:45:25.390545+0000","last_fullsized":"2023-07-19T20:45:25.390545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:56:16.159993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390078+0000","last_change":"2023-07-19T20:45:24.399199+0000","last_active":"2023-07-19T20:45:25.390078+0000","last_peered":"2023-07-19T20:45:25.390078+0000","last_clean":"2023-07-19T20:45:25.390078+0000","last_became_active":"2023-07-19T20:45:24.398911+0000","last_became_peered":"2023-07-19T20:45:24.398911+0000","last_unstale":"2023-07-19T20:45:25.390078+0000","last_undegraded":"2023-07-19T20:45:25.390078+0000","last_fullsized":"2023-07-19T20:45:25.390078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:43:26.720724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.720923+0000","last_change":"2023-07-19T20:45:24.415431+0000","last_active":"2023-07-19T20:45:25.720923+0000","last_peered":"2023-07-19T20:45:25.720923+0000","last_clean":"2023-07-19T20:45:25.720923+0000","last_became_active":"2023-07-19T20:45:24.415148+0000","last_became_peered":"2023-07-19T20:45:24.415148+0000","last_unstale":"2023-07-19T20:45:25.720923+0000","last_undegraded":"2023-07-19T20:45:25.720923+0000","last_fullsized":"2023-07-19T20:45:25.720923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:55:52.728537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721293+0000","last_change":"2023-07-19T20:45:24.415222+0000","last_active":"2023-07-19T20:45:25.721293+0000","last_peered":"2023-07-19T20:45:25.721293+0000","last_clean":"2023-07-19T20:45:25.721293+0000","last_became_active":"2023-07-19T20:45:24.414948+0000","last_became_peered":"2023-07-19T20:45:24.414948+0000","last_unstale":"2023-07-19T20:45:25.721293+0000","last_undegraded":"2023-07-19T20:45:25.721293+0000","last_fullsized":"2023-07-19T20:45:25.721293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:25:41.220126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.413087+0000","last_change":"2023-07-19T20:45:24.408911+0000","last_active":"2023-07-19T20:45:24.413087+0000","last_peered":"2023-07-19T20:45:24.413087+0000","last_clean":"2023-07-19T20:45:24.413087+0000","last_became_active":"2023-07-19T20:45:24.408494+0000","last_became_peered":"2023-07-19T20:45:24.408494+0000","last_unstale":"2023-07-19T20:45:24.413087+0000","last_undegraded":"2023-07-19T20:45:24.413087+0000","last_fullsized":"2023-07-19T20:45:24.413087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T20:58:36.217136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.411884+0000","last_change":"2023-07-19T20:45:24.410394+0000","last_active":"2023-07-19T20:45:24.411884+0000","last_peered":"2023-07-19T20:45:24.411884+0000","last_clean":"2023-07-19T20:45:24.411884+0000","last_became_active":"2023-07-19T20:45:24.410044+0000","last_became_peered":"2023-07-19T20:45:24.410044+0000","last_unstale":"2023-07-19T20:45:24.411884+0000","last_undegraded":"2023-07-19T20:45:24.411884+0000","last_fullsized":"2023-07-19T20:45:24.411884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:14:02.012710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.412907+0000","last_change":"2023-07-19T20:45:24.409127+0000","last_active":"2023-07-19T20:45:24.412907+0000","last_peered":"2023-07-19T20:45:24.412907+0000","last_clean":"2023-07-19T20:45:24.412907+0000","last_became_active":"2023-07-19T20:45:24.408477+0000","last_became_peered":"2023-07-19T20:45:24.408477+0000","last_unstale":"2023-07-19T20:45:24.412907+0000","last_undegraded":"2023-07-19T20:45:24.412907+0000","last_fullsized":"2023-07-19T20:45:24.412907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:36:08.846684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391142+0000","last_change":"2023-07-19T20:45:24.401726+0000","last_active":"2023-07-19T20:45:25.391142+0000","last_peered":"2023-07-19T20:45:25.391142+0000","last_clean":"2023-07-19T20:45:25.391142+0000","last_became_active":"2023-07-19T20:45:24.401454+0000","last_became_peered":"2023-07-19T20:45:24.401454+0000","last_unstale":"2023-07-19T20:45:25.391142+0000","last_undegraded":"2023-07-19T20:45:25.391142+0000","last_fullsized":"2023-07-19T20:45:25.391142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:12:25.703062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390349+0000","last_change":"2023-07-19T20:45:24.403342+0000","last_active":"2023-07-19T20:45:25.390349+0000","last_peered":"2023-07-19T20:45:25.390349+0000","last_clean":"2023-07-19T20:45:25.390349+0000","last_became_active":"2023-07-19T20:45:24.403051+0000","last_became_peered":"2023-07-19T20:45:24.403051+0000","last_unstale":"2023-07-19T20:45:25.390349+0000","last_undegraded":"2023-07-19T20:45:25.390349+0000","last_fullsized":"2023-07-19T20:45:25.390349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:14:05.320776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721053+0000","last_change":"2023-07-19T20:45:24.413329+0000","last_active":"2023-07-19T20:45:25.721053+0000","last_peered":"2023-07-19T20:45:25.721053+0000","last_clean":"2023-07-19T20:45:25.721053+0000","last_became_active":"2023-07-19T20:45:24.413067+0000","last_became_peered":"2023-07-19T20:45:24.413067+0000","last_unstale":"2023-07-19T20:45:25.721053+0000","last_undegraded":"2023-07-19T20:45:25.721053+0000","last_fullsized":"2023-07-19T20:45:25.721053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:25:18.765616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.412938+0000","last_change":"2023-07-19T20:45:24.412257+0000","last_active":"2023-07-19T20:45:24.412938+0000","last_peered":"2023-07-19T20:45:24.412938+0000","last_clean":"2023-07-19T20:45:24.412938+0000","last_became_active":"2023-07-19T20:45:24.411836+0000","last_became_peered":"2023-07-19T20:45:24.411836+0000","last_unstale":"2023-07-19T20:45:24.412938+0000","last_undegraded":"2023-07-19T20:45:24.412938+0000","last_fullsized":"2023-07-19T20:45:24.412938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:44:37.542202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.413189+0000","last_change":"2023-07-19T20:45:24.408896+0000","last_active":"2023-07-19T20:45:24.413189+0000","last_peered":"2023-07-19T20:45:24.413189+0000","last_clean":"2023-07-19T20:45:24.413189+0000","last_became_active":"2023-07-19T20:45:24.408255+0000","last_became_peered":"2023-07-19T20:45:24.408255+0000","last_unstale":"2023-07-19T20:45:24.413189+0000","last_undegraded":"2023-07-19T20:45:24.413189+0000","last_fullsized":"2023-07-19T20:45:24.413189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:57:13.516312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.413964+0000","last_change":"2023-07-19T20:45:24.410764+0000","last_active":"2023-07-19T20:45:24.413964+0000","last_peered":"2023-07-19T20:45:24.413964+0000","last_clean":"2023-07-19T20:45:24.413964+0000","last_became_active":"2023-07-19T20:45:24.410520+0000","last_became_peered":"2023-07-19T20:45:24.410520+0000","last_unstale":"2023-07-19T20:45:24.413964+0000","last_undegraded":"2023-07-19T20:45:24.413964+0000","last_fullsized":"2023-07-19T20:45:24.413964+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:24:18.972463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.418003+0000","last_change":"2023-07-19T20:45:24.412739+0000","last_active":"2023-07-19T20:45:24.418003+0000","last_peered":"2023-07-19T20:45:24.418003+0000","last_clean":"2023-07-19T20:45:24.418003+0000","last_became_active":"2023-07-19T20:45:24.412499+0000","last_became_peered":"2023-07-19T20:45:24.412499+0000","last_unstale":"2023-07-19T20:45:24.418003+0000","last_undegraded":"2023-07-19T20:45:24.418003+0000","last_fullsized":"2023-07-19T20:45:24.418003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:30:53.102605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390152+0000","last_change":"2023-07-19T20:45:24.405038+0000","last_active":"2023-07-19T20:45:25.390152+0000","last_peered":"2023-07-19T20:45:25.390152+0000","last_clean":"2023-07-19T20:45:25.390152+0000","last_became_active":"2023-07-19T20:45:24.404764+0000","last_became_peered":"2023-07-19T20:45:24.404764+0000","last_unstale":"2023-07-19T20:45:25.390152+0000","last_undegraded":"2023-07-19T20:45:25.390152+0000","last_fullsized":"2023-07-19T20:45:25.390152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:10:03.774290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.412956+0000","last_change":"2023-07-19T20:45:24.407292+0000","last_active":"2023-07-19T20:45:24.412956+0000","last_peered":"2023-07-19T20:45:24.412956+0000","last_clean":"2023-07-19T20:45:24.412956+0000","last_became_active":"2023-07-19T20:45:24.407038+0000","last_became_peered":"2023-07-19T20:45:24.407038+0000","last_unstale":"2023-07-19T20:45:24.412956+0000","last_undegraded":"2023-07-19T20:45:24.412956+0000","last_fullsized":"2023-07-19T20:45:24.412956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:08:43.082205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.413009+0000","last_change":"2023-07-19T20:45:24.407732+0000","last_active":"2023-07-19T20:45:24.413009+0000","last_peered":"2023-07-19T20:45:24.413009+0000","last_clean":"2023-07-19T20:45:24.413009+0000","last_became_active":"2023-07-19T20:45:24.407462+0000","last_became_peered":"2023-07-19T20:45:24.407462+0000","last_unstale":"2023-07-19T20:45:24.413009+0000","last_undegraded":"2023-07-19T20:45:24.413009+0000","last_fullsized":"2023-07-19T20:45:24.413009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:34:25.896006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721001+0000","last_change":"2023-07-19T20:45:24.412337+0000","last_active":"2023-07-19T20:45:25.721001+0000","last_peered":"2023-07-19T20:45:25.721001+0000","last_clean":"2023-07-19T20:45:25.721001+0000","last_became_active":"2023-07-19T20:45:24.412063+0000","last_became_peered":"2023-07-19T20:45:24.412063+0000","last_unstale":"2023-07-19T20:45:25.721001+0000","last_undegraded":"2023-07-19T20:45:25.721001+0000","last_fullsized":"2023-07-19T20:45:25.721001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:10:03.774290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.405180+0000","last_change":"2023-07-19T20:45:24.403095+0000","last_active":"2023-07-19T20:45:24.405180+0000","last_peered":"2023-07-19T20:45:24.405180+0000","last_clean":"2023-07-19T20:45:24.405180+0000","last_became_active":"2023-07-19T20:45:24.402868+0000","last_became_peered":"2023-07-19T20:45:24.402868+0000","last_unstale":"2023-07-19T20:45:24.405180+0000","last_undegraded":"2023-07-19T20:45:24.405180+0000","last_fullsized":"2023-07-19T20:45:24.405180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:30:53.102605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721316+0000","last_change":"2023-07-19T20:45:24.415437+0000","last_active":"2023-07-19T20:45:25.721316+0000","last_peered":"2023-07-19T20:45:25.721316+0000","last_clean":"2023-07-19T20:45:25.721316+0000","last_became_active":"2023-07-19T20:45:24.415161+0000","last_became_peered":"2023-07-19T20:45:24.415161+0000","last_unstale":"2023-07-19T20:45:25.721316+0000","last_undegraded":"2023-07-19T20:45:25.721316+0000","last_fullsized":"2023-07-19T20:45:25.721316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:43:26.720724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.418088+0000","last_change":"2023-07-19T20:45:24.000047+0000","last_active":"2023-07-19T20:45:24.418088+0000","last_peered":"2023-07-19T20:45:24.418088+0000","last_clean":"2023-07-19T20:45:24.418088+0000","last_became_active":"2023-07-19T20:45:23.999775+0000","last_became_peered":"2023-07-19T20:45:23.999775+0000","last_unstale":"2023-07-19T20:45:24.418088+0000","last_undegraded":"2023-07-19T20:45:24.418088+0000","last_fullsized":"2023-07-19T20:45:24.418088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:50:48.227491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.414119+0000","last_change":"2023-07-19T20:45:24.411945+0000","last_active":"2023-07-19T20:45:24.414119+0000","last_peered":"2023-07-19T20:45:24.414119+0000","last_clean":"2023-07-19T20:45:24.414119+0000","last_became_active":"2023-07-19T20:45:24.411756+0000","last_became_peered":"2023-07-19T20:45:24.411756+0000","last_unstale":"2023-07-19T20:45:24.414119+0000","last_undegraded":"2023-07-19T20:45:24.414119+0000","last_fullsized":"2023-07-19T20:45:24.414119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:12:28.101468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.406513+0000","last_change":"2023-07-19T20:45:23.997011+0000","last_active":"2023-07-19T20:45:24.406513+0000","last_peered":"2023-07-19T20:45:24.406513+0000","last_clean":"2023-07-19T20:45:24.406513+0000","last_became_active":"2023-07-19T20:45:23.996734+0000","last_became_peered":"2023-07-19T20:45:23.996734+0000","last_unstale":"2023-07-19T20:45:24.406513+0000","last_undegraded":"2023-07-19T20:45:24.406513+0000","last_fullsized":"2023-07-19T20:45:24.406513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:42:42.789583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390567+0000","last_change":"2023-07-19T20:45:24.409840+0000","last_active":"2023-07-19T20:45:25.390567+0000","last_peered":"2023-07-19T20:45:25.390567+0000","last_clean":"2023-07-19T20:45:25.390567+0000","last_became_active":"2023-07-19T20:45:24.409339+0000","last_became_peered":"2023-07-19T20:45:24.409339+0000","last_unstale":"2023-07-19T20:45:25.390567+0000","last_undegraded":"2023-07-19T20:45:25.390567+0000","last_fullsized":"2023-07-19T20:45:25.390567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:00:23.950242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.414072+0000","last_change":"2023-07-19T20:45:24.004599+0000","last_active":"2023-07-19T20:45:24.414072+0000","last_peered":"2023-07-19T20:45:24.414072+0000","last_clean":"2023-07-19T20:45:24.414072+0000","last_became_active":"2023-07-19T20:45:24.004334+0000","last_became_peered":"2023-07-19T20:45:24.004334+0000","last_unstale":"2023-07-19T20:45:24.414072+0000","last_undegraded":"2023-07-19T20:45:24.414072+0000","last_fullsized":"2023-07-19T20:45:24.414072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:43:12.013245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391807+0000","last_change":"2023-07-19T20:45:24.411882+0000","last_active":"2023-07-19T20:45:25.391807+0000","last_peered":"2023-07-19T20:45:25.391807+0000","last_clean":"2023-07-19T20:45:25.391807+0000","last_became_active":"2023-07-19T20:45:24.411542+0000","last_became_peered":"2023-07-19T20:45:24.411542+0000","last_unstale":"2023-07-19T20:45:25.391807+0000","last_undegraded":"2023-07-19T20:45:25.391807+0000","last_fullsized":"2023-07-19T20:45:25.391807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:33:50.523963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390633+0000","last_change":"2023-07-19T20:45:24.002572+0000","last_active":"2023-07-19T20:45:25.390633+0000","last_peered":"2023-07-19T20:45:25.390633+0000","last_clean":"2023-07-19T20:45:25.390633+0000","last_became_active":"2023-07-19T20:45:24.002288+0000","last_became_peered":"2023-07-19T20:45:24.002288+0000","last_unstale":"2023-07-19T20:45:25.390633+0000","last_undegraded":"2023-07-19T20:45:25.390633+0000","last_fullsized":"2023-07-19T20:45:25.390633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:13:59.622732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.406615+0000","last_change":"2023-07-19T20:45:24.406090+0000","last_active":"2023-07-19T20:45:24.406615+0000","last_peered":"2023-07-19T20:45:24.406615+0000","last_clean":"2023-07-19T20:45:24.406615+0000","last_became_active":"2023-07-19T20:45:24.405819+0000","last_became_peered":"2023-07-19T20:45:24.405819+0000","last_unstale":"2023-07-19T20:45:24.406615+0000","last_undegraded":"2023-07-19T20:45:24.406615+0000","last_fullsized":"2023-07-19T20:45:24.406615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:10:41.848465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"32'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391077+0000","last_change":"2023-07-19T20:45:23.997566+0000","last_active":"2023-07-19T20:45:25.391077+0000","last_peered":"2023-07-19T20:45:25.391077+0000","last_clean":"2023-07-19T20:45:25.391077+0000","last_became_active":"2023-07-19T20:45:23.996970+0000","last_became_peered":"2023-07-19T20:45:23.996970+0000","last_unstale":"2023-07-19T20:45:25.391077+0000","last_undegraded":"2023-07-19T20:45:25.391077+0000","last_fullsized":"2023-07-19T20:45:25.391077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:06:31.362206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390377+0000","last_change":"2023-07-19T20:45:24.402377+0000","last_active":"2023-07-19T20:45:25.390377+0000","last_peered":"2023-07-19T20:45:25.390377+0000","last_clean":"2023-07-19T20:45:25.390377+0000","last_became_active":"2023-07-19T20:45:24.402104+0000","last_became_peered":"2023-07-19T20:45:24.402104+0000","last_unstale":"2023-07-19T20:45:25.390377+0000","last_undegraded":"2023-07-19T20:45:25.390377+0000","last_fullsized":"2023-07-19T20:45:25.390377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:43:14.171374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"32'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721223+0000","last_change":"2023-07-19T20:45:24.004837+0000","last_active":"2023-07-19T20:45:25.721223+0000","last_peered":"2023-07-19T20:45:25.721223+0000","last_clean":"2023-07-19T20:45:25.721223+0000","last_became_active":"2023-07-19T20:45:24.004531+0000","last_became_peered":"2023-07-19T20:45:24.004531+0000","last_unstale":"2023-07-19T20:45:25.721223+0000","last_undegraded":"2023-07-19T20:45:25.721223+0000","last_fullsized":"2023-07-19T20:45:25.721223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:06:31.362206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390338+0000","last_change":"2023-07-19T20:45:24.402273+0000","last_active":"2023-07-19T20:45:25.390338+0000","last_peered":"2023-07-19T20:45:25.390338+0000","last_clean":"2023-07-19T20:45:25.390338+0000","last_became_active":"2023-07-19T20:45:24.401811+0000","last_became_peered":"2023-07-19T20:45:24.401811+0000","last_unstale":"2023-07-19T20:45:25.390338+0000","last_undegraded":"2023-07-19T20:45:25.390338+0000","last_fullsized":"2023-07-19T20:45:25.390338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:45:27.288078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.397361+0000","last_change":"2023-07-19T20:45:24.002033+0000","last_active":"2023-07-19T20:45:24.397361+0000","last_peered":"2023-07-19T20:45:24.397361+0000","last_clean":"2023-07-19T20:45:24.397361+0000","last_became_active":"2023-07-19T20:45:24.001831+0000","last_became_peered":"2023-07-19T20:45:24.001831+0000","last_unstale":"2023-07-19T20:45:24.397361+0000","last_undegraded":"2023-07-19T20:45:24.397361+0000","last_fullsized":"2023-07-19T20:45:24.397361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:43:46.194354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391837+0000","last_change":"2023-07-19T20:45:24.405824+0000","last_active":"2023-07-19T20:45:25.391837+0000","last_peered":"2023-07-19T20:45:25.391837+0000","last_clean":"2023-07-19T20:45:25.391837+0000","last_became_active":"2023-07-19T20:45:24.405531+0000","last_became_peered":"2023-07-19T20:45:24.405531+0000","last_unstale":"2023-07-19T20:45:25.391837+0000","last_undegraded":"2023-07-19T20:45:25.391837+0000","last_fullsized":"2023-07-19T20:45:25.391837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:58:17.309821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390254+0000","last_change":"2023-07-19T20:45:24.000623+0000","last_active":"2023-07-19T20:45:25.390254+0000","last_peered":"2023-07-19T20:45:25.390254+0000","last_clean":"2023-07-19T20:45:25.390254+0000","last_became_active":"2023-07-19T20:45:24.000374+0000","last_became_peered":"2023-07-19T20:45:24.000374+0000","last_unstale":"2023-07-19T20:45:25.390254+0000","last_undegraded":"2023-07-19T20:45:25.390254+0000","last_fullsized":"2023-07-19T20:45:25.390254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:50:40.422081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.414322+0000","last_change":"2023-07-19T20:45:24.412584+0000","last_active":"2023-07-19T20:45:24.414322+0000","last_peered":"2023-07-19T20:45:24.414322+0000","last_clean":"2023-07-19T20:45:24.414322+0000","last_became_active":"2023-07-19T20:45:24.412294+0000","last_became_peered":"2023-07-19T20:45:24.412294+0000","last_unstale":"2023-07-19T20:45:24.414322+0000","last_undegraded":"2023-07-19T20:45:24.414322+0000","last_fullsized":"2023-07-19T20:45:24.414322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:21:22.353776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391938+0000","last_change":"2023-07-19T20:45:23.997386+0000","last_active":"2023-07-19T20:45:25.391938+0000","last_peered":"2023-07-19T20:45:25.391938+0000","last_clean":"2023-07-19T20:45:25.391938+0000","last_became_active":"2023-07-19T20:45:23.997127+0000","last_became_peered":"2023-07-19T20:45:23.997127+0000","last_unstale":"2023-07-19T20:45:25.391938+0000","last_undegraded":"2023-07-19T20:45:25.391938+0000","last_fullsized":"2023-07-19T20:45:25.391938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:39:56.761677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721368+0000","last_change":"2023-07-19T20:45:24.411917+0000","last_active":"2023-07-19T20:45:25.721368+0000","last_peered":"2023-07-19T20:45:25.721368+0000","last_clean":"2023-07-19T20:45:25.721368+0000","last_became_active":"2023-07-19T20:45:24.411650+0000","last_became_peered":"2023-07-19T20:45:24.411650+0000","last_unstale":"2023-07-19T20:45:25.721368+0000","last_undegraded":"2023-07-19T20:45:25.721368+0000","last_fullsized":"2023-07-19T20:45:25.721368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:12:25.703062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391592+0000","last_change":"2023-07-19T20:45:23.999376+0000","last_active":"2023-07-19T20:45:25.391592+0000","last_peered":"2023-07-19T20:45:25.391592+0000","last_clean":"2023-07-19T20:45:25.391592+0000","last_became_active":"2023-07-19T20:45:23.999046+0000","last_became_peered":"2023-07-19T20:45:23.999046+0000","last_unstale":"2023-07-19T20:45:25.391592+0000","last_undegraded":"2023-07-19T20:45:25.391592+0000","last_fullsized":"2023-07-19T20:45:25.391592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:08:14.490724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.407627+0000","last_change":"2023-07-19T20:45:24.406955+0000","last_active":"2023-07-19T20:45:24.407627+0000","last_peered":"2023-07-19T20:45:24.407627+0000","last_clean":"2023-07-19T20:45:24.407627+0000","last_became_active":"2023-07-19T20:45:24.406733+0000","last_became_peered":"2023-07-19T20:45:24.406733+0000","last_unstale":"2023-07-19T20:45:24.407627+0000","last_undegraded":"2023-07-19T20:45:24.407627+0000","last_fullsized":"2023-07-19T20:45:24.407627+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:46:12.931341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"32'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391195+0000","last_change":"2023-07-19T20:45:24.002714+0000","last_active":"2023-07-19T20:45:25.391195+0000","last_peered":"2023-07-19T20:45:25.391195+0000","last_clean":"2023-07-19T20:45:25.391195+0000","last_became_active":"2023-07-19T20:45:24.002431+0000","last_became_peered":"2023-07-19T20:45:24.002431+0000","last_unstale":"2023-07-19T20:45:25.391195+0000","last_undegraded":"2023-07-19T20:45:25.391195+0000","last_fullsized":"2023-07-19T20:45:25.391195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:34:15.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391187+0000","last_change":"2023-07-19T20:45:24.403765+0000","last_active":"2023-07-19T20:45:25.391187+0000","last_peered":"2023-07-19T20:45:25.391187+0000","last_clean":"2023-07-19T20:45:25.391187+0000","last_became_active":"2023-07-19T20:45:24.402995+0000","last_became_peered":"2023-07-19T20:45:24.402995+0000","last_unstale":"2023-07-19T20:45:25.391187+0000","last_undegraded":"2023-07-19T20:45:25.391187+0000","last_fullsized":"2023-07-19T20:45:25.391187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:49:25.866235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"32'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391860+0000","last_change":"2023-07-19T20:45:24.001819+0000","last_active":"2023-07-19T20:45:25.391860+0000","last_peered":"2023-07-19T20:45:25.391860+0000","last_clean":"2023-07-19T20:45:25.391860+0000","last_became_active":"2023-07-19T20:45:24.001578+0000","last_became_peered":"2023-07-19T20:45:24.001578+0000","last_unstale":"2023-07-19T20:45:25.391860+0000","last_undegraded":"2023-07-19T20:45:25.391860+0000","last_fullsized":"2023-07-19T20:45:25.391860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:30:13.882308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.398503+0000","last_change":"2023-07-19T20:45:24.396814+0000","last_active":"2023-07-19T20:45:24.398503+0000","last_peered":"2023-07-19T20:45:24.398503+0000","last_clean":"2023-07-19T20:45:24.398503+0000","last_became_active":"2023-07-19T20:45:24.396581+0000","last_became_peered":"2023-07-19T20:45:24.396581+0000","last_unstale":"2023-07-19T20:45:24.398503+0000","last_undegraded":"2023-07-19T20:45:24.398503+0000","last_fullsized":"2023-07-19T20:45:24.398503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:32:13.690684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391927+0000","last_change":"2023-07-19T20:45:24.003430+0000","last_active":"2023-07-19T20:45:25.391927+0000","last_peered":"2023-07-19T20:45:25.391927+0000","last_clean":"2023-07-19T20:45:25.391927+0000","last_became_active":"2023-07-19T20:45:24.002623+0000","last_became_peered":"2023-07-19T20:45:24.002623+0000","last_unstale":"2023-07-19T20:45:25.391927+0000","last_undegraded":"2023-07-19T20:45:25.391927+0000","last_fullsized":"2023-07-19T20:45:25.391927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:40:01.536994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.392072+0000","last_change":"2023-07-19T20:45:24.399472+0000","last_active":"2023-07-19T20:45:25.392072+0000","last_peered":"2023-07-19T20:45:25.392072+0000","last_clean":"2023-07-19T20:45:25.392072+0000","last_became_active":"2023-07-19T20:45:24.399218+0000","last_became_peered":"2023-07-19T20:45:24.399218+0000","last_unstale":"2023-07-19T20:45:25.392072+0000","last_undegraded":"2023-07-19T20:45:25.392072+0000","last_fullsized":"2023-07-19T20:45:25.392072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:09:24.894596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.396262+0000","last_change":"2023-07-19T20:45:24.000346+0000","last_active":"2023-07-19T20:45:24.396262+0000","last_peered":"2023-07-19T20:45:24.396262+0000","last_clean":"2023-07-19T20:45:24.396262+0000","last_became_active":"2023-07-19T20:45:23.999926+0000","last_became_peered":"2023-07-19T20:45:23.999926+0000","last_unstale":"2023-07-19T20:45:24.396262+0000","last_undegraded":"2023-07-19T20:45:24.396262+0000","last_fullsized":"2023-07-19T20:45:24.396262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:32:31.842917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721048+0000","last_change":"2023-07-19T20:45:24.414428+0000","last_active":"2023-07-19T20:45:25.721048+0000","last_peered":"2023-07-19T20:45:25.721048+0000","last_clean":"2023-07-19T20:45:25.721048+0000","last_became_active":"2023-07-19T20:45:24.414161+0000","last_became_peered":"2023-07-19T20:45:24.414161+0000","last_unstale":"2023-07-19T20:45:25.721048+0000","last_undegraded":"2023-07-19T20:45:25.721048+0000","last_fullsized":"2023-07-19T20:45:25.721048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:32:13.690684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.396192+0000","last_change":"2023-07-19T20:45:24.003330+0000","last_active":"2023-07-19T20:45:24.396192+0000","last_peered":"2023-07-19T20:45:24.396192+0000","last_clean":"2023-07-19T20:45:24.396192+0000","last_became_active":"2023-07-19T20:45:24.003012+0000","last_became_peered":"2023-07-19T20:45:24.003012+0000","last_unstale":"2023-07-19T20:45:24.396192+0000","last_undegraded":"2023-07-19T20:45:24.396192+0000","last_fullsized":"2023-07-19T20:45:24.396192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:44:28.254565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391740+0000","last_change":"2023-07-19T20:45:24.399125+0000","last_active":"2023-07-19T20:45:25.391740+0000","last_peered":"2023-07-19T20:45:25.391740+0000","last_clean":"2023-07-19T20:45:25.391740+0000","last_became_active":"2023-07-19T20:45:24.398881+0000","last_became_peered":"2023-07-19T20:45:24.398881+0000","last_unstale":"2023-07-19T20:45:25.391740+0000","last_undegraded":"2023-07-19T20:45:25.391740+0000","last_fullsized":"2023-07-19T20:45:25.391740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:37:29.651664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'8","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721179+0000","last_change":"2023-07-19T20:45:24.003649+0000","last_active":"2023-07-19T20:45:25.721179+0000","last_peered":"2023-07-19T20:45:25.721179+0000","last_clean":"2023-07-19T20:45:25.721179+0000","last_became_active":"2023-07-19T20:45:24.003417+0000","last_became_peered":"2023-07-19T20:45:24.003417+0000","last_unstale":"2023-07-19T20:45:25.721179+0000","last_undegraded":"2023-07-19T20:45:25.721179+0000","last_fullsized":"2023-07-19T20:45:25.721179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:34:15.386461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391875+0000","last_change":"2023-07-19T20:45:24.408079+0000","last_active":"2023-07-19T20:45:25.391875+0000","last_peered":"2023-07-19T20:45:25.391875+0000","last_clean":"2023-07-19T20:45:25.391875+0000","last_became_active":"2023-07-19T20:45:24.407822+0000","last_became_peered":"2023-07-19T20:45:24.407822+0000","last_unstale":"2023-07-19T20:45:25.391875+0000","last_undegraded":"2023-07-19T20:45:25.391875+0000","last_fullsized":"2023-07-19T20:45:25.391875+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:10:03.774290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390979+0000","last_change":"2023-07-19T20:45:23.998164+0000","last_active":"2023-07-19T20:45:25.390979+0000","last_peered":"2023-07-19T20:45:25.390979+0000","last_clean":"2023-07-19T20:45:25.390979+0000","last_became_active":"2023-07-19T20:45:23.997893+0000","last_became_peered":"2023-07-19T20:45:23.997893+0000","last_unstale":"2023-07-19T20:45:25.390979+0000","last_undegraded":"2023-07-19T20:45:25.390979+0000","last_fullsized":"2023-07-19T20:45:25.390979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:06:04.751696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391084+0000","last_change":"2023-07-19T20:45:24.404432+0000","last_active":"2023-07-19T20:45:25.391084+0000","last_peered":"2023-07-19T20:45:25.391084+0000","last_clean":"2023-07-19T20:45:25.391084+0000","last_became_active":"2023-07-19T20:45:24.404184+0000","last_became_peered":"2023-07-19T20:45:24.404184+0000","last_unstale":"2023-07-19T20:45:25.391084+0000","last_undegraded":"2023-07-19T20:45:25.391084+0000","last_fullsized":"2023-07-19T20:45:25.391084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:16:21.260694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390768+0000","last_change":"2023-07-19T20:45:24.000332+0000","last_active":"2023-07-19T20:45:25.390768+0000","last_peered":"2023-07-19T20:45:25.390768+0000","last_clean":"2023-07-19T20:45:25.390768+0000","last_became_active":"2023-07-19T20:45:24.000041+0000","last_became_peered":"2023-07-19T20:45:24.000041+0000","last_unstale":"2023-07-19T20:45:25.390768+0000","last_undegraded":"2023-07-19T20:45:25.390768+0000","last_fullsized":"2023-07-19T20:45:25.390768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:23:26.998443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390676+0000","last_change":"2023-07-19T20:45:24.402419+0000","last_active":"2023-07-19T20:45:25.390676+0000","last_peered":"2023-07-19T20:45:25.390676+0000","last_clean":"2023-07-19T20:45:25.390676+0000","last_became_active":"2023-07-19T20:45:24.402149+0000","last_became_peered":"2023-07-19T20:45:24.402149+0000","last_unstale":"2023-07-19T20:45:25.390676+0000","last_undegraded":"2023-07-19T20:45:25.390676+0000","last_fullsized":"2023-07-19T20:45:25.390676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:25:54.857116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.410234+0000","last_change":"2023-07-19T20:45:23.999221+0000","last_active":"2023-07-19T20:45:24.410234+0000","last_peered":"2023-07-19T20:45:24.410234+0000","last_clean":"2023-07-19T20:45:24.410234+0000","last_became_active":"2023-07-19T20:45:23.998973+0000","last_became_peered":"2023-07-19T20:45:23.998973+0000","last_unstale":"2023-07-19T20:45:24.410234+0000","last_undegraded":"2023-07-19T20:45:24.410234+0000","last_fullsized":"2023-07-19T20:45:24.410234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:36:20.349126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.411759+0000","last_change":"2023-07-19T20:45:24.402382+0000","last_active":"2023-07-19T20:45:24.411759+0000","last_peered":"2023-07-19T20:45:24.411759+0000","last_clean":"2023-07-19T20:45:24.411759+0000","last_became_active":"2023-07-19T20:45:24.402140+0000","last_became_peered":"2023-07-19T20:45:24.402140+0000","last_unstale":"2023-07-19T20:45:24.411759+0000","last_undegraded":"2023-07-19T20:45:24.411759+0000","last_fullsized":"2023-07-19T20:45:24.411759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:32:32.851673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.397073+0000","last_change":"2023-07-19T20:45:23.996849+0000","last_active":"2023-07-19T20:45:24.397073+0000","last_peered":"2023-07-19T20:45:24.397073+0000","last_clean":"2023-07-19T20:45:24.397073+0000","last_became_active":"2023-07-19T20:45:23.996590+0000","last_became_peered":"2023-07-19T20:45:23.996590+0000","last_unstale":"2023-07-19T20:45:24.397073+0000","last_undegraded":"2023-07-19T20:45:24.397073+0000","last_fullsized":"2023-07-19T20:45:24.397073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:11:01.461690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.720980+0000","last_change":"2023-07-19T20:45:24.414472+0000","last_active":"2023-07-19T20:45:25.720980+0000","last_peered":"2023-07-19T20:45:25.720980+0000","last_clean":"2023-07-19T20:45:25.720980+0000","last_became_active":"2023-07-19T20:45:24.413930+0000","last_became_peered":"2023-07-19T20:45:24.413930+0000","last_unstale":"2023-07-19T20:45:25.720980+0000","last_undegraded":"2023-07-19T20:45:25.720980+0000","last_fullsized":"2023-07-19T20:45:25.720980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T07:43:14.171374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.404802+0000","last_change":"2023-07-19T20:45:24.001552+0000","last_active":"2023-07-19T20:45:24.404802+0000","last_peered":"2023-07-19T20:45:24.404802+0000","last_clean":"2023-07-19T20:45:24.404802+0000","last_became_active":"2023-07-19T20:45:24.001331+0000","last_became_peered":"2023-07-19T20:45:24.001331+0000","last_unstale":"2023-07-19T20:45:24.404802+0000","last_undegraded":"2023-07-19T20:45:24.404802+0000","last_fullsized":"2023-07-19T20:45:24.404802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:57:03.405855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.407634+0000","last_change":"2023-07-19T20:45:24.407056+0000","last_active":"2023-07-19T20:45:24.407634+0000","last_peered":"2023-07-19T20:45:24.407634+0000","last_clean":"2023-07-19T20:45:24.407634+0000","last_became_active":"2023-07-19T20:45:24.406795+0000","last_became_peered":"2023-07-19T20:45:24.406795+0000","last_unstale":"2023-07-19T20:45:24.407634+0000","last_undegraded":"2023-07-19T20:45:24.407634+0000","last_fullsized":"2023-07-19T20:45:24.407634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:55:52.728537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.390959+0000","last_change":"2023-07-19T20:45:23.998695+0000","last_active":"2023-07-19T20:45:24.390959+0000","last_peered":"2023-07-19T20:45:24.390959+0000","last_clean":"2023-07-19T20:45:24.390959+0000","last_became_active":"2023-07-19T20:45:23.998418+0000","last_became_peered":"2023-07-19T20:45:23.998418+0000","last_unstale":"2023-07-19T20:45:24.390959+0000","last_undegraded":"2023-07-19T20:45:24.390959+0000","last_fullsized":"2023-07-19T20:45:24.390959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:34:27.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390859+0000","last_change":"2023-07-19T20:45:24.408250+0000","last_active":"2023-07-19T20:45:25.390859+0000","last_peered":"2023-07-19T20:45:25.390859+0000","last_clean":"2023-07-19T20:45:25.390859+0000","last_became_active":"2023-07-19T20:45:24.408031+0000","last_became_peered":"2023-07-19T20:45:24.408031+0000","last_unstale":"2023-07-19T20:45:25.390859+0000","last_undegraded":"2023-07-19T20:45:25.390859+0000","last_fullsized":"2023-07-19T20:45:25.390859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:54:25.000020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721128+0000","last_change":"2023-07-19T20:45:23.998085+0000","last_active":"2023-07-19T20:45:25.721128+0000","last_peered":"2023-07-19T20:45:25.721128+0000","last_clean":"2023-07-19T20:45:25.721128+0000","last_became_active":"2023-07-19T20:45:23.997823+0000","last_became_peered":"2023-07-19T20:45:23.997823+0000","last_unstale":"2023-07-19T20:45:25.721128+0000","last_undegraded":"2023-07-19T20:45:25.721128+0000","last_fullsized":"2023-07-19T20:45:25.721128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:29:33.566430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391998+0000","last_change":"2023-07-19T20:45:24.405212+0000","last_active":"2023-07-19T20:45:25.391998+0000","last_peered":"2023-07-19T20:45:25.391998+0000","last_clean":"2023-07-19T20:45:25.391998+0000","last_became_active":"2023-07-19T20:45:24.404980+0000","last_became_peered":"2023-07-19T20:45:24.404980+0000","last_unstale":"2023-07-19T20:45:25.391998+0000","last_undegraded":"2023-07-19T20:45:25.391998+0000","last_fullsized":"2023-07-19T20:45:25.391998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T20:55:03.798131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.390481+0000","last_change":"2023-07-19T20:45:24.003965+0000","last_active":"2023-07-19T20:45:24.390481+0000","last_peered":"2023-07-19T20:45:24.390481+0000","last_clean":"2023-07-19T20:45:24.390481+0000","last_became_active":"2023-07-19T20:45:24.003682+0000","last_became_peered":"2023-07-19T20:45:24.003682+0000","last_unstale":"2023-07-19T20:45:24.390481+0000","last_undegraded":"2023-07-19T20:45:24.390481+0000","last_fullsized":"2023-07-19T20:45:24.390481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:45:21.375657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390645+0000","last_change":"2023-07-19T20:45:24.402104+0000","last_active":"2023-07-19T20:45:25.390645+0000","last_peered":"2023-07-19T20:45:25.390645+0000","last_clean":"2023-07-19T20:45:25.390645+0000","last_became_active":"2023-07-19T20:45:24.401494+0000","last_became_peered":"2023-07-19T20:45:24.401494+0000","last_unstale":"2023-07-19T20:45:25.390645+0000","last_undegraded":"2023-07-19T20:45:25.390645+0000","last_fullsized":"2023-07-19T20:45:25.390645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:20:17.786230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391040+0000","last_change":"2023-07-19T20:45:23.999169+0000","last_active":"2023-07-19T20:45:25.391040+0000","last_peered":"2023-07-19T20:45:25.391040+0000","last_clean":"2023-07-19T20:45:25.391040+0000","last_became_active":"2023-07-19T20:45:23.998862+0000","last_became_peered":"2023-07-19T20:45:23.998862+0000","last_unstale":"2023-07-19T20:45:25.391040+0000","last_undegraded":"2023-07-19T20:45:25.391040+0000","last_fullsized":"2023-07-19T20:45:25.391040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:23:28.594043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.390523+0000","last_change":"2023-07-19T20:44:33.123673+0000","last_active":"2023-07-19T20:45:24.390523+0000","last_peered":"2023-07-19T20:45:24.390523+0000","last_clean":"2023-07-19T20:45:24.390523+0000","last_became_active":"2023-07-19T20:44:33.123400+0000","last_became_peered":"2023-07-19T20:44:33.123400+0000","last_unstale":"2023-07-19T20:45:24.390523+0000","last_undegraded":"2023-07-19T20:45:24.390523+0000","last_fullsized":"2023-07-19T20:45:24.390523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T08:29:32.159769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721472+0000","last_change":"2023-07-19T20:45:24.412317+0000","last_active":"2023-07-19T20:45:25.721472+0000","last_peered":"2023-07-19T20:45:25.721472+0000","last_clean":"2023-07-19T20:45:25.721472+0000","last_became_active":"2023-07-19T20:45:24.411559+0000","last_became_peered":"2023-07-19T20:45:24.411559+0000","last_unstale":"2023-07-19T20:45:25.721472+0000","last_undegraded":"2023-07-19T20:45:25.721472+0000","last_fullsized":"2023-07-19T20:45:25.721472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:01:10.625888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391636+0000","last_change":"2023-07-19T20:45:24.000380+0000","last_active":"2023-07-19T20:45:25.391636+0000","last_peered":"2023-07-19T20:45:25.391636+0000","last_clean":"2023-07-19T20:45:25.391636+0000","last_became_active":"2023-07-19T20:45:24.000141+0000","last_became_peered":"2023-07-19T20:45:24.000141+0000","last_unstale":"2023-07-19T20:45:25.391636+0000","last_undegraded":"2023-07-19T20:45:25.391636+0000","last_fullsized":"2023-07-19T20:45:25.391636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:24:03.369424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.390348+0000","last_change":"2023-07-19T20:44:33.124105+0000","last_active":"2023-07-19T20:45:24.390348+0000","last_peered":"2023-07-19T20:45:24.390348+0000","last_clean":"2023-07-19T20:45:24.390348+0000","last_became_active":"2023-07-19T20:44:33.123795+0000","last_became_peered":"2023-07-19T20:44:33.123795+0000","last_unstale":"2023-07-19T20:45:24.390348+0000","last_undegraded":"2023-07-19T20:45:24.390348+0000","last_fullsized":"2023-07-19T20:45:24.390348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:14:19.759142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.413992+0000","last_change":"2023-07-19T20:45:24.410828+0000","last_active":"2023-07-19T20:45:24.413992+0000","last_peered":"2023-07-19T20:45:24.413992+0000","last_clean":"2023-07-19T20:45:24.413992+0000","last_became_active":"2023-07-19T20:45:24.410586+0000","last_became_peered":"2023-07-19T20:45:24.410586+0000","last_unstale":"2023-07-19T20:45:24.413992+0000","last_undegraded":"2023-07-19T20:45:24.413992+0000","last_fullsized":"2023-07-19T20:45:24.413992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T02:47:23.161714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391060+0000","last_change":"2023-07-19T20:45:23.998855+0000","last_active":"2023-07-19T20:45:25.391060+0000","last_peered":"2023-07-19T20:45:25.391060+0000","last_clean":"2023-07-19T20:45:25.391060+0000","last_became_active":"2023-07-19T20:45:23.998568+0000","last_became_peered":"2023-07-19T20:45:23.998568+0000","last_unstale":"2023-07-19T20:45:25.391060+0000","last_undegraded":"2023-07-19T20:45:25.391060+0000","last_fullsized":"2023-07-19T20:45:25.391060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:29:33.566430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-19T20:45:23.991557+0000","last_change":"2023-07-19T20:44:33.124619+0000","last_active":"2023-07-19T20:45:23.991557+0000","last_peered":"2023-07-19T20:45:23.991557+0000","last_clean":"2023-07-19T20:45:23.991557+0000","last_became_active":"2023-07-19T20:44:33.124278+0000","last_became_peered":"2023-07-19T20:44:33.124278+0000","last_unstale":"2023-07-19T20:45:23.991557+0000","last_undegraded":"2023-07-19T20:45:23.991557+0000","last_fullsized":"2023-07-19T20:45:23.991557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:57:12.956476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.402540+0000","last_change":"2023-07-19T20:44:33.129185+0000","last_active":"2023-07-19T20:45:24.402540+0000","last_peered":"2023-07-19T20:45:24.402540+0000","last_clean":"2023-07-19T20:45:24.402540+0000","last_became_active":"2023-07-19T20:44:33.128873+0000","last_became_peered":"2023-07-19T20:44:33.128873+0000","last_unstale":"2023-07-19T20:45:24.402540+0000","last_undegraded":"2023-07-19T20:45:24.402540+0000","last_fullsized":"2023-07-19T20:45:24.402540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:59:43.504158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721438+0000","last_change":"2023-07-19T20:45:24.412533+0000","last_active":"2023-07-19T20:45:25.721438+0000","last_peered":"2023-07-19T20:45:25.721438+0000","last_clean":"2023-07-19T20:45:25.721438+0000","last_became_active":"2023-07-19T20:45:24.411778+0000","last_became_peered":"2023-07-19T20:45:24.411778+0000","last_unstale":"2023-07-19T20:45:25.721438+0000","last_undegraded":"2023-07-19T20:45:25.721438+0000","last_fullsized":"2023-07-19T20:45:25.721438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:10:41.848465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.390830+0000","last_change":"2023-07-19T20:45:24.002028+0000","last_active":"2023-07-19T20:45:24.390830+0000","last_peered":"2023-07-19T20:45:24.390830+0000","last_clean":"2023-07-19T20:45:24.390830+0000","last_became_active":"2023-07-19T20:45:24.001785+0000","last_became_peered":"2023-07-19T20:45:24.001785+0000","last_unstale":"2023-07-19T20:45:24.390830+0000","last_undegraded":"2023-07-19T20:45:24.390830+0000","last_fullsized":"2023-07-19T20:45:24.390830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T01:47:41.710478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.400962+0000","last_change":"2023-07-19T20:44:33.746155+0000","last_active":"2023-07-19T20:45:24.400962+0000","last_peered":"2023-07-19T20:45:24.400962+0000","last_clean":"2023-07-19T20:45:24.400962+0000","last_became_active":"2023-07-19T20:44:33.745839+0000","last_became_peered":"2023-07-19T20:44:33.745839+0000","last_unstale":"2023-07-19T20:45:24.400962+0000","last_undegraded":"2023-07-19T20:45:24.400962+0000","last_fullsized":"2023-07-19T20:45:24.400962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T23:27:53.622247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.390940+0000","last_change":"2023-07-19T20:45:24.405729+0000","last_active":"2023-07-19T20:45:25.390940+0000","last_peered":"2023-07-19T20:45:25.390940+0000","last_clean":"2023-07-19T20:45:25.390940+0000","last_became_active":"2023-07-19T20:45:24.405450+0000","last_became_peered":"2023-07-19T20:45:24.405450+0000","last_unstale":"2023-07-19T20:45:25.390940+0000","last_undegraded":"2023-07-19T20:45:25.390940+0000","last_fullsized":"2023-07-19T20:45:25.390940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:33:50.523963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.721419+0000","last_change":"2023-07-19T20:45:24.004184+0000","last_active":"2023-07-19T20:45:25.721419+0000","last_peered":"2023-07-19T20:45:25.721419+0000","last_clean":"2023-07-19T20:45:25.721419+0000","last_became_active":"2023-07-19T20:45:24.003885+0000","last_became_peered":"2023-07-19T20:45:24.003885+0000","last_unstale":"2023-07-19T20:45:25.721419+0000","last_undegraded":"2023-07-19T20:45:25.721419+0000","last_fullsized":"2023-07-19T20:45:25.721419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:00:22.865793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.402456+0000","last_change":"2023-07-19T20:44:33.746397+0000","last_active":"2023-07-19T20:45:24.402456+0000","last_peered":"2023-07-19T20:45:24.402456+0000","last_clean":"2023-07-19T20:45:24.402456+0000","last_became_active":"2023-07-19T20:44:33.746140+0000","last_became_peered":"2023-07-19T20:44:33.746140+0000","last_unstale":"2023-07-19T20:45:24.402456+0000","last_undegraded":"2023-07-19T20:45:24.402456+0000","last_fullsized":"2023-07-19T20:45:24.402456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T04:56:34.826030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-19T20:45:25.391911+0000","last_change":"2023-07-19T20:45:24.402514+0000","last_active":"2023-07-19T20:45:25.391911+0000","last_peered":"2023-07-19T20:45:25.391911+0000","last_clean":"2023-07-19T20:45:25.391911+0000","last_became_active":"2023-07-19T20:45:24.402284+0000","last_became_peered":"2023-07-19T20:45:24.402284+0000","last_unstale":"2023-07-19T20:45:25.391911+0000","last_undegraded":"2023-07-19T20:45:25.391911+0000","last_fullsized":"2023-07-19T20:45:25.391911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:54:25.000020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.387590+0000","last_change":"2023-07-19T20:45:24.002306+0000","last_active":"2023-07-19T20:45:24.387590+0000","last_peered":"2023-07-19T20:45:24.387590+0000","last_clean":"2023-07-19T20:45:24.387590+0000","last_became_active":"2023-07-19T20:45:24.002058+0000","last_became_peered":"2023-07-19T20:45:24.002058+0000","last_unstale":"2023-07-19T20:45:24.387590+0000","last_undegraded":"2023-07-19T20:45:24.387590+0000","last_fullsized":"2023-07-19T20:45:24.387590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T22:06:04.751696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.393924+0000","last_change":"2023-07-19T20:44:33.746552+0000","last_active":"2023-07-19T20:45:24.393924+0000","last_peered":"2023-07-19T20:45:24.393924+0000","last_clean":"2023-07-19T20:45:24.393924+0000","last_became_active":"2023-07-19T20:44:33.745934+0000","last_became_peered":"2023-07-19T20:44:33.745934+0000","last_unstale":"2023-07-19T20:45:24.393924+0000","last_undegraded":"2023-07-19T20:45:24.393924+0000","last_fullsized":"2023-07-19T20:45:24.393924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:19:16.931517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.413579+0000","last_change":"2023-07-19T20:45:24.410202+0000","last_active":"2023-07-19T20:45:24.413579+0000","last_peered":"2023-07-19T20:45:24.413579+0000","last_clean":"2023-07-19T20:45:24.413579+0000","last_became_active":"2023-07-19T20:45:24.409951+0000","last_became_peered":"2023-07-19T20:45:24.409951+0000","last_unstale":"2023-07-19T20:45:24.413579+0000","last_undegraded":"2023-07-19T20:45:24.413579+0000","last_fullsized":"2023-07-19T20:45:24.413579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T20:58:36.217136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.398733+0000","last_change":"2023-07-19T20:45:23.998984+0000","last_active":"2023-07-19T20:45:24.398733+0000","last_peered":"2023-07-19T20:45:24.398733+0000","last_clean":"2023-07-19T20:45:24.398733+0000","last_became_active":"2023-07-19T20:45:23.998707+0000","last_became_peered":"2023-07-19T20:45:23.998707+0000","last_unstale":"2023-07-19T20:45:24.398733+0000","last_undegraded":"2023-07-19T20:45:24.398733+0000","last_fullsized":"2023-07-19T20:45:24.398733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T00:11:01.461690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-19T20:45:23.993010+0000","last_change":"2023-07-19T20:44:33.746879+0000","last_active":"2023-07-19T20:45:23.993010+0000","last_peered":"2023-07-19T20:45:23.993010+0000","last_clean":"2023-07-19T20:45:23.993010+0000","last_became_active":"2023-07-19T20:44:33.746120+0000","last_became_peered":"2023-07-19T20:44:33.746120+0000","last_unstale":"2023-07-19T20:45:23.993010+0000","last_undegraded":"2023-07-19T20:45:23.993010+0000","last_fullsized":"2023-07-19T20:45:23.993010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T05:34:22.791863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.398488+0000","last_change":"2023-07-19T20:45:24.396350+0000","last_active":"2023-07-19T20:45:24.398488+0000","last_peered":"2023-07-19T20:45:24.398488+0000","last_clean":"2023-07-19T20:45:24.398488+0000","last_became_active":"2023-07-19T20:45:24.396103+0000","last_became_peered":"2023-07-19T20:45:24.396103+0000","last_unstale":"2023-07-19T20:45:24.398488+0000","last_undegraded":"2023-07-19T20:45:24.398488+0000","last_fullsized":"2023-07-19T20:45:24.398488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:23.979993+0000","last_clean_scrub_stamp":"2023-07-19T20:45:23.979993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T06:43:26.720724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-07-19T20:45:24.387601+0000","last_change":"2023-07-19T20:45:23.999083+0000","last_active":"2023-07-19T20:45:24.387601+0000","last_peered":"2023-07-19T20:45:24.387601+0000","last_clean":"2023-07-19T20:45:24.387601+0000","last_became_active":"2023-07-19T20:45:23.998785+0000","last_became_peered":"2023-07-19T20:45:23.998785+0000","last_unstale":"2023-07-19T20:45:24.387601+0000","last_undegraded":"2023-07-19T20:45:24.387601+0000","last_fullsized":"2023-07-19T20:45:24.387601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:45:22.971236+0000","last_clean_scrub_stamp":"2023-07-19T20:45:22.971236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T03:08:14.490724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-19T20:45:23.991781+0000","last_change":"2023-07-19T20:44:33.129202+0000","last_active":"2023-07-19T20:45:23.991781+0000","last_peered":"2023-07-19T20:45:23.991781+0000","last_clean":"2023-07-19T20:45:23.991781+0000","last_became_active":"2023-07-19T20:44:33.128920+0000","last_became_peered":"2023-07-19T20:44:33.128920+0000","last_unstale":"2023-07-19T20:45:23.991781+0000","last_undegraded":"2023-07-19T20:45:23.991781+0000","last_fullsized":"2023-07-19T20:45:23.991781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-19T20:44:32.107714+0000","last_clean_scrub_stamp":"2023-07-19T20:44:32.107714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-20T21:43:18.861932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":966656,"data_stored":734776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":143356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":954368,"data_stored":733232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":142808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":141883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":151025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":376832,"data_stored":150031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":141925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-19T20:45:28.845 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-19T20:45:28.845 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-19T20:45:29.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.010+0000 7f73716e4700 1 Processor -- start 2023-07-19T20:45:29.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.010+0000 7f73716e4700 1 -- start start 2023-07-19T20:45:29.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f73716e4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f736c148f20 0x7f736c149370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f73716e4700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f736c14bd30 0x7f736c14c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f73716e4700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736c1487b0 con 0x7f736c0b8650 2023-07-19T20:45:29.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f73716e4700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c0b9380 con 0x7f736c14bd30 2023-07-19T20:45:29.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f73716e4700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0bbb20 con 0x7f736c148f20 2023-07-19T20:45:29.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f736affd700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f736c0b8650 0x7f736c0bb410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:43214/0 (socket says 172.21.15.117:43214) 2023-07-19T20:45:29.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f736affd700 1 -- 172.21.15.117:0/2559582439 learned_addr learned my addr 172.21.15.117:0/2559582439 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:29.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f736a7fc700 1 --2- 172.21.15.117:0/2559582439 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f736c148f20 0x7f736c149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f736b7fe700 1 --2- 172.21.15.117:0/2559582439 >> v2:172.21.15.124:3300/0 conn(0x7f736c14bd30 0x7f736c14c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f7369ffb700 1 -- 172.21.15.117:0/2559582439 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542721711 0 0) 0x7f736c1487b0 con 0x7f736c0b8650 2023-07-19T20:45:29.007 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f7369ffb700 1 -- 172.21.15.117:0/2559582439 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73540035b0 con 0x7f736c0b8650 2023-07-19T20:45:29.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f7369ffb700 1 -- 172.21.15.117:0/2559582439 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1441836530 0 0) 0x7f73540035b0 con 0x7f736c0b8650 2023-07-19T20:45:29.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f7369ffb700 1 -- 172.21.15.117:0/2559582439 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f736c148f20 msgr2=0x7f736c149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:29.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f7369ffb700 1 --2- 172.21.15.117:0/2559582439 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f736c148f20 0x7f736c149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f7369ffb700 1 -- 172.21.15.117:0/2559582439 >> v2:172.21.15.124:3300/0 conn(0x7f736c14bd30 msgr2=0x7f736c14c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:29.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f7369ffb700 1 --2- 172.21.15.117:0/2559582439 >> v2:172.21.15.124:3300/0 conn(0x7f736c14bd30 0x7f736c14c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.011+0000 7f7369ffb700 1 -- 172.21.15.117:0/2559582439 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c14c7c0 con 0x7f736c0b8650 2023-07-19T20:45:29.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f7369ffb700 1 -- 172.21.15.117:0/2559582439 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7f7360001670 con 0x7f736c0b8650 2023-07-19T20:45:29.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f7369ffb700 1 -- 172.21.15.117:0/2559582439 >> v1:172.21.15.117:6789/0 conn(0x7f736c0b8650 legacy=0x7f736c0bb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:29.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f7369ffb700 1 --2- 172.21.15.117:0/2559582439 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7354003a00 0x7f7354003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f7369ffb700 1 --2- 172.21.15.117:0/2559582439 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f736c148f20 0x7f7354004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f7369ffb700 1 --2- 172.21.15.117:0/2559582439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7354004d90 0x7f7354005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f7369ffb700 1 -- 172.21.15.117:0/2559582439 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0b9380 con 0x7f7354004d90 2023-07-19T20:45:29.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f7369ffb700 1 -- 172.21.15.117:0/2559582439 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0bbb20 con 0x7f7354003a00 2023-07-19T20:45:29.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f7369ffb700 1 -- 172.21.15.117:0/2559582439 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735400ba10 con 0x7f736c148f20 2023-07-19T20:45:29.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f736b7fe700 1 --2- 172.21.15.117:0/2559582439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7354004d90 0x7f7354005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f736affd700 1 --2- 172.21.15.117:0/2559582439 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7354003a00 0x7f7354003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f736a7fc700 1 --2- 172.21.15.117:0/2559582439 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f736c148f20 0x7f7354004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f736b7fe700 1 -- 172.21.15.117:0/2559582439 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f736c148f20 msgr2=0x7f7354004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:29.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f736b7fe700 1 --2- 172.21.15.117:0/2559582439 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f736c148f20 0x7f7354004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f736b7fe700 1 -- 172.21.15.117:0/2559582439 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7354003a00 msgr2=0x7f7354003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:29.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f736b7fe700 1 --2- 172.21.15.117:0/2559582439 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7354003a00 0x7f7354003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f736b7fe700 1 -- 172.21.15.117:0/2559582439 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73540035b0 con 0x7f7354004d90 2023-07-19T20:45:29.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f736a7fc700 1 --2- 172.21.15.117:0/2559582439 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f736c148f20 0x7f7354004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:29.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f736b7fe700 1 --2- 172.21.15.117:0/2559582439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7354004d90 0x7f7354005200 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7364009f90 tx=0x7f7354005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46c42d28d80d533 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:29.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f7369ffb700 1 -- 172.21.15.117:0/2559582439 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736400ec30 con 0x7f7354004d90 2023-07-19T20:45:29.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f7369ffb700 1 -- 172.21.15.117:0/2559582439 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736400f040 con 0x7f7354004d90 2023-07-19T20:45:29.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.012+0000 7f7369ffb700 1 -- 172.21.15.117:0/2559582439 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364014480 con 0x7f7354004d90 2023-07-19T20:45:29.014 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.013+0000 7f73716e4700 1 -- 172.21.15.117:0/2559582439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7354004d90 msgr2=0x7f7354005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:29.014 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.013+0000 7f73716e4700 1 --2- 172.21.15.117:0/2559582439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7354004d90 0x7f7354005200 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7364009f90 tx=0x7f7354005880 comp rx=0 tx=0).stop 2023-07-19T20:45:29.015 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.013+0000 7f736b7fe700 1 -- 172.21.15.117:0/2559582439 reap_dead start 2023-07-19T20:45:29.015 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.013+0000 7f73716e4700 1 -- 172.21.15.117:0/2559582439 shutdown_connections 2023-07-19T20:45:29.015 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.013+0000 7f73716e4700 1 -- 172.21.15.117:0/2559582439 >> 172.21.15.117:0/2559582439 conn(0x7f736c06e9c0 msgr2=0x7f736c06edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:29.015 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.013+0000 7f73716e4700 1 -- 172.21.15.117:0/2559582439 shutdown_connections 2023-07-19T20:45:29.016 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.013+0000 7f73716e4700 1 -- 172.21.15.117:0/2559582439 wait complete. 2023-07-19T20:45:29.016 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.014+0000 7f73716e4700 1 Processor -- start 2023-07-19T20:45:29.016 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.014+0000 7f73716e4700 1 -- start start 2023-07-19T20:45:29.016 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f73716e4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f736c0b76f0 0x7f736c14b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.016 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f73716e4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c149cc0 0x7f736c14a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.016 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f73716e4700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f736c0bc7e0 0x7f736c0bcc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.016 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f73716e4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c14ae20 con 0x7f736c149cc0 2023-07-19T20:45:29.017 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f73716e4700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c147f10 con 0x7f736c0bc7e0 2023-07-19T20:45:29.017 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f73716e4700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c1481f0 con 0x7f736c0b76f0 2023-07-19T20:45:29.017 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f736a7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c149cc0 0x7f736c14a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.017 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f736a7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c149cc0 0x7f736c14a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47480/0 (socket says 172.21.15.117:47480) 2023-07-19T20:45:29.017 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f736a7fc700 1 -- 172.21.15.117:0/367786960 learned_addr learned my addr 172.21.15.117:0/367786960 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:29.017 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f736affd700 1 --2- 172.21.15.117:0/367786960 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f736c0b76f0 0x7f736c14b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.017 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f736b7fe700 1 --2- 172.21.15.117:0/367786960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f736c0bc7e0 0x7f736c0bcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f736a7fc700 1 -- 172.21.15.117:0/367786960 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f736c0b76f0 msgr2=0x7f736c14b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:29.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f736a7fc700 1 --2- 172.21.15.117:0/367786960 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f736c0b76f0 0x7f736c14b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f736a7fc700 1 -- 172.21.15.117:0/367786960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f736c0bc7e0 msgr2=0x7f736c0bcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:29.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f736a7fc700 1 --2- 172.21.15.117:0/367786960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f736c0bc7e0 0x7f736c0bcc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f736a7fc700 1 -- 172.21.15.117:0/367786960 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c1484d0 con 0x7f736c149cc0 2023-07-19T20:45:29.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f736a7fc700 1 --2- 172.21.15.117:0/367786960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c149cc0 0x7f736c14a110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f735c0108f0 tx=0x7f735c010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:29.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f73537fe700 1 -- 172.21.15.117:0/367786960 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c010e90 con 0x7f736c149cc0 2023-07-19T20:45:29.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f73537fe700 1 -- 172.21.15.117:0/367786960 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c004030 con 0x7f736c149cc0 2023-07-19T20:45:29.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.015+0000 7f73537fe700 1 -- 172.21.15.117:0/367786960 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c0043e0 con 0x7f736c149cc0 2023-07-19T20:45:29.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.016+0000 7f73716e4700 1 -- 172.21.15.117:0/367786960 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736c0b7ac0 con 0x7f736c149cc0 2023-07-19T20:45:29.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.016+0000 7f73716e4700 1 -- 172.21.15.117:0/367786960 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736c14a650 con 0x7f736c149cc0 2023-07-19T20:45:29.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.017+0000 7f73716e4700 1 -- 172.21.15.117:0/367786960 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736c14af60 con 0x7f736c149cc0 2023-07-19T20:45:29.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.017+0000 7f73537fe700 1 -- 172.21.15.117:0/367786960 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f735c00e8d0 con 0x7f736c149cc0 2023-07-19T20:45:29.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.017+0000 7f73537fe700 1 --2- 172.21.15.117:0/367786960 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f735806a660 0x7f735806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.018+0000 7f736affd700 1 --2- 172.21.15.117:0/367786960 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f735806a660 0x7f735806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.018+0000 7f73537fe700 1 -- 172.21.15.117:0/367786960 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f735c088fe0 con 0x7f736c149cc0 2023-07-19T20:45:29.020 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.018+0000 7f736affd700 1 --2- 172.21.15.117:0/367786960 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f735806a660 0x7f735806cb10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7360000c00 tx=0x7f7360009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:29.020 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.022+0000 7f73537fe700 1 -- 172.21.15.117:0/367786960 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f735c057ea0 con 0x7f736c149cc0 2023-07-19T20:45:29.276 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.282+0000 7f73716e4700 1 -- 172.21.15.117:0/367786960 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f736c0b5580 con 0x7f736c149cc0 2023-07-19T20:45:29.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.286+0000 7f73537fe700 1 -- 172.21.15.117:0/367786960 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f735c057a30 con 0x7f736c149cc0 2023-07-19T20:45:29.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.288+0000 7f73716e4700 1 -- 172.21.15.117:0/367786960 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f735806a660 msgr2=0x7f735806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:29.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.288+0000 7f73716e4700 1 --2- 172.21.15.117:0/367786960 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f735806a660 0x7f735806cb10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7360000c00 tx=0x7f7360009040 comp rx=0 tx=0).stop 2023-07-19T20:45:29.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.288+0000 7f73716e4700 1 -- 172.21.15.117:0/367786960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c149cc0 msgr2=0x7f736c14a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:29.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.288+0000 7f73716e4700 1 --2- 172.21.15.117:0/367786960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c149cc0 0x7f736c14a110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f735c0108f0 tx=0x7f735c010cb0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.288+0000 7f73716e4700 1 -- 172.21.15.117:0/367786960 shutdown_connections 2023-07-19T20:45:29.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.288+0000 7f73716e4700 1 --2- 172.21.15.117:0/367786960 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f735806a660 0x7f735806cb10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.288+0000 7f73716e4700 1 --2- 172.21.15.117:0/367786960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f736c0bc7e0 0x7f736c0bcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.288+0000 7f73716e4700 1 --2- 172.21.15.117:0/367786960 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f736c0b76f0 0x7f736c14b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.288+0000 7f73716e4700 1 --2- 172.21.15.117:0/367786960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c149cc0 0x7f736c14a110 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.288+0000 7f73716e4700 1 -- 172.21.15.117:0/367786960 >> 172.21.15.117:0/367786960 conn(0x7f736c06e9c0 msgr2=0x7f736c0b94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:29.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.288+0000 7f73716e4700 1 -- 172.21.15.117:0/367786960 shutdown_connections 2023-07-19T20:45:29.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.288+0000 7f73716e4700 1 -- 172.21.15.117:0/367786960 wait complete. 2023-07-19T20:45:29.283 INFO:teuthology.orchestra.run.smithi117.stderr:updated caps for client.0 2023-07-19T20:45:29.294 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-19T20:45:29.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.423+0000 7f61d8139700 1 Processor -- start 2023-07-19T20:45:29.417 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.423+0000 7f61d8139700 1 -- start start 2023-07-19T20:45:29.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.424+0000 7f61d8139700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f61d00bacb0 0x7f61d00702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.424+0000 7f61d8139700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61d00b8da0 0x7f61d00b91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.424+0000 7f61d8139700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d00729d0 con 0x7f61d0071be0 2023-07-19T20:45:29.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.424+0000 7f61d8139700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d00715e0 con 0x7f61d00bacb0 2023-07-19T20:45:29.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.424+0000 7f61d8139700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00717c0 con 0x7f61d00b8da0 2023-07-19T20:45:29.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.424+0000 7f61d5ed5700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f61d00bacb0 0x7f61d00702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.424+0000 7f61d5ed5700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f61d00bacb0 0x7f61d00702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47496/0 (socket says 172.21.15.117:47496) 2023-07-19T20:45:29.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.424+0000 7f61d5ed5700 1 -- 172.21.15.117:0/523795814 learned_addr learned my addr 172.21.15.117:0/523795814 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:29.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.424+0000 7f61d66d6700 1 --2- 172.21.15.117:0/523795814 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61d00b8da0 0x7f61d00b91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.424+0000 7f61d5ed5700 1 -- 172.21.15.117:0/523795814 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61d00b8da0 msgr2=0x7f61d00b91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:29.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.424+0000 7f61d5ed5700 1 --2- 172.21.15.117:0/523795814 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61d00b8da0 0x7f61d00b91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.421 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.424+0000 7f61d5ed5700 1 -- 172.21.15.117:0/523795814 >> v1:172.21.15.124:6789/0 conn(0x7f61d0071be0 legacy=0x7f61d01446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:29.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.424+0000 7f61d5ed5700 1 -- 172.21.15.117:0/523795814 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d0072130 con 0x7f61d00bacb0 2023-07-19T20:45:29.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.424+0000 7f61d5ed5700 1 --2- 172.21.15.117:0/523795814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61d00bacb0 0x7f61d00702f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f61c00098f0 tx=0x7f61c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eae95f9b536a964 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:29.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.425+0000 7f61d4ed3700 1 -- 172.21.15.117:0/523795814 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c000b8a0 con 0x7f61d00bacb0 2023-07-19T20:45:29.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.425+0000 7f61d4ed3700 1 -- 172.21.15.117:0/523795814 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c000ba00 con 0x7f61d00bacb0 2023-07-19T20:45:29.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.425+0000 7f61d4ed3700 1 -- 172.21.15.117:0/523795814 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c000bd90 con 0x7f61d00bacb0 2023-07-19T20:45:29.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.425+0000 7f61d8139700 1 -- 172.21.15.117:0/523795814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61d00bacb0 msgr2=0x7f61d00702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:29.422 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.425+0000 7f61d8139700 1 --2- 172.21.15.117:0/523795814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61d00bacb0 0x7f61d00702f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f61c00098f0 tx=0x7f61c0009c00 comp rx=0 tx=0).stop 2023-07-19T20:45:29.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.425+0000 7f61d8139700 1 -- 172.21.15.117:0/523795814 shutdown_connections 2023-07-19T20:45:29.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.425+0000 7f61d8139700 1 --2- 172.21.15.117:0/523795814 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61d00b8da0 0x7f61d00b91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.425+0000 7f61d8139700 1 --2- 172.21.15.117:0/523795814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61d00bacb0 0x7f61d00702f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.425+0000 7f61d8139700 1 -- 172.21.15.117:0/523795814 >> 172.21.15.117:0/523795814 conn(0x7f61d00be4b0 msgr2=0x7f61d00ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:29.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.425+0000 7f61d8139700 1 -- 172.21.15.117:0/523795814 shutdown_connections 2023-07-19T20:45:29.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.425+0000 7f61d8139700 1 -- 172.21.15.117:0/523795814 wait complete. 2023-07-19T20:45:29.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.426+0000 7f61d8139700 1 Processor -- start 2023-07-19T20:45:29.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.426+0000 7f61d8139700 1 -- start start 2023-07-19T20:45:29.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d8139700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61d0071be0 0x7f61d00b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d8139700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61d00b8da0 0x7f61d00b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d8139700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61d00bacb0 0x7f61d01e1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d8139700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d01d68f0 con 0x7f61d00b8da0 2023-07-19T20:45:29.430 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d8139700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00b60f0 con 0x7f61d00bacb0 2023-07-19T20:45:29.430 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d8139700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00b4d10 con 0x7f61d0071be0 2023-07-19T20:45:29.430 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d56d4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61d00b8da0 0x7f61d00b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.431 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d56d4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61d00b8da0 0x7f61d00b6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47506/0 (socket says 172.21.15.117:47506) 2023-07-19T20:45:29.431 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d56d4700 1 -- 172.21.15.117:0/3152076218 learned_addr learned my addr 172.21.15.117:0/3152076218 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:29.431 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d66d6700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61d00bacb0 0x7f61d01e1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.431 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d5ed5700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61d0071be0 0x7f61d00b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.431 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d56d4700 1 -- 172.21.15.117:0/3152076218 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61d0071be0 msgr2=0x7f61d00b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:29.431 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d56d4700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61d0071be0 0x7f61d00b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.431 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d56d4700 1 -- 172.21.15.117:0/3152076218 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61d00bacb0 msgr2=0x7f61d01e1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:29.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d56d4700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61d00bacb0 0x7f61d01e1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d56d4700 1 -- 172.21.15.117:0/3152076218 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c0009550 con 0x7f61d00b8da0 2023-07-19T20:45:29.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d5ed5700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61d0071be0 0x7f61d00b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:29.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d56d4700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61d00b8da0 0x7f61d00b6a70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00c4e0 tx=0x7f61cc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:29.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61c67fc700 1 -- 172.21.15.117:0/3152076218 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0052d0 con 0x7f61d00b8da0 2023-07-19T20:45:29.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61c67fc700 1 -- 172.21.15.117:0/3152076218 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc005430 con 0x7f61d00b8da0 2023-07-19T20:45:29.432 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61d8139700 1 -- 172.21.15.117:0/3152076218 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d00b4ff0 con 0x7f61d00b8da0 2023-07-19T20:45:29.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.427+0000 7f61c67fc700 1 -- 172.21.15.117:0/3152076218 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0038c0 con 0x7f61d00b8da0 2023-07-19T20:45:29.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.428+0000 7f61d8139700 1 -- 172.21.15.117:0/3152076218 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d00b6fb0 con 0x7f61d00b8da0 2023-07-19T20:45:29.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.428+0000 7f61d8139700 1 -- 172.21.15.117:0/3152076218 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d01e0e90 con 0x7f61d00b8da0 2023-07-19T20:45:29.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.429+0000 7f61c67fc700 1 -- 172.21.15.117:0/3152076218 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f61cc003a20 con 0x7f61d00b8da0 2023-07-19T20:45:29.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.429+0000 7f61c67fc700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f61b406a660 0x7f61b406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:29.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.429+0000 7f61c67fc700 1 -- 172.21.15.117:0/3152076218 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f61cc087dd0 con 0x7f61d00b8da0 2023-07-19T20:45:29.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.429+0000 7f61d5ed5700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f61b406a660 0x7f61b406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:29.433 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.430+0000 7f61d5ed5700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f61b406a660 0x7f61b406cb10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f61c0014040 tx=0x7f61c0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:29.437 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.433+0000 7f61c67fc700 1 -- 172.21.15.117:0/3152076218 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f61cc053260 con 0x7f61d00b8da0 2023-07-19T20:45:29.657 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.663+0000 7f61d8139700 1 -- 172.21.15.117:0/3152076218 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61d0067940 con 0x7f61d00b8da0 2023-07-19T20:45:29.658 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.663+0000 7f61c67fc700 1 -- 172.21.15.117:0/3152076218 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3894 (secure 0 0 0) 0x7f61cc089f50 con 0x7f61d00b8da0 2023-07-19T20:45:29.658 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:45:29.658 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6833/536497381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":536497381},{"type":"v1","addr":"172.21.15.124:6833","nonce":536497381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2489302759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2489302759},{"type":"v1","addr":"172.21.15.117:6836","nonce":2489302759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-19T20:45:24.383082+0000","modified":"2023-07-19T20:45:27.396889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4923":{"gid":4923,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/337131599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":337131599},{"type":"v1","addr":"172.21.15.117:6837","nonce":337131599}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-19T20:45:29.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.665+0000 7f61d8139700 1 -- 172.21.15.117:0/3152076218 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f61b406a660 msgr2=0x7f61b406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:29.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.665+0000 7f61d8139700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f61b406a660 0x7f61b406cb10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f61c0014040 tx=0x7f61c0008030 comp rx=0 tx=0).stop 2023-07-19T20:45:29.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.665+0000 7f61d8139700 1 -- 172.21.15.117:0/3152076218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61d00b8da0 msgr2=0x7f61d00b6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:29.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.665+0000 7f61d8139700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61d00b8da0 0x7f61d00b6a70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00c4e0 tx=0x7f61cc00c7f0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.665+0000 7f61d8139700 1 -- 172.21.15.117:0/3152076218 shutdown_connections 2023-07-19T20:45:29.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.665+0000 7f61d8139700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f61b406a660 0x7f61b406cb10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.660 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.665+0000 7f61d8139700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61d00bacb0 0x7f61d01e1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.661 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.665+0000 7f61d8139700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61d0071be0 0x7f61d00b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.661 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.665+0000 7f61d8139700 1 --2- 172.21.15.117:0/3152076218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61d00b8da0 0x7f61d00b6a70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:29.661 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.665+0000 7f61d8139700 1 -- 172.21.15.117:0/3152076218 >> 172.21.15.117:0/3152076218 conn(0x7f61d00be4b0 msgr2=0x7f61d0142c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:29.661 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.665+0000 7f61d8139700 1 -- 172.21.15.117:0/3152076218 shutdown_connections 2023-07-19T20:45:29.662 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:29.665+0000 7f61d8139700 1 -- 172.21.15.117:0/3152076218 wait complete. 2023-07-19T20:45:29.662 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 15 2023-07-19T20:45:29.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-19T20:45:24.383082+0000', 'modified': '2023-07-19T20:45:27.396889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4923}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4923': {'gid': 4923, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6837/337131599', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6835', 'nonce': 337131599}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 337131599}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-19T20:45:29.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-19T20:45:29.975 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-19T20:45:30.100 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.107+0000 7f07e335d700 1 Processor -- start 2023-07-19T20:45:30.101 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.107+0000 7f07e335d700 1 -- start start 2023-07-19T20:45:30.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.108+0000 7f07e335d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f07dc1426c0 0x7f07dc142af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.108+0000 7f07e335d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc14bca0 0x7f07dc14c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.108+0000 7f07e335d700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc148730 con 0x7f07dc072340 2023-07-19T20:45:30.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.108+0000 7f07e335d700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc1492a0 con 0x7f07dc1426c0 2023-07-19T20:45:30.104 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.108+0000 7f07e335d700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc148970 con 0x7f07dc14bca0 2023-07-19T20:45:30.104 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.108+0000 7f07e18fa700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc14bca0 0x7f07dc14c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.104 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.108+0000 7f07e08f8700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f07dc1426c0 0x7f07dc142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.104 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.108+0000 7f07e10f9700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f07dc072340 0x7f07dc0b8130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.117:45956/0 (socket says 172.21.15.117:45956) 2023-07-19T20:45:30.104 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.108+0000 7f07e10f9700 1 -- 172.21.15.117:0/4101260523 learned_addr learned my addr 172.21.15.117:0/4101260523 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:30.104 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.108+0000 7f07e08f8700 1 -- 172.21.15.117:0/4101260523 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc14bca0 msgr2=0x7f07dc14c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:30.104 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.108+0000 7f07e08f8700 1 --2- 172.21.15.117:0/4101260523 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc14bca0 0x7f07dc14c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.108+0000 7f07e08f8700 1 -- 172.21.15.117:0/4101260523 >> v1:172.21.15.124:6789/0 conn(0x7f07dc072340 legacy=0x7f07dc0b8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.108+0000 7f07d3fff700 1 -- 172.21.15.117:0/4101260523 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786547488 0 0) 0x7f07cc001110 con 0x7f07dc072340 2023-07-19T20:45:30.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.108+0000 7f07e08f8700 1 -- 172.21.15.117:0/4101260523 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc148c50 con 0x7f07dc1426c0 2023-07-19T20:45:30.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.109+0000 7f07e08f8700 1 --2- 172.21.15.117:0/4101260523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc1426c0 0x7f07dc142af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009840 tx=0x7f07d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8de894d509923b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:30.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.109+0000 7f07d3fff700 1 -- 172.21.15.117:0/4101260523 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8011830 con 0x7f07dc1426c0 2023-07-19T20:45:30.105 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.109+0000 7f07d3fff700 1 -- 172.21.15.117:0/4101260523 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d8011990 con 0x7f07dc1426c0 2023-07-19T20:45:30.106 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.109+0000 7f07d3fff700 1 -- 172.21.15.117:0/4101260523 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8011d20 con 0x7f07dc1426c0 2023-07-19T20:45:30.106 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.109+0000 7f07e335d700 1 -- 172.21.15.117:0/4101260523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc1426c0 msgr2=0x7f07dc142af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.106 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.109+0000 7f07e335d700 1 --2- 172.21.15.117:0/4101260523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc1426c0 0x7f07dc142af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009840 tx=0x7f07d8009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:30.106 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.109+0000 7f07e335d700 1 -- 172.21.15.117:0/4101260523 shutdown_connections 2023-07-19T20:45:30.106 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.109+0000 7f07e335d700 1 --2- 172.21.15.117:0/4101260523 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc14bca0 0x7f07dc14c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.106 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.109+0000 7f07e335d700 1 --2- 172.21.15.117:0/4101260523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc1426c0 0x7f07dc142af0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.107 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.109+0000 7f07e335d700 1 -- 172.21.15.117:0/4101260523 >> 172.21.15.117:0/4101260523 conn(0x7f07dc0bd8b0 msgr2=0x7f07dc0bdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:30.107 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.109+0000 7f07e335d700 1 -- 172.21.15.117:0/4101260523 shutdown_connections 2023-07-19T20:45:30.107 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.109+0000 7f07e335d700 1 -- 172.21.15.117:0/4101260523 wait complete. 2023-07-19T20:45:30.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.110+0000 7f07e335d700 1 Processor -- start 2023-07-19T20:45:30.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.110+0000 7f07e335d700 1 -- start start 2023-07-19T20:45:30.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e335d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07dc072340 0x7f07dc14b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e335d700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc1426c0 0x7f07dc1de3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e335d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc14bca0 0x7f07dc1de900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e335d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc0bd2d0 con 0x7f07dc072340 2023-07-19T20:45:30.114 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e335d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc149ef0 con 0x7f07dc14bca0 2023-07-19T20:45:30.115 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e335d700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc1ddf30 con 0x7f07dc1426c0 2023-07-19T20:45:30.115 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e10f9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07dc072340 0x7f07dc14b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.115 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e10f9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07dc072340 0x7f07dc14b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47510/0 (socket says 172.21.15.117:47510) 2023-07-19T20:45:30.115 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e10f9700 1 -- 172.21.15.117:0/1284084051 learned_addr learned my addr 172.21.15.117:0/1284084051 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:30.115 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e18fa700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc14bca0 0x7f07dc1de900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e08f8700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc1426c0 0x7f07dc1de3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e10f9700 1 -- 172.21.15.117:0/1284084051 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc1426c0 msgr2=0x7f07dc1de3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e10f9700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc1426c0 0x7f07dc1de3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e10f9700 1 -- 172.21.15.117:0/1284084051 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc14bca0 msgr2=0x7f07dc1de900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.116 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e10f9700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc14bca0 0x7f07dc1de900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.117 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e10f9700 1 -- 172.21.15.117:0/1284084051 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d80094a0 con 0x7f07dc072340 2023-07-19T20:45:30.117 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.111+0000 7f07e08f8700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc1426c0 0x7f07dc1de3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-19T20:45:30.117 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.112+0000 7f07e10f9700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07dc072340 0x7f07dc14b370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00c580 tx=0x7f07cc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:30.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.112+0000 7f07d1ffb700 1 -- 172.21.15.117:0/1284084051 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc004c80 con 0x7f07dc072340 2023-07-19T20:45:30.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.112+0000 7f07d1ffb700 1 -- 172.21.15.117:0/1284084051 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc004e00 con 0x7f07dc072340 2023-07-19T20:45:30.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.112+0000 7f07d1ffb700 1 -- 172.21.15.117:0/1284084051 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc007310 con 0x7f07dc072340 2023-07-19T20:45:30.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.112+0000 7f07e335d700 1 -- 172.21.15.117:0/1284084051 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc1d2aa0 con 0x7f07dc072340 2023-07-19T20:45:30.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.112+0000 7f07e335d700 1 -- 172.21.15.117:0/1284084051 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc149c10 con 0x7f07dc072340 2023-07-19T20:45:30.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.113+0000 7f07d1ffb700 1 -- 172.21.15.117:0/1284084051 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f07cc007470 con 0x7f07dc072340 2023-07-19T20:45:30.118 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.114+0000 7f07d1ffb700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f07c006a660 0x7f07c006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.119 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.114+0000 7f07e08f8700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f07c006a660 0x7f07c006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.119 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.114+0000 7f07d1ffb700 1 -- 172.21.15.117:0/1284084051 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f07cc0885b0 con 0x7f07dc072340 2023-07-19T20:45:30.119 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.114+0000 7f07e08f8700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f07c006a660 0x7f07c006cb10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009840 tx=0x7f07d8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:30.119 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.116+0000 7f07ef501b80 1 Processor -- start 2023-07-19T20:45:30.119 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.116+0000 7f07ef501b80 1 -- start start 2023-07-19T20:45:30.119 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.116+0000 7f07ef501b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03218210 0x563a03214610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.116+0000 7f07ef501b80 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 0x563a03214b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.116+0000 7f07ef501b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03245c10 0x563a03246080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.116+0000 7f07ef501b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a031841e0 con 0x563a03218210 2023-07-19T20:45:30.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.116+0000 7f07ef501b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a03102fd0 con 0x563a03245c10 2023-07-19T20:45:30.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.116+0000 7f07ef501b80 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a03171eb0 con 0x563a032185e0 2023-07-19T20:45:30.120 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07e10f9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03218210 0x563a03214610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07e10f9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03218210 0x563a03214610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47520/0 (socket says 172.21.15.117:47520) 2023-07-19T20:45:30.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07e10f9700 1 -- 172.21.15.117:0/1549978821 learned_addr learned my addr 172.21.15.117:0/1549978821 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:30.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07e08f8700 1 --2- 172.21.15.117:0/1549978821 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 0x563a03214b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07e10f9700 1 -- 172.21.15.117:0/1549978821 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 msgr2=0x563a03214b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:30.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07e18fa700 1 --2- 172.21.15.117:0/1549978821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03245c10 0x563a03246080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.121 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07e10f9700 1 --2- 172.21.15.117:0/1549978821 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 0x563a03214b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.122 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07e10f9700 1 -- 172.21.15.117:0/1549978821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03245c10 msgr2=0x563a03246080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:30.122 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07e10f9700 1 --2- 172.21.15.117:0/1549978821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03245c10 0x563a03246080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.122 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07e10f9700 1 -- 172.21.15.117:0/1549978821 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a02f5f790 con 0x563a03218210 2023-07-19T20:45:30.122 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07e08f8700 1 --2- 172.21.15.117:0/1549978821 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 0x563a03214b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:30.122 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07e10f9700 1 --2- 172.21.15.117:0/1549978821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03218210 0x563a03214610 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f07cc057360 tx=0x7f07cc057220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54cc42b2092dbb08 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:30.122 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07beffd700 1 -- 172.21.15.117:0/1549978821 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc05f9b0 con 0x563a03218210 2023-07-19T20:45:30.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07beffd700 1 -- 172.21.15.117:0/1549978821 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc055a00 con 0x563a03218210 2023-07-19T20:45:30.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.117+0000 7f07beffd700 1 -- 172.21.15.117:0/1549978821 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc056d50 con 0x563a03218210 2023-07-19T20:45:30.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.118+0000 7f07ef501b80 1 -- 172.21.15.117:0/1549978821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03218210 msgr2=0x563a03214610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.118+0000 7f07ef501b80 1 --2- 172.21.15.117:0/1549978821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03218210 0x563a03214610 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f07cc057360 tx=0x7f07cc057220 comp rx=0 tx=0).stop 2023-07-19T20:45:30.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.118+0000 7f07ef501b80 1 -- 172.21.15.117:0/1549978821 shutdown_connections 2023-07-19T20:45:30.123 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.118+0000 7f07ef501b80 1 --2- 172.21.15.117:0/1549978821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03245c10 0x563a03246080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.118+0000 7f07ef501b80 1 --2- 172.21.15.117:0/1549978821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03218210 0x563a03214610 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.118+0000 7f07ef501b80 1 --2- 172.21.15.117:0/1549978821 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 0x563a03214b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.118+0000 7f07ef501b80 1 -- 172.21.15.117:0/1549978821 >> 172.21.15.117:0/1549978821 conn(0x563a0320f1b0 msgr2=0x563a03219130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:30.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.118+0000 7f07ef501b80 1 -- 172.21.15.117:0/1549978821 shutdown_connections 2023-07-19T20:45:30.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.118+0000 7f07ef501b80 1 -- 172.21.15.117:0/1549978821 wait complete. 2023-07-19T20:45:30.124 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.118+0000 7f07ef501b80 1 -- start start 2023-07-19T20:45:30.125 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.118+0000 7f07ef501b80 1 Processor -- start 2023-07-19T20:45:30.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.119+0000 7f07ef501b80 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a03218210 0x563a03242e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.119+0000 7f07ef501b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a032185e0 0x563a032442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.129 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.119+0000 7f07ef501b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a0325fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.130 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.119+0000 7f07ef501b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0316b220 con 0x563a03245c10 2023-07-19T20:45:30.130 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.119+0000 7f07ef501b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a03107770 con 0x563a032185e0 2023-07-19T20:45:30.130 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.119+0000 7f07ef501b80 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a0312a6f0 con 0x563a03218210 2023-07-19T20:45:30.130 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.119+0000 7f07ef501b80 10 client.0 _ll_register_callbacks cb 0x563a031094e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-19T20:45:30.130 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.119+0000 7f07e18fa700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a0325fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.130 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.119+0000 7f07e18fa700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a0325fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47528/0 (socket says 172.21.15.117:47528) 2023-07-19T20:45:30.130 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.119+0000 7f07e18fa700 1 -- 172.21.15.117:0/2513343503 learned_addr learned my addr 172.21.15.117:0/2513343503 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:30.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.119+0000 7f07e10f9700 1 --2- 172.21.15.117:0/2513343503 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a03218210 0x563a03242e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.119+0000 7f07e08f8700 1 --2- 172.21.15.117:0/2513343503 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a032185e0 0x563a032442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07e18fa700 1 -- 172.21.15.117:0/2513343503 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a03218210 msgr2=0x563a03242e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:30.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07e18fa700 1 --2- 172.21.15.117:0/2513343503 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a03218210 0x563a03242e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07e18fa700 1 -- 172.21.15.117:0/2513343503 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a032185e0 msgr2=0x563a032442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:30.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07e18fa700 1 --2- 172.21.15.117:0/2513343503 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a032185e0 0x563a032442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07e18fa700 1 -- 172.21.15.117:0/2513343503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc149c10 con 0x563a03245c10 2023-07-19T20:45:30.131 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07e18fa700 1 --2- 172.21.15.117:0/2513343503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a0325fa50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f07d4007d90 tx=0x7f07d4012520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a053b91f309ad5 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:30.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2023-07-19T20:45:30.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07b7fff700 1 -- 172.21.15.117:0/2513343503 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400e040 con 0x563a03245c10 2023-07-19T20:45:30.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07b7fff700 1 -- 172.21.15.117:0/2513343503 <== mon.0 v2:172.21.15.117:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f07d4012c00 con 0x563a03245c10 2023-07-19T20:45:30.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07ef501b80 1 -- 172.21.15.117:0/2513343503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a030c5b00 con 0x563a03245c10 2023-07-19T20:45:30.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07b7fff700 1 -- 172.21.15.117:0/2513343503 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07d4012dc0 con 0x563a03245c10 2023-07-19T20:45:30.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07ef501b80 10 client.5103 fetch_fsmap learned FSMap version 15 2023-07-19T20:45:30.132 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07ef501b80 1 -- 172.21.15.117:0/2513343503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x563a0304c0a0 con 0x563a03245c10 2023-07-19T20:45:30.133 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07b7fff700 1 -- 172.21.15.117:0/2513343503 <== mon.0 v2:172.21.15.117:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563a030c5b00 con 0x563a03245c10 2023-07-19T20:45:30.133 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07b7fff700 1 -- 172.21.15.117:0/2513343503 <== mon.0 v2:172.21.15.117:3300/0 5 ==== fsmap(e 15) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f07d4014040 con 0x563a03245c10 2023-07-19T20:45:30.133 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07ef501b80 10 client.5103 fetch_fsmap finished waiting for FSMap version 15 2023-07-19T20:45:30.133 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07ef501b80 10 client.5103 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-19T20:45:30.133 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07ef501b80 20 client.5103 populate_metadata read hostname 'smithi117' 2023-07-19T20:45:30.133 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07ef501b80 1 --2- 172.21.15.117:0/2513343503 >> [v2:172.21.15.117:6835/337131599,v1:172.21.15.117:6837/337131599] conn(0x563a03260690 0x563a032371b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.133 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07ef501b80 4 client.5103 mds_command: new command op to 4923 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-19T20:45:30.133 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07ef501b80 1 -- 172.21.15.117:0/2513343503 --> [v2:172.21.15.117:6835/337131599,v1:172.21.15.117:6837/337131599] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a03164400 con 0x563a03260690 2023-07-19T20:45:30.134 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.120+0000 7f07e10f9700 1 --2- 172.21.15.117:0/2513343503 >> [v2:172.21.15.117:6835/337131599,v1:172.21.15.117:6837/337131599] conn(0x563a03260690 0x563a032371b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.134 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.121+0000 7f07b7fff700 10 client.5103 ms_handle_connect on v2:172.21.15.117:6835/337131599 2023-07-19T20:45:30.134 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.121+0000 7f07e10f9700 1 --2- 172.21.15.117:0/2513343503 >> [v2:172.21.15.117:6835/337131599,v1:172.21.15.117:6837/337131599] conn(0x563a03260690 0x563a032371b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=432a9db8b9084c53 server_cookie=aac20a4aa75dd561 in_seq=0 out_seq=0 2023-07-19T20:45:30.134 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.121+0000 7f07b7fff700 1 -- 172.21.15.117:0/2513343503 <== mds.0 v2:172.21.15.117:6835/337131599 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x563a03164400 con 0x563a03260690 2023-07-19T20:45:30.134 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.121+0000 7f07b7fff700 10 client.5103 handle_command_reply: tid=0 2023-07-19T20:45:30.134 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.121+0000 7f07ef501b80 1 client.5103 shutdown 2023-07-19T20:45:30.134 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.121+0000 7f07ef501b80 1 -- 172.21.15.117:0/2513343503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 msgr2=0x563a0325fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.135 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.121+0000 7f07ef501b80 1 --2- 172.21.15.117:0/2513343503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a0325fa50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f07d4007d90 tx=0x7f07d4012520 comp rx=0 tx=0).stop 2023-07-19T20:45:30.135 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.121+0000 7f07ef501b80 1 -- 172.21.15.117:0/2513343503 shutdown_connections 2023-07-19T20:45:30.135 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.121+0000 7f07ef501b80 1 --2- 172.21.15.117:0/2513343503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a0325fa50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.135 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.121+0000 7f07ef501b80 1 --2- 172.21.15.117:0/2513343503 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a03218210 0x563a03242e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.135 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.121+0000 7f07ef501b80 1 --2- 172.21.15.117:0/2513343503 >> [v2:172.21.15.117:6835/337131599,v1:172.21.15.117:6837/337131599] conn(0x563a03260690 0x563a032371b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.135 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.121+0000 7f07ef501b80 1 --2- 172.21.15.117:0/2513343503 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a032185e0 0x563a032442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.135 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.121+0000 7f07b7fff700 0 client.5103 ms_handle_reset on v2:172.21.15.117:6835/337131599 2023-07-19T20:45:30.135 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.121+0000 7f07ef501b80 1 -- 172.21.15.117:0/2513343503 >> 172.21.15.117:0/2513343503 conn(0x563a0320f1b0 msgr2=0x563a03240d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:30.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.122+0000 7f07ef501b80 1 -- 172.21.15.117:0/2513343503 shutdown_connections 2023-07-19T20:45:30.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.122+0000 7f07ef501b80 1 -- 172.21.15.117:0/2513343503 wait complete. 2023-07-19T20:45:30.136 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.122+0000 7f07ef501b80 20 client.5103 trim_cache size 0 max 16384 2023-07-19T20:45:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07ef501b80 1 Processor -- start 2023-07-19T20:45:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07ef501b80 1 -- start start 2023-07-19T20:45:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07ef501b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03218210 0x563a032143d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07ef501b80 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 0x563a03242c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07ef501b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a03219dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07ef501b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a02f60390 con 0x563a03245c10 2023-07-19T20:45:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07ef501b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0326f590 con 0x563a03218210 2023-07-19T20:45:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07ef501b80 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a03244fb0 con 0x563a032185e0 2023-07-19T20:45:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07e18fa700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a03219dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07e18fa700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a03219dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47538/0 (socket says 172.21.15.117:47538) 2023-07-19T20:45:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07e18fa700 1 -- 172.21.15.117:0/3897801453 learned_addr learned my addr 172.21.15.117:0/3897801453 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:30.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07e10f9700 1 --2- 172.21.15.117:0/3897801453 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03218210 0x563a032143d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07e08f8700 1 --2- 172.21.15.117:0/3897801453 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 0x563a03242c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07e18fa700 1 -- 172.21.15.117:0/3897801453 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 msgr2=0x563a03242c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:30.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07e18fa700 1 --2- 172.21.15.117:0/3897801453 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 0x563a03242c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07e18fa700 1 -- 172.21.15.117:0/3897801453 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03218210 msgr2=0x563a032143d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:30.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07e18fa700 1 --2- 172.21.15.117:0/3897801453 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03218210 0x563a032143d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.139+0000 7f07e18fa700 1 -- 172.21.15.117:0/3897801453 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a03132010 con 0x563a03245c10 2023-07-19T20:45:30.143 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.140+0000 7f07e08f8700 1 --2- 172.21.15.117:0/3897801453 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 0x563a03242c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-19T20:45:30.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.140+0000 7f07e18fa700 1 --2- 172.21.15.117:0/3897801453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a03219dc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009a40 tx=0x7f07d4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d717da31e1901593 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:30.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.140+0000 7f07bf7fe700 1 -- 172.21.15.117:0/3897801453 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400e070 con 0x563a03245c10 2023-07-19T20:45:30.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.140+0000 7f07bf7fe700 1 -- 172.21.15.117:0/3897801453 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d400f040 con 0x563a03245c10 2023-07-19T20:45:30.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.140+0000 7f07bf7fe700 1 -- 172.21.15.117:0/3897801453 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4012c40 con 0x563a03245c10 2023-07-19T20:45:30.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.140+0000 7f07ef501b80 1 -- 172.21.15.117:0/3897801453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 msgr2=0x563a03219dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.140+0000 7f07ef501b80 1 --2- 172.21.15.117:0/3897801453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a03219dc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009a40 tx=0x7f07d4018000 comp rx=0 tx=0).stop 2023-07-19T20:45:30.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.140+0000 7f07ef501b80 1 -- 172.21.15.117:0/3897801453 shutdown_connections 2023-07-19T20:45:30.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.140+0000 7f07ef501b80 1 --2- 172.21.15.117:0/3897801453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a03219dc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.140+0000 7f07ef501b80 1 --2- 172.21.15.117:0/3897801453 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03218210 0x563a032143d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.140+0000 7f07ef501b80 1 --2- 172.21.15.117:0/3897801453 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 0x563a03242c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.140+0000 7f07ef501b80 1 -- 172.21.15.117:0/3897801453 >> 172.21.15.117:0/3897801453 conn(0x563a0320f1b0 msgr2=0x563a03219130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:30.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.140+0000 7f07ef501b80 1 -- 172.21.15.117:0/3897801453 shutdown_connections 2023-07-19T20:45:30.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.140+0000 7f07ef501b80 1 -- 172.21.15.117:0/3897801453 wait complete. 2023-07-19T20:45:30.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.141+0000 7f07ef501b80 1 -- start start 2023-07-19T20:45:30.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.141+0000 7f07ef501b80 1 Processor -- start 2023-07-19T20:45:30.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.142+0000 7f07ef501b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03218210 0x563a03213a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.142+0000 7f07ef501b80 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 0x563a032af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.142+0000 7f07ef501b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a032afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.142+0000 7f07ef501b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a032b5d30 con 0x563a03245c10 2023-07-19T20:45:30.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.142+0000 7f07ef501b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a03242580 con 0x563a03218210 2023-07-19T20:45:30.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.142+0000 7f07ef501b80 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a03213590 con 0x563a032185e0 2023-07-19T20:45:30.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.142+0000 7f07ef501b80 10 client.0 _ll_register_callbacks cb 0x7f07d40076d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-19T20:45:30.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.142+0000 7f07e18fa700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a032afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.142+0000 7f07e18fa700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a032afaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47546/0 (socket says 172.21.15.117:47546) 2023-07-19T20:45:30.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.142+0000 7f07e18fa700 1 -- 172.21.15.117:0/2556107787 learned_addr learned my addr 172.21.15.117:0/2556107787 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:30.149 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.142+0000 7f07e10f9700 1 --2- 172.21.15.117:0/2556107787 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03218210 0x563a03213a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.149 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07e08f8700 1 --2- 172.21.15.117:0/2556107787 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 0x563a032af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.149 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07e18fa700 1 -- 172.21.15.117:0/2556107787 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 msgr2=0x563a032af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:30.149 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07e18fa700 1 --2- 172.21.15.117:0/2556107787 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 0x563a032af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.149 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07e18fa700 1 -- 172.21.15.117:0/2556107787 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03218210 msgr2=0x563a03213a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:30.149 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07e18fa700 1 --2- 172.21.15.117:0/2556107787 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03218210 0x563a03213a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.149 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07e18fa700 1 -- 172.21.15.117:0/2556107787 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a0304c0a0 con 0x563a03245c10 2023-07-19T20:45:30.150 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07e18fa700 1 --2- 172.21.15.117:0/2556107787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a032afaf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f07d4023040 tx=0x7f07d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad80d71f157f563 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:30.150 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2023-07-19T20:45:30.150 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07b7fff700 1 -- 172.21.15.117:0/2556107787 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400e050 con 0x563a03245c10 2023-07-19T20:45:30.150 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07b7fff700 1 -- 172.21.15.117:0/2556107787 <== mon.0 v2:172.21.15.117:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f07d40189b0 con 0x563a03245c10 2023-07-19T20:45:30.150 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07ef501b80 1 -- 172.21.15.117:0/2556107787 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f07cc055a00 con 0x563a03245c10 2023-07-19T20:45:30.150 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07b7fff700 1 -- 172.21.15.117:0/2556107787 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07d4007bd0 con 0x563a03245c10 2023-07-19T20:45:30.150 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07ef501b80 10 client.5109 fetch_fsmap learned FSMap version 15 2023-07-19T20:45:30.151 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07ef501b80 1 -- 172.21.15.117:0/2556107787 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x563a02fc01d0 con 0x563a03245c10 2023-07-19T20:45:30.151 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07b7fff700 1 -- 172.21.15.117:0/2556107787 <== mon.0 v2:172.21.15.117:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc055a00 con 0x563a03245c10 2023-07-19T20:45:30.151 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07b7fff700 1 -- 172.21.15.117:0/2556107787 <== mon.0 v2:172.21.15.117:3300/0 5 ==== fsmap(e 15) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f07d4012240 con 0x563a03245c10 2023-07-19T20:45:30.151 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07ef501b80 10 client.5109 fetch_fsmap finished waiting for FSMap version 15 2023-07-19T20:45:30.151 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07ef501b80 10 client.5109 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-19T20:45:30.151 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07ef501b80 20 client.5109 populate_metadata read hostname 'smithi117' 2023-07-19T20:45:30.151 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07ef501b80 1 --2- 172.21.15.117:0/2556107787 >> [v2:172.21.15.117:6835/337131599,v1:172.21.15.117:6837/337131599] conn(0x563a03264300 0x563a032b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.152 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07ef501b80 4 client.5109 mds_command: new command op to 4923 tid=0[{"prefix": "status"}] 2023-07-19T20:45:30.152 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07ef501b80 1 -- 172.21.15.117:0/2556107787 --> [v2:172.21.15.117:6835/337131599,v1:172.21.15.117:6837/337131599] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563a02fbaef0 con 0x563a03264300 2023-07-19T20:45:30.152 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.143+0000 7f07e10f9700 1 --2- 172.21.15.117:0/2556107787 >> [v2:172.21.15.117:6835/337131599,v1:172.21.15.117:6837/337131599] conn(0x563a03264300 0x563a032b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.152 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07b7fff700 10 client.5109 ms_handle_connect on v2:172.21.15.117:6835/337131599 2023-07-19T20:45:30.152 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07e10f9700 1 --2- 172.21.15.117:0/2556107787 >> [v2:172.21.15.117:6835/337131599,v1:172.21.15.117:6837/337131599] conn(0x563a03264300 0x563a032b8e00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaaff5fa61c00cc7 server_cookie=6c8b8a4448187b3d in_seq=0 out_seq=0 2023-07-19T20:45:30.152 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07b7fff700 1 -- 172.21.15.117:0/2556107787 <== mds.0 v2:172.21.15.117:6835/337131599 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x563a02fbaef0 con 0x563a03264300 2023-07-19T20:45:30.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07b7fff700 10 client.5109 handle_command_reply: tid=0 2023-07-19T20:45:30.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07ef501b80 1 client.5109 shutdown 2023-07-19T20:45:30.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07ef501b80 1 -- 172.21.15.117:0/2556107787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 msgr2=0x563a032afaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07ef501b80 1 --2- 172.21.15.117:0/2556107787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a032afaf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f07d4023040 tx=0x7f07d4004ad0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07ef501b80 1 -- 172.21.15.117:0/2556107787 shutdown_connections 2023-07-19T20:45:30.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07ef501b80 1 --2- 172.21.15.117:0/2556107787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a03245c10 0x563a032afaf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07ef501b80 1 --2- 172.21.15.117:0/2556107787 >> [v2:172.21.15.117:6835/337131599,v1:172.21.15.117:6837/337131599] conn(0x563a03264300 0x563a032b8e00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07ef501b80 1 --2- 172.21.15.117:0/2556107787 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563a03218210 0x563a03213a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07ef501b80 1 --2- 172.21.15.117:0/2556107787 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x563a032185e0 0x563a032af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07b7fff700 0 client.5109 ms_handle_reset on v2:172.21.15.117:6835/337131599 2023-07-19T20:45:30.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07ef501b80 1 -- 172.21.15.117:0/2556107787 >> 172.21.15.117:0/2556107787 conn(0x563a0320f1b0 msgr2=0x563a032143d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:30.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07ef501b80 1 -- 172.21.15.117:0/2556107787 shutdown_connections 2023-07-19T20:45:30.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07ef501b80 1 -- 172.21.15.117:0/2556107787 wait complete. 2023-07-19T20:45:30.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.144+0000 7f07ef501b80 20 client.5109 trim_cache size 0 max 16384 2023-07-19T20:45:30.155 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-07-19T20:45:30.156 INFO:teuthology.orchestra.run.smithi117.stdout: "cluster_fsid": "46db5732-4a4f-4d1e-835b-9507e9513c02", 2023-07-19T20:45:30.156 INFO:teuthology.orchestra.run.smithi117.stdout: "whoami": 0, 2023-07-19T20:45:30.156 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4923, 2023-07-19T20:45:30.157 INFO:teuthology.orchestra.run.smithi117.stdout: "want_state": "up:active", 2023-07-19T20:45:30.157 INFO:teuthology.orchestra.run.smithi117.stdout: "state": "up:active", 2023-07-19T20:45:30.157 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs", 2023-07-19T20:45:30.157 INFO:teuthology.orchestra.run.smithi117.stdout: "rank_uptime": 5.7603075989999999, 2023-07-19T20:45:30.157 INFO:teuthology.orchestra.run.smithi117.stdout: "mdsmap_epoch": 15, 2023-07-19T20:45:30.157 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_epoch": 33, 2023-07-19T20:45:30.158 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_epoch_barrier": 33, 2023-07-19T20:45:30.158 INFO:teuthology.orchestra.run.smithi117.stdout: "uptime": 13.121879034000001 2023-07-19T20:45:30.158 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-07-19T20:45:30.159 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.145+0000 7f07e335d700 1 -- 172.21.15.117:0/1284084051 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f07c006a660 msgr2=0x7f07c006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.159 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.145+0000 7f07e335d700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f07c006a660 0x7f07c006cb10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009840 tx=0x7f07d8008030 comp rx=0 tx=0).stop 2023-07-19T20:45:30.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.145+0000 7f07e335d700 1 -- 172.21.15.117:0/1284084051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07dc072340 msgr2=0x7f07dc14b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.145+0000 7f07e335d700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07dc072340 0x7f07dc14b370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00c580 tx=0x7f07cc00c890 comp rx=0 tx=0).stop 2023-07-19T20:45:30.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.145+0000 7f07e335d700 1 -- 172.21.15.117:0/1284084051 shutdown_connections 2023-07-19T20:45:30.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.145+0000 7f07e335d700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f07c006a660 0x7f07c006cb10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.145+0000 7f07e335d700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc14bca0 0x7f07dc1de900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.145+0000 7f07e335d700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07dc072340 0x7f07dc14b370 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.145+0000 7f07e335d700 1 --2- 172.21.15.117:0/1284084051 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc1426c0 0x7f07dc1de3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.145+0000 7f07e335d700 1 -- 172.21.15.117:0/1284084051 >> 172.21.15.117:0/1284084051 conn(0x7f07dc0bd8b0 msgr2=0x7f07dc0bdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:30.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.145+0000 7f07e335d700 1 -- 172.21.15.117:0/1284084051 shutdown_connections 2023-07-19T20:45:30.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.145+0000 7f07e335d700 1 -- 172.21.15.117:0/1284084051 wait complete. 2023-07-19T20:45:30.162 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-19T20:45:30.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.289+0000 7f25289f9700 1 Processor -- start 2023-07-19T20:45:30.283 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.289+0000 7f25289f9700 1 -- start start 2023-07-19T20:45:30.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f25289f9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f25240b7ce0 0x7f2524149250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f25289f9700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f25240a1080 0x7f25240b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f25289f9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25240a09f0 con 0x7f2524142630 2023-07-19T20:45:30.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f25289f9700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25241487e0 con 0x7f25240a1080 2023-07-19T20:45:30.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f25289f9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2524148a50 con 0x7f25240b7ce0 2023-07-19T20:45:30.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f2522d9d700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f2524142630 0x7f252414bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:43218/0 (socket says 172.21.15.117:43218) 2023-07-19T20:45:30.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f2522d9d700 1 -- 172.21.15.117:0/1341489956 learned_addr learned my addr 172.21.15.117:0/1341489956 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:45:30.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f2521d9b700 1 --2- 172.21.15.117:0/1341489956 >> v2:172.21.15.124:3300/0 conn(0x7f25240a1080 0x7f25240b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f252259c700 1 --2- 172.21.15.117:0/1341489956 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f25240b7ce0 0x7f2524149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f252159a700 1 -- 172.21.15.117:0/1341489956 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496621674 0 0) 0x7f25240a09f0 con 0x7f2524142630 2023-07-19T20:45:30.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f252159a700 1 -- 172.21.15.117:0/1341489956 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f250c0035b0 con 0x7f2524142630 2023-07-19T20:45:30.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f2521d9b700 1 -- 172.21.15.117:0/1341489956 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f25240b7ce0 msgr2=0x7f2524149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:45:30.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f2521d9b700 1 --2- 172.21.15.117:0/1341489956 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f25240b7ce0 0x7f2524149250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f2521d9b700 1 -- 172.21.15.117:0/1341489956 >> v1:172.21.15.117:6789/0 conn(0x7f2524142630 legacy=0x7f252414bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f2521d9b700 1 -- 172.21.15.117:0/1341489956 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2524148d30 con 0x7f25240a1080 2023-07-19T20:45:30.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.290+0000 7f2521d9b700 1 --2- 172.21.15.117:0/1341489956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25240a1080 0x7f25240b8b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2518009840 tx=0x7f2518009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adcaacf7f31ba725 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:30.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.291+0000 7f252159a700 1 -- 172.21.15.117:0/1341489956 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518011830 con 0x7f25240a1080 2023-07-19T20:45:30.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.291+0000 7f252159a700 1 -- 172.21.15.117:0/1341489956 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2518011990 con 0x7f25240a1080 2023-07-19T20:45:30.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.291+0000 7f252159a700 1 -- 172.21.15.117:0/1341489956 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518011d20 con 0x7f25240a1080 2023-07-19T20:45:30.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.291+0000 7f25289f9700 1 -- 172.21.15.117:0/1341489956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25240a1080 msgr2=0x7f25240b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.291+0000 7f25289f9700 1 --2- 172.21.15.117:0/1341489956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25240a1080 0x7f25240b8b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2518009840 tx=0x7f2518009b50 comp rx=0 tx=0).stop 2023-07-19T20:45:30.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.291+0000 7f25289f9700 1 -- 172.21.15.117:0/1341489956 shutdown_connections 2023-07-19T20:45:30.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.291+0000 7f25289f9700 1 --2- 172.21.15.117:0/1341489956 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f25240b7ce0 0x7f2524149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.291+0000 7f25289f9700 1 --2- 172.21.15.117:0/1341489956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25240a1080 0x7f25240b8b20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.291+0000 7f25289f9700 1 -- 172.21.15.117:0/1341489956 >> 172.21.15.117:0/1341489956 conn(0x7f25240b9b70 msgr2=0x7f25240b9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:30.290 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.291+0000 7f25289f9700 1 -- 172.21.15.117:0/1341489956 shutdown_connections 2023-07-19T20:45:30.291 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.291+0000 7f25289f9700 1 -- 172.21.15.117:0/1341489956 wait complete. 2023-07-19T20:45:30.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.293+0000 7f25289f9700 1 Processor -- start 2023-07-19T20:45:30.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.293+0000 7f25289f9700 1 -- start start 2023-07-19T20:45:30.293 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f25289f9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25240a1080 0x7f25241e3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f25289f9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25240b7ce0 0x7f252409e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f25289f9700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2524142630 0x7f2524071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f25289f9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252409edc0 con 0x7f25240a1080 2023-07-19T20:45:30.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f25289f9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252409f2b0 con 0x7f25240b7ce0 2023-07-19T20:45:30.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f25289f9700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25241e3f80 con 0x7f2524142630 2023-07-19T20:45:30.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f252259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25240a1080 0x7f25241e3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.294 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f252259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25240a1080 0x7f25241e3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47556/0 (socket says 172.21.15.117:47556) 2023-07-19T20:45:30.295 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f252259c700 1 -- 172.21.15.117:0/1340745016 learned_addr learned my addr 172.21.15.117:0/1340745016 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:45:30.295 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f2521d9b700 1 --2- 172.21.15.117:0/1340745016 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25240b7ce0 0x7f252409e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.295 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f2522d9d700 1 --2- 172.21.15.117:0/1340745016 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2524142630 0x7f2524071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.295 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f252259c700 1 -- 172.21.15.117:0/1340745016 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2524142630 msgr2=0x7f2524071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f252259c700 1 --2- 172.21.15.117:0/1340745016 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2524142630 0x7f2524071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f252259c700 1 -- 172.21.15.117:0/1340745016 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25240b7ce0 msgr2=0x7f252409e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f252259c700 1 --2- 172.21.15.117:0/1340745016 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25240b7ce0 0x7f252409e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f252259c700 1 -- 172.21.15.117:0/1340745016 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180094a0 con 0x7f25240a1080 2023-07-19T20:45:30.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f252259c700 1 --2- 172.21.15.117:0/1340745016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25240a1080 0x7f25241e3010 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f251400e9b0 tx=0x7f251400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:30.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f2512ffd700 1 -- 172.21.15.117:0/1340745016 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514009710 con 0x7f25240a1080 2023-07-19T20:45:30.296 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f2512ffd700 1 -- 172.21.15.117:0/1340745016 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400ee50 con 0x7f25240a1080 2023-07-19T20:45:30.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f25289f9700 1 -- 172.21.15.117:0/1340745016 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25241e36e0 con 0x7f25240a1080 2023-07-19T20:45:30.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.294+0000 7f2512ffd700 1 -- 172.21.15.117:0/1340745016 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400ca50 con 0x7f25240a1080 2023-07-19T20:45:30.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.295+0000 7f25289f9700 1 -- 172.21.15.117:0/1340745016 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25241e3ca0 con 0x7f25240a1080 2023-07-19T20:45:30.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.295+0000 7f25289f9700 1 -- 172.21.15.117:0/1340745016 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2524067940 con 0x7f25240a1080 2023-07-19T20:45:30.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.296+0000 7f2512ffd700 1 -- 172.21.15.117:0/1340745016 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f251400cbb0 con 0x7f25240a1080 2023-07-19T20:45:30.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.296+0000 7f2512ffd700 1 --2- 172.21.15.117:0/1340745016 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f250406a660 0x7f250406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:45:30.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.296+0000 7f2512ffd700 1 -- 172.21.15.117:0/1340745016 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2514088ac0 con 0x7f25240a1080 2023-07-19T20:45:30.297 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.296+0000 7f2521d9b700 1 --2- 172.21.15.117:0/1340745016 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f250406a660 0x7f250406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:45:30.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.297+0000 7f2521d9b700 1 --2- 172.21.15.117:0/1340745016 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f250406a660 0x7f250406cb10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2518009fd0 tx=0x7f251801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:45:30.298 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.301+0000 7f2512ffd700 1 -- 172.21.15.117:0/1340745016 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2514057950 con 0x7f25240a1080 2023-07-19T20:45:30.522 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.528+0000 7f25289f9700 1 -- 172.21.15.117:0/1340745016 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f252406f240 con 0x7f25240a1080 2023-07-19T20:45:30.522 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.528+0000 7f2512ffd700 1 -- 172.21.15.117:0/1340745016 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f251400ce60 con 0x7f25240a1080 2023-07-19T20:45:30.522 INFO:teuthology.orchestra.run.smithi117.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-19T20:45:30.523 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.530+0000 7f25289f9700 1 -- 172.21.15.117:0/1340745016 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f250406a660 msgr2=0x7f250406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.530+0000 7f25289f9700 1 --2- 172.21.15.117:0/1340745016 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f250406a660 0x7f250406cb10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2518009fd0 tx=0x7f251801c040 comp rx=0 tx=0).stop 2023-07-19T20:45:30.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.530+0000 7f25289f9700 1 -- 172.21.15.117:0/1340745016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25240a1080 msgr2=0x7f25241e3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:45:30.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.530+0000 7f25289f9700 1 --2- 172.21.15.117:0/1340745016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25240a1080 0x7f25241e3010 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f251400e9b0 tx=0x7f251400ecc0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.530+0000 7f25289f9700 1 -- 172.21.15.117:0/1340745016 shutdown_connections 2023-07-19T20:45:30.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.530+0000 7f25289f9700 1 --2- 172.21.15.117:0/1340745016 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f250406a660 0x7f250406cb10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.530+0000 7f25289f9700 1 --2- 172.21.15.117:0/1340745016 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2524142630 0x7f2524071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.525 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.530+0000 7f25289f9700 1 --2- 172.21.15.117:0/1340745016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25240a1080 0x7f25241e3010 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.525 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.530+0000 7f25289f9700 1 --2- 172.21.15.117:0/1340745016 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25240b7ce0 0x7f252409e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:45:30.525 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.530+0000 7f25289f9700 1 -- 172.21.15.117:0/1340745016 >> 172.21.15.117:0/1340745016 conn(0x7f25240b9b70 msgr2=0x7f25241468e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:45:30.525 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.530+0000 7f25289f9700 1 -- 172.21.15.117:0/1340745016 shutdown_connections 2023-07-19T20:45:30.525 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:45:30.530+0000 7f25289f9700 1 -- 172.21.15.117:0/1340745016 wait complete. 2023-07-19T20:45:30.535 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-19T20:45:30.536 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-19T20:45:30.536 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-07-19T20:45:30.536 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-19T20:45:30.537 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-19T20:45:30.537 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-19T20:45:30.537 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-19T20:45:30.537 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-19T20:45:30.538 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-19T20:45:30.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:30.538 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-07-19T20:45:30.591 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-19T20:45:30.831 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-19T20:45:30.831 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-07-19T20:45:30.831 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-07-19T20:45:30.831 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-07-19T20:45:30.831 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-07-19T20:45:30.832 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-19T20:45:30.832 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-07-19T20:45:30.832 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-07-19T20:45:30.832 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-19T20:45:30.832 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-07-19T20:45:30.832 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-07-19T20:45:30.832 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-19T20:45:30.833 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-07-19T20:45:30.833 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-19T20:45:30.833 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-07-19T20:45:30.833 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-19T20:45:30.833 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42038sec preferred_lft 42038sec 2023-07-19T20:45:30.833 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-07-19T20:45:30.833 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-07-19T20:45:30.834 INFO:teuthology.orchestra.run.smithi130.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-19T20:45:30.834 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 6e:37:81:a8:11:f7 brd ff:ff:ff:ff:ff:ff 2023-07-19T20:45:30.834 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-19T20:45:30.834 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-07-19T20:45:30.834 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::64ad:abff:febb:4ec0/64 scope link 2023-07-19T20:45:30.834 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-07-19T20:45:30.834 INFO:teuthology.orchestra.run.smithi130.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-19T20:45:30.834 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 6e:37:81:a8:11:f7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-19T20:45:30.835 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::6c37:81ff:fea8:11f7/64 scope link 2023-07-19T20:45:30.835 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-07-19T20:45:30.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:30.835 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-19T20:45:30.912 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-07-19T20:45:30.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:30.916 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-07-19T20:45:30.966 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-07-19T20:45:30.967 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-19T20:45:30.967 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-19T20:45:30.967 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-19T20:45:30.967 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-19T20:45:30.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:30.968 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-07-19T20:45:30.969 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-07-19T20:45:30.969 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-19T20:45:30.969 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-19T20:45:30.970 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-19T20:45:30.970 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-07-19T20:45:31.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:31.140 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-07-19T20:45:31.189 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-19T20:45:31.189 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-19T20:45:31.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:31.190 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-07-19T20:45:31.299 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-19T20:45:31.299 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-19T20:45:31.345 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-19T20:45:31.345 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-19T20:45:31.346 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-19T20:45:31.430 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-19T20:45:31.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:31.431 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-19T20:45:31.574 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-19T20:45:31.575 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-19T20:45:31.575 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-07-19T20:45:31.590 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-19T20:45:31.590 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-19T20:45:31.590 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-07-19T20:45:31.591 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.117:3300,172.21.15.124:3300,172.21.15.124:3301" 2023-07-19T20:45:31.591 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-19T20:45:31.614 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-19T20:45:31.615 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-19T20:45:31.615 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-07-19T20:45:31.615 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.117:3300,172.21.15.124:3300,172.21.15.124:3301" 2023-07-19T20:45:31.615 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-19T20:45:31.616 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.117:6789,172.21.15.124:6789,172.21.15.124:6790" 2023-07-19T20:45:31.616 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.117:6789,172.21.15.124:6789,172.21.15.124:6790:/ 2023-07-19T20:45:31.616 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=46db5732-4a4f-4d1e-835b-9507e9513c02" will pass to kernel 2023-07-19T20:45:31.620 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-19T20:45:31.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:31.621 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-19T20:45:31.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:31.692 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-19T20:45:31.800 INFO:teuthology.orchestra.run.smithi130.stdout:client5056 2023-07-19T20:45:31.801 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:45:31.801 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-19T20:45:31.854 DEBUG:teuthology.orchestra.run.smithi130:> mktemp -d --suffix=xfstests-dev 2023-07-19T20:45:31.940 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.WX1oxq0LGuxfstests-dev 2023-07-19T20:45:31.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:31.941 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.WX1oxq0LGuxfstests-dev) 2023-07-19T20:45:32.027 INFO:teuthology.orchestra.run.smithi130.stderr:Cloning into '/tmp/tmp.WX1oxq0LGuxfstests-dev'... 2023-07-19T20:45:32.890 DEBUG:teuthology.orchestra.run.smithi130:> mktemp -d --suffix=xfsprogs-dev 2023-07-19T20:45:32.937 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.ViZlSiF0Gpxfsprogs-dev 2023-07-19T20:45:32.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:32.937 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.ViZlSiF0Gpxfsprogs-dev) 2023-07-19T20:45:33.023 INFO:teuthology.orchestra.run.smithi130.stderr:Cloning into '/tmp/tmp.ViZlSiF0Gpxfsprogs-dev'... 2023-07-19T20:45:33.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:33.578 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-07-19T20:45:33.669 DEBUG:teuthology.orchestra.run.smithi130:> mktemp -d --suffix=test 2023-07-19T20:45:33.714 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.XYGNwUVwe6test 2023-07-19T20:45:33.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-19T20:45:33.715 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-07-19T20:45:33.803 DEBUG:teuthology.orchestra.run.smithi130:> mktemp -d --suffix=scratch 2023-07-19T20:45:33.848 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.moYJlVBlsTscratch 2023-07-19T20:45:33.849 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-07-19T20:45:33.850 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel xfsprogs-qa-devel 2023-07-19T20:45:34.945 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:07:33 ago on Wed 19 Jul 2023 08:38:01 PM UTC. 2023-07-19T20:45:36.174 INFO:teuthology.orchestra.run.smithi130.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-07-19T20:45:36.174 INFO:teuthology.orchestra.run.smithi130.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-07-19T20:45:36.175 INFO:teuthology.orchestra.run.smithi130.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-07-19T20:45:36.176 INFO:teuthology.orchestra.run.smithi130.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-07-19T20:45:36.177 INFO:teuthology.orchestra.run.smithi130.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-07-19T20:45:36.183 INFO:teuthology.orchestra.run.smithi130.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-07-19T20:45:36.183 INFO:teuthology.orchestra.run.smithi130.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-07-19T20:45:36.183 INFO:teuthology.orchestra.run.smithi130.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-07-19T20:45:36.184 INFO:teuthology.orchestra.run.smithi130.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-07-19T20:45:36.185 INFO:teuthology.orchestra.run.smithi130.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-07-19T20:45:36.186 INFO:teuthology.orchestra.run.smithi130.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-07-19T20:45:36.187 INFO:teuthology.orchestra.run.smithi130.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-07-19T20:45:36.188 INFO:teuthology.orchestra.run.smithi130.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-07-19T20:45:36.190 INFO:teuthology.orchestra.run.smithi130.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-07-19T20:45:36.190 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsdump-3.1.8-6.el8.x86_64 is already installed. 2023-07-19T20:45:36.191 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-07-19T20:45:36.194 INFO:teuthology.orchestra.run.smithi130.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-19T20:45:36.195 INFO:teuthology.orchestra.run.smithi130.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-19T20:45:36.195 INFO:teuthology.orchestra.run.smithi130.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-07-19T20:45:36.195 INFO:teuthology.orchestra.run.smithi130.stdout:Package libuuid-devel-2.32.1-42.el8.x86_64 is already installed. 2023-07-19T20:45:36.196 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsprogs-devel-5.0.0-12.el8.x86_64 is already installed. 2023-07-19T20:45:36.198 INFO:teuthology.orchestra.run.smithi130.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-07-19T20:45:36.204 INFO:teuthology.orchestra.run.smithi130.stdout:Package gettext-0.19.8.1-17.el8.x86_64 is already installed. 2023-07-19T20:45:36.211 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-07-19T20:45:36.396 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-07-19T20:45:36.396 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================== 2023-07-19T20:45:36.396 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-07-19T20:45:36.397 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================== 2023-07-19T20:45:36.397 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-07-19T20:45:36.398 INFO:teuthology.orchestra.run.smithi130.stdout: device-mapper-devel x86_64 8:1.02.181-9.el8 powertools 284 k 2023-07-19T20:45:36.398 INFO:teuthology.orchestra.run.smithi130.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-07-19T20:45:36.398 INFO:teuthology.orchestra.run.smithi130.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-07-19T20:45:36.399 INFO:teuthology.orchestra.run.smithi130.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-07-19T20:45:36.399 INFO:teuthology.orchestra.run.smithi130.stdout: inih-devel x86_64 57-1.el8 epel 14 k 2023-07-19T20:45:36.399 INFO:teuthology.orchestra.run.smithi130.stdout: libblkid-devel x86_64 2.32.1-42.el8 baseos 87 k 2023-07-19T20:45:36.399 INFO:teuthology.orchestra.run.smithi130.stdout: libedit-devel x86_64 3.1-23.20170329cvs.el8 powertools 44 k 2023-07-19T20:45:36.400 INFO:teuthology.orchestra.run.smithi130.stdout: libicu-devel x86_64 60.3-2.el8_1 baseos 922 k 2023-07-19T20:45:36.400 INFO:teuthology.orchestra.run.smithi130.stdout: python2 x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 110 k 2023-07-19T20:45:36.400 INFO:teuthology.orchestra.run.smithi130.stdout: userspace-rcu-devel x86_64 0.10.1-4.el8 powertools 84 k 2023-07-19T20:45:36.400 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2023-07-19T20:45:36.401 INFO:teuthology.orchestra.run.smithi130.stdout: cpp x86_64 8.5.0-20.el8 baseos 10 M 2023-07-19T20:45:36.401 INFO:teuthology.orchestra.run.smithi130.stdout: gcc x86_64 8.5.0-20.el8 baseos 24 M 2023-07-19T20:45:36.401 INFO:teuthology.orchestra.run.smithi130.stdout: gcc-gdb-plugin x86_64 8.5.0-20.el8 appstream 121 k 2023-07-19T20:45:36.402 INFO:teuthology.orchestra.run.smithi130.stdout: gcc-plugin-annobin x86_64 8.5.0-20.el8 baseos 36 k 2023-07-19T20:45:36.402 INFO:teuthology.orchestra.run.smithi130.stdout: libgcc x86_64 8.5.0-20.el8 baseos 81 k 2023-07-19T20:45:36.402 INFO:teuthology.orchestra.run.smithi130.stdout: libgomp x86_64 8.5.0-20.el8 baseos 208 k 2023-07-19T20:45:36.402 INFO:teuthology.orchestra.run.smithi130.stdout: sqlite x86_64 3.26.0-18.el8 baseos 668 k 2023-07-19T20:45:36.403 INFO:teuthology.orchestra.run.smithi130.stdout: sqlite-libs x86_64 3.26.0-18.el8 baseos 581 k 2023-07-19T20:45:36.403 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-07-19T20:45:36.403 INFO:teuthology.orchestra.run.smithi130.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2023-07-19T20:45:36.403 INFO:teuthology.orchestra.run.smithi130.stdout: inih x86_64 57-1.el8 epel 28 k 2023-07-19T20:45:36.404 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-07-19T20:45:36.405 INFO:teuthology.orchestra.run.smithi130.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2023-07-19T20:45:36.405 INFO:teuthology.orchestra.run.smithi130.stdout: python2-libs x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 6.5 M 2023-07-19T20:45:36.406 INFO:teuthology.orchestra.run.smithi130.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 892 k 2023-07-19T20:45:36.406 INFO:teuthology.orchestra.run.smithi130.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 287 k 2023-07-19T20:45:36.406 INFO:teuthology.orchestra.run.smithi130.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8+299+aa6e9afa appstream 44 k 2023-07-19T20:45:36.406 INFO:teuthology.orchestra.run.smithi130.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-07-19T20:45:36.407 INFO:teuthology.orchestra.run.smithi130.stdout: systemd-devel x86_64 239-75.el8 baseos 511 k 2023-07-19T20:45:36.407 INFO:teuthology.orchestra.run.smithi130.stdout:Installing weak dependencies: 2023-07-19T20:45:36.407 INFO:teuthology.orchestra.run.smithi130.stdout: python2-pip noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 1.8 M 2023-07-19T20:45:36.407 INFO:teuthology.orchestra.run.smithi130.stdout: python2-setuptools noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 702 k 2023-07-19T20:45:36.409 INFO:teuthology.orchestra.run.smithi130.stdout:Enabling module streams: 2023-07-19T20:45:36.409 INFO:teuthology.orchestra.run.smithi130.stdout: python27 2.7 2023-07-19T20:45:36.409 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:45:36.410 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-07-19T20:45:36.410 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================== 2023-07-19T20:45:36.410 INFO:teuthology.orchestra.run.smithi130.stdout:Install 22 Packages 2023-07-19T20:45:36.411 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 8 Packages 2023-07-19T20:45:36.411 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:45:36.412 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 49 M 2023-07-19T20:45:36.413 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-07-19T20:45:37.134 INFO:teuthology.orchestra.run.smithi130.stdout:(1/30): libpmemblk-1.6.1-1.el8.x86_64.rpm 387 kB/s | 92 kB 00:00 2023-07-19T20:45:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:(2/30): python2-2.7.18-12.module_el8+299+aa6e9a 421 kB/s | 110 kB 00:00 2023-07-19T20:45:37.307 INFO:teuthology.orchestra.run.smithi130.stdout:(3/30): fio-3.19-4.el8.x86_64.rpm 1.3 MB/s | 538 kB 00:00 2023-07-19T20:45:37.441 INFO:teuthology.orchestra.run.smithi130.stdout:(4/30): python2-pip-wheel-9.0.3-19.module_el8+2 6.5 MB/s | 892 kB 00:00 2023-07-19T20:45:37.591 INFO:teuthology.orchestra.run.smithi130.stdout:(5/30): python2-setuptools-39.0.1-13.module_el8 4.6 MB/s | 702 kB 00:00 2023-07-19T20:45:37.678 INFO:teuthology.orchestra.run.smithi130.stdout:(6/30): python2-setuptools-wheel-39.0.1-13.modu 3.4 MB/s | 287 kB 00:00 2023-07-19T20:45:37.751 INFO:teuthology.orchestra.run.smithi130.stdout:(7/30): python2-wheel-wheel-0.31.1-3.module_el8 595 kB/s | 44 kB 00:00 2023-07-19T20:45:37.842 INFO:teuthology.orchestra.run.smithi130.stdout:(8/30): python2-libs-2.7.18-12.module_el8+299+a 9.1 MB/s | 6.5 MB 00:00 2023-07-19T20:45:37.884 INFO:teuthology.orchestra.run.smithi130.stdout:(9/30): python2-pip-9.0.3-19.module_el8+299+aa6 2.5 MB/s | 1.8 MB 00:00 2023-07-19T20:45:38.171 INFO:teuthology.orchestra.run.smithi130.stdout:(10/30): daxctl-libs-71.1-7.el8.x86_64.rpm 101 kB/s | 42 kB 00:00 2023-07-19T20:45:38.384 INFO:teuthology.orchestra.run.smithi130.stdout:(11/30): libblkid-devel-2.32.1-42.el8.x86_64.rp 175 kB/s | 87 kB 00:00 2023-07-19T20:45:38.435 INFO:teuthology.orchestra.run.smithi130.stdout:(12/30): dump-0.4-0.36.b46.el8.x86_64.rpm 277 kB/s | 164 kB 00:00 2023-07-19T20:45:38.560 INFO:teuthology.orchestra.run.smithi130.stdout:(13/30): ndctl-libs-71.1-7.el8.x86_64.rpm 458 kB/s | 80 kB 00:00 2023-07-19T20:45:38.585 INFO:teuthology.orchestra.run.smithi130.stdout:(14/30): rmt-1.5.3-13.el8.x86_64.rpm 343 kB/s | 51 kB 00:00 2023-07-19T20:45:38.785 INFO:teuthology.orchestra.run.smithi130.stdout:(15/30): libicu-devel-60.3-2.el8_1.x86_64.rpm 1.5 MB/s | 922 kB 00:00 2023-07-19T20:45:38.962 INFO:teuthology.orchestra.run.smithi130.stdout:(16/30): systemd-devel-239-75.el8.x86_64.rpm 1.2 MB/s | 511 kB 00:00 2023-07-19T20:45:39.069 INFO:teuthology.orchestra.run.smithi130.stdout:(17/30): libedit-devel-3.1-23.20170329cvs.el8.x 156 kB/s | 44 kB 00:00 2023-07-19T20:45:39.121 INFO:teuthology.orchestra.run.smithi130.stdout:(18/30): device-mapper-devel-1.02.181-9.el8.x86 532 kB/s | 284 kB 00:00 2023-07-19T20:45:39.378 INFO:teuthology.orchestra.run.smithi130.stdout:(19/30): userspace-rcu-devel-0.10.1-4.el8.x86_6 202 kB/s | 84 kB 00:00 2023-07-19T20:45:39.703 INFO:teuthology.orchestra.run.smithi130.stdout:(20/30): inih-57-1.el8.x86_64.rpm 48 kB/s | 28 kB 00:00 2023-07-19T20:45:39.954 INFO:teuthology.orchestra.run.smithi130.stdout:(21/30): indent-2.2.13-2.el8.x86_64.rpm 211 kB/s | 187 kB 00:00 2023-07-19T20:45:39.996 INFO:teuthology.orchestra.run.smithi130.stdout:(22/30): gcc-gdb-plugin-8.5.0-20.el8.x86_64.rpm 415 kB/s | 121 kB 00:00 2023-07-19T20:45:40.029 INFO:teuthology.orchestra.run.smithi130.stdout:(23/30): inih-devel-57-1.el8.x86_64.rpm 21 kB/s | 14 kB 00:00 2023-07-19T20:45:40.180 INFO:teuthology.orchestra.run.smithi130.stdout:(24/30): gcc-plugin-annobin-8.5.0-20.el8.x86_64 238 kB/s | 36 kB 00:00 2023-07-19T20:45:40.455 INFO:teuthology.orchestra.run.smithi130.stdout:(25/30): libgcc-8.5.0-20.el8.x86_64.rpm 296 kB/s | 81 kB 00:00 2023-07-19T20:45:40.597 INFO:teuthology.orchestra.run.smithi130.stdout:(26/30): libgomp-8.5.0-20.el8.x86_64.rpm 1.4 MB/s | 208 kB 00:00 2023-07-19T20:45:40.880 INFO:teuthology.orchestra.run.smithi130.stdout:(27/30): cpp-8.5.0-20.el8.x86_64.rpm 11 MB/s | 10 MB 00:00 2023-07-19T20:45:40.914 INFO:teuthology.orchestra.run.smithi130.stdout:(28/30): sqlite-3.26.0-18.el8.x86_64.rpm 2.1 MB/s | 668 kB 00:00 2023-07-19T20:45:41.006 INFO:teuthology.orchestra.run.smithi130.stdout:(29/30): sqlite-libs-3.26.0-18.el8.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2023-07-19T20:45:41.756 INFO:teuthology.orchestra.run.smithi130.stdout:(30/30): gcc-8.5.0-20.el8.x86_64.rpm 13 MB/s | 24 MB 00:01 2023-07-19T20:45:41.760 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-07-19T20:45:41.760 INFO:teuthology.orchestra.run.smithi130.stdout:Total 9.1 MB/s | 49 MB 00:05 2023-07-19T20:45:42.592 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-07-19T20:45:42.714 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-07-19T20:45:42.715 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-07-19T20:45:43.237 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-07-19T20:45:43.242 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-07-19T20:45:44.578 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:45:44.582 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:45:44.586 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:45:44.687 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-07-19T20:45:44.855 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libgcc-8.5.0-20.el8.x86_64 1/38 2023-07-19T20:45:44.983 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libgcc-8.5.0-20.el8.x86_64 1/38 2023-07-19T20:45:45.177 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : sqlite-libs-3.26.0-18.el8.x86_64 2/38 2023-07-19T20:45:45.404 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 3/38 2023-07-19T20:45:45.480 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 3/38 2023-07-19T20:45:45.654 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 4/38 2023-07-19T20:45:45.740 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 4/38 2023-07-19T20:45:45.880 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 5/38 2023-07-19T20:45:45.960 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 5/38 2023-07-19T20:45:46.161 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : inih-57-1.el8.x86_64 6/38 2023-07-19T20:45:46.329 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libgomp-8.5.0-20.el8.x86_64 7/38 2023-07-19T20:45:47.450 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libgomp-8.5.0-20.el8.x86_64 7/38 2023-07-19T20:45:47.637 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : cpp-8.5.0-20.el8.x86_64 8/38 2023-07-19T20:45:49.440 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cpp-8.5.0-20.el8.x86_64 8/38 2023-07-19T20:45:49.687 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : gcc-8.5.0-20.el8.x86_64 9/38 2023-07-19T20:45:50.025 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: gcc-8.5.0-20.el8.x86_64 9/38 2023-07-19T20:45:50.245 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : systemd-devel-239-75.el8.x86_64 10/38 2023-07-19T20:45:50.450 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 11/38 2023-07-19T20:45:50.625 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 12/38 2023-07-19T20:45:52.061 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 13/38 2023-07-19T20:45:52.833 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 14/38 2023-07-19T20:45:53.264 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 15/38 2023-07-19T20:45:53.477 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 16/38 2023-07-19T20:45:53.673 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 17/38 2023-07-19T20:45:53.723 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 17/38 2023-07-19T20:45:53.926 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 18/38 2023-07-19T20:45:54.110 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : device-mapper-devel-8:1.02.181-9.el8.x86_64 19/38 2023-07-19T20:45:54.319 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : gcc-gdb-plugin-8.5.0-20.el8.x86_64 20/38 2023-07-19T20:45:54.397 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-20.el8.x86_64 20/38 2023-07-19T20:45:54.562 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : gcc-plugin-annobin-8.5.0-20.el8.x86_64 21/38 2023-07-19T20:45:54.604 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-20.el8.x86_64 21/38 2023-07-19T20:45:54.841 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : inih-devel-57-1.el8.x86_64 22/38 2023-07-19T20:45:55.119 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fio-3.19-4.el8.x86_64 23/38 2023-07-19T20:45:55.613 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : sqlite-3.26.0-18.el8.x86_64 24/38 2023-07-19T20:45:55.943 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libicu-devel-60.3-2.el8_1.x86_64 25/38 2023-07-19T20:45:56.244 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : indent-2.2.13-2.el8.x86_64 26/38 2023-07-19T20:45:56.433 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : userspace-rcu-devel-0.10.1-4.el8.x86_64 27/38 2023-07-19T20:45:56.590 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libedit-devel-3.1-23.20170329cvs.el8.x86_64 28/38 2023-07-19T20:45:56.785 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libblkid-devel-2.32.1-42.el8.x86_64 29/38 2023-07-19T20:45:56.921 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 30/38 2023-07-19T20:45:56.921 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : gcc-gdb-plugin-8.5.0-19.el8.x86_64 31/38 2023-07-19T20:45:57.171 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-19.el8.x86_64 31/38 2023-07-19T20:45:57.172 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : gcc-plugin-annobin-8.5.0-19.el8.x86_64 32/38 2023-07-19T20:45:57.354 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-19.el8.x86_64 32/38 2023-07-19T20:45:57.375 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: gcc-8.5.0-19.el8.x86_64 33/38 2023-07-19T20:45:57.604 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : gcc-8.5.0-19.el8.x86_64 33/38 2023-07-19T20:45:57.754 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : sqlite-3.26.0-17.el8.x86_64 34/38 2023-07-19T20:45:57.920 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : sqlite-libs-3.26.0-17.el8.x86_64 35/38 2023-07-19T20:45:57.935 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cpp-8.5.0-19.el8.x86_64 36/38 2023-07-19T20:45:58.146 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : cpp-8.5.0-19.el8.x86_64 36/38 2023-07-19T20:45:58.146 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libgcc-8.5.0-19.el8.x86_64 37/38 2023-07-19T20:45:58.354 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libgcc-8.5.0-19.el8.x86_64 37/38 2023-07-19T20:45:58.368 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libgomp-8.5.0-19.el8.x86_64 38/38 2023-07-19T20:45:58.369 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libgomp-8.5.0-19.el8.x86_64 38/38 2023-07-19T20:45:59.210 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libgomp-8.5.0-19.el8.x86_64 38/38 2023-07-19T20:45:59.210 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fio-3.19-4.el8.x86_64 1/38 2023-07-19T20:45:59.210 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/38 2023-07-19T20:45:59.210 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 3/38 2023-07-19T20:45:59.210 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 4/38 2023-07-19T20:45:59.211 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 5/38 2023-07-19T20:45:59.211 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/38 2023-07-19T20:45:59.211 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 7/38 2023-07-19T20:45:59.211 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/38 2023-07-19T20:45:59.211 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 9/38 2023-07-19T20:45:59.212 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 10/38 2023-07-19T20:45:59.212 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/38 2023-07-19T20:45:59.212 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libblkid-devel-2.32.1-42.el8.x86_64 12/38 2023-07-19T20:45:59.212 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libicu-devel-60.3-2.el8_1.x86_64 13/38 2023-07-19T20:45:59.212 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 14/38 2023-07-19T20:45:59.212 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 15/38 2023-07-19T20:45:59.213 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : systemd-devel-239-75.el8.x86_64 16/38 2023-07-19T20:45:59.213 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : device-mapper-devel-8:1.02.181-9.el8.x86_64 17/38 2023-07-19T20:45:59.213 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libedit-devel-3.1-23.20170329cvs.el8.x86_64 18/38 2023-07-19T20:45:59.213 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : userspace-rcu-devel-0.10.1-4.el8.x86_64 19/38 2023-07-19T20:45:59.213 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : indent-2.2.13-2.el8.x86_64 20/38 2023-07-19T20:45:59.213 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : inih-57-1.el8.x86_64 21/38 2023-07-19T20:45:59.213 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : inih-devel-57-1.el8.x86_64 22/38 2023-07-19T20:45:59.214 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gcc-gdb-plugin-8.5.0-20.el8.x86_64 23/38 2023-07-19T20:45:59.214 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gcc-gdb-plugin-8.5.0-19.el8.x86_64 24/38 2023-07-19T20:45:59.214 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cpp-8.5.0-20.el8.x86_64 25/38 2023-07-19T20:45:59.215 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cpp-8.5.0-19.el8.x86_64 26/38 2023-07-19T20:45:59.215 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gcc-8.5.0-20.el8.x86_64 27/38 2023-07-19T20:45:59.215 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gcc-8.5.0-19.el8.x86_64 28/38 2023-07-19T20:45:59.215 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gcc-plugin-annobin-8.5.0-20.el8.x86_64 29/38 2023-07-19T20:45:59.216 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gcc-plugin-annobin-8.5.0-19.el8.x86_64 30/38 2023-07-19T20:45:59.216 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgcc-8.5.0-20.el8.x86_64 31/38 2023-07-19T20:45:59.216 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgcc-8.5.0-19.el8.x86_64 32/38 2023-07-19T20:45:59.216 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgomp-8.5.0-20.el8.x86_64 33/38 2023-07-19T20:45:59.216 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgomp-8.5.0-19.el8.x86_64 34/38 2023-07-19T20:45:59.216 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : sqlite-3.26.0-18.el8.x86_64 35/38 2023-07-19T20:45:59.216 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : sqlite-3.26.0-17.el8.x86_64 36/38 2023-07-19T20:45:59.217 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : sqlite-libs-3.26.0-18.el8.x86_64 37/38 2023-07-19T20:46:00.170 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : sqlite-libs-3.26.0-17.el8.x86_64 38/38 2023-07-19T20:46:00.170 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:46:00.170 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2023-07-19T20:46:00.170 INFO:teuthology.orchestra.run.smithi130.stdout: cpp-8.5.0-20.el8.x86_64 gcc-8.5.0-20.el8.x86_64 2023-07-19T20:46:00.170 INFO:teuthology.orchestra.run.smithi130.stdout: gcc-gdb-plugin-8.5.0-20.el8.x86_64 gcc-plugin-annobin-8.5.0-20.el8.x86_64 2023-07-19T20:46:00.171 INFO:teuthology.orchestra.run.smithi130.stdout: libgcc-8.5.0-20.el8.x86_64 libgomp-8.5.0-20.el8.x86_64 2023-07-19T20:46:00.171 INFO:teuthology.orchestra.run.smithi130.stdout: sqlite-3.26.0-18.el8.x86_64 sqlite-libs-3.26.0-18.el8.x86_64 2023-07-19T20:46:00.171 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-07-19T20:46:00.171 INFO:teuthology.orchestra.run.smithi130.stdout: daxctl-libs-71.1-7.el8.x86_64 2023-07-19T20:46:00.171 INFO:teuthology.orchestra.run.smithi130.stdout: device-mapper-devel-8:1.02.181-9.el8.x86_64 2023-07-19T20:46:00.171 INFO:teuthology.orchestra.run.smithi130.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-07-19T20:46:00.172 INFO:teuthology.orchestra.run.smithi130.stdout: fio-3.19-4.el8.x86_64 2023-07-19T20:46:00.172 INFO:teuthology.orchestra.run.smithi130.stdout: indent-2.2.13-2.el8.x86_64 2023-07-19T20:46:00.172 INFO:teuthology.orchestra.run.smithi130.stdout: inih-57-1.el8.x86_64 2023-07-19T20:46:00.172 INFO:teuthology.orchestra.run.smithi130.stdout: inih-devel-57-1.el8.x86_64 2023-07-19T20:46:00.172 INFO:teuthology.orchestra.run.smithi130.stdout: libblkid-devel-2.32.1-42.el8.x86_64 2023-07-19T20:46:00.172 INFO:teuthology.orchestra.run.smithi130.stdout: libedit-devel-3.1-23.20170329cvs.el8.x86_64 2023-07-19T20:46:00.173 INFO:teuthology.orchestra.run.smithi130.stdout: libicu-devel-60.3-2.el8_1.x86_64 2023-07-19T20:46:00.173 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-07-19T20:46:00.173 INFO:teuthology.orchestra.run.smithi130.stdout: ndctl-libs-71.1-7.el8.x86_64 2023-07-19T20:46:00.173 INFO:teuthology.orchestra.run.smithi130.stdout: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-07-19T20:46:00.173 INFO:teuthology.orchestra.run.smithi130.stdout: python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-07-19T20:46:00.173 INFO:teuthology.orchestra.run.smithi130.stdout: python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-07-19T20:46:00.173 INFO:teuthology.orchestra.run.smithi130.stdout: python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-07-19T20:46:00.174 INFO:teuthology.orchestra.run.smithi130.stdout: python2-setuptools-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-07-19T20:46:00.174 INFO:teuthology.orchestra.run.smithi130.stdout: python2-setuptools-wheel-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-07-19T20:46:00.174 INFO:teuthology.orchestra.run.smithi130.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e9afa.noarch 2023-07-19T20:46:00.174 INFO:teuthology.orchestra.run.smithi130.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-07-19T20:46:00.174 INFO:teuthology.orchestra.run.smithi130.stdout: systemd-devel-239-75.el8.x86_64 2023-07-19T20:46:00.175 INFO:teuthology.orchestra.run.smithi130.stdout: userspace-rcu-devel-0.10.1-4.el8.x86_64 2023-07-19T20:46:00.175 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:46:00.175 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-07-19T20:46:00.381 DEBUG:teuthology.orchestra.run.smithi130:> sudo useradd -m fsgqa 2023-07-19T20:46:00.455 INFO:teuthology.orchestra.run.smithi130.stderr:useradd: user 'fsgqa' already exists 2023-07-19T20:46:00.458 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-19T20:46:00.459 DEBUG:teuthology.orchestra.run.smithi130:> sudo groupadd fsgqa 2023-07-19T20:46:00.528 INFO:teuthology.orchestra.run.smithi130.stderr:groupadd: group 'fsgqa' already exists 2023-07-19T20:46:00.532 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-19T20:46:00.534 DEBUG:teuthology.orchestra.run.smithi130:> sudo useradd fsgqa2 2023-07-19T20:46:01.112 DEBUG:teuthology.orchestra.run.smithi130:> sudo useradd 123456-fsgqa 2023-07-19T20:46:01.652 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-07-19T20:46:01.797 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.795+0000 7ff216f39700 1 Processor -- start 2023-07-19T20:46:01.798 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.795+0000 7ff216f39700 1 -- start start 2023-07-19T20:46:01.799 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.796+0000 7ff216f39700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff2100b6dc0 0x7ff2100b8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:01.799 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.796+0000 7ff216f39700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff21014ad30 0x7ff2101520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:01.800 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.796+0000 7ff216f39700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff210141f60 con 0x7ff2100b95e0 2023-07-19T20:46:01.800 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.796+0000 7ff216f39700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2100719f0 con 0x7ff21014ad30 2023-07-19T20:46:01.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.796+0000 7ff216f39700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21006bc80 con 0x7ff2100b6dc0 2023-07-19T20:46:01.801 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20ffff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ff2100b95e0 0x7ff21006b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:33308/0 (socket says 172.21.15.117:33308) 2023-07-19T20:46:01.802 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20ffff700 1 -- 172.21.15.117:0/427574288 learned_addr learned my addr 172.21.15.117:0/427574288 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:46:01.802 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff214cd5700 1 --2- 172.21.15.117:0/427574288 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff2100b6dc0 0x7ff2100b8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:01.802 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff2154d6700 1 --2- 172.21.15.117:0/427574288 >> v2:172.21.15.124:3300/0 conn(0x7ff21014ad30 0x7ff2101520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:01.803 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 -- 172.21.15.117:0/427574288 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128344220 0 0) 0x7ff210141f60 con 0x7ff2100b95e0 2023-07-19T20:46:01.803 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 -- 172.21.15.117:0/427574288 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2000035b0 con 0x7ff2100b95e0 2023-07-19T20:46:01.804 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 -- 172.21.15.117:0/427574288 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2558896950 0 0) 0x7ff2000035b0 con 0x7ff2100b95e0 2023-07-19T20:46:01.804 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 -- 172.21.15.117:0/427574288 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff2100b6dc0 msgr2=0x7ff2100b8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:46:01.804 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 --2- 172.21.15.117:0/427574288 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff2100b6dc0 0x7ff2100b8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:01.805 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 -- 172.21.15.117:0/427574288 >> v2:172.21.15.124:3300/0 conn(0x7ff21014ad30 msgr2=0x7ff2101520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:46:01.805 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 --2- 172.21.15.117:0/427574288 >> v2:172.21.15.124:3300/0 conn(0x7ff21014ad30 0x7ff2101520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:01.805 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 -- 172.21.15.117:0/427574288 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff210070a50 con 0x7ff2100b95e0 2023-07-19T20:46:01.806 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 -- 172.21.15.117:0/427574288 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2915090449 0 0) 0x7ff1fc001670 con 0x7ff2100b95e0 2023-07-19T20:46:01.806 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 -- 172.21.15.117:0/427574288 >> v1:172.21.15.117:6789/0 conn(0x7ff2100b95e0 legacy=0x7ff21006b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:46:01.807 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 --2- 172.21.15.117:0/427574288 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff200003a00 0x7ff200003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:01.807 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 --2- 172.21.15.117:0/427574288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff200004430 0x7ff2000048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:01.807 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 --2- 172.21.15.117:0/427574288 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff2100b6dc0 0x7ff200004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:01.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 -- 172.21.15.117:0/427574288 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21006bc80 con 0x7ff200004430 2023-07-19T20:46:01.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 -- 172.21.15.117:0/427574288 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff200005700 con 0x7ff200003a00 2023-07-19T20:46:01.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20f7fe700 1 -- 172.21.15.117:0/427574288 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20000ba90 con 0x7ff2100b6dc0 2023-07-19T20:46:01.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff20ffff700 1 --2- 172.21.15.117:0/427574288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff200004430 0x7ff2000048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:01.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff214cd5700 1 --2- 172.21.15.117:0/427574288 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff200003a00 0x7ff200003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:01.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.797+0000 7ff2154d6700 1 --2- 172.21.15.117:0/427574288 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff2100b6dc0 0x7ff200004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:01.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff20ffff700 1 -- 172.21.15.117:0/427574288 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff2100b6dc0 msgr2=0x7ff200004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:46:01.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff20ffff700 1 --2- 172.21.15.117:0/427574288 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff2100b6dc0 0x7ff200004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:01.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff20ffff700 1 -- 172.21.15.117:0/427574288 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff200003a00 msgr2=0x7ff200003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:46:01.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff20ffff700 1 --2- 172.21.15.117:0/427574288 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff200003a00 0x7ff200003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:01.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff20ffff700 1 -- 172.21.15.117:0/427574288 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2000035b0 con 0x7ff200004430 2023-07-19T20:46:01.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff20ffff700 1 --2- 172.21.15.117:0/427574288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff200004430 0x7ff2000048f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff2100b99b0 tx=0x7ff200005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc49019348ecc40e server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:46:01.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff20f7fe700 1 -- 172.21.15.117:0/427574288 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc007c60 con 0x7ff200004430 2023-07-19T20:46:01.812 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff20f7fe700 1 -- 172.21.15.117:0/427574288 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc00ce80 con 0x7ff200004430 2023-07-19T20:46:01.812 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff20f7fe700 1 -- 172.21.15.117:0/427574288 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc005ba0 con 0x7ff200004430 2023-07-19T20:46:01.812 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff216f39700 1 -- 172.21.15.117:0/427574288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff200004430 msgr2=0x7ff2000048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:46:01.812 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff216f39700 1 --2- 172.21.15.117:0/427574288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff200004430 0x7ff2000048f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff2100b99b0 tx=0x7ff200005880 comp rx=0 tx=0).stop 2023-07-19T20:46:01.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff2154d6700 1 -- 172.21.15.117:0/427574288 reap_dead start 2023-07-19T20:46:01.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff216f39700 1 -- 172.21.15.117:0/427574288 shutdown_connections 2023-07-19T20:46:01.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff216f39700 1 -- 172.21.15.117:0/427574288 >> 172.21.15.117:0/427574288 conn(0x7ff2100bdc00 msgr2=0x7ff2100b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:46:01.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff216f39700 1 -- 172.21.15.117:0/427574288 shutdown_connections 2023-07-19T20:46:01.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.798+0000 7ff216f39700 1 -- 172.21.15.117:0/427574288 wait complete. 2023-07-19T20:46:01.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.800+0000 7ff216f39700 1 Processor -- start 2023-07-19T20:46:01.814 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.800+0000 7ff216f39700 1 -- start start 2023-07-19T20:46:01.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.800+0000 7ff216f39700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff200004430 0x7ff210149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:01.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.800+0000 7ff216f39700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2101df1f0 0x7ff2101d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:01.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.800+0000 7ff216f39700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff2100b5ed0 0x7ff2101384b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:01.815 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.800+0000 7ff216f39700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2101d2e00 con 0x7ff2101df1f0 2023-07-19T20:46:01.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.800+0000 7ff216f39700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2101d2290 con 0x7ff2100b5ed0 2023-07-19T20:46:01.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.800+0000 7ff216f39700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2101d19f0 con 0x7ff200004430 2023-07-19T20:46:01.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.800+0000 7ff20ffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2101df1f0 0x7ff2101d28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:01.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.800+0000 7ff20ffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2101df1f0 0x7ff2101d28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35598/0 (socket says 172.21.15.117:35598) 2023-07-19T20:46:01.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.800+0000 7ff20ffff700 1 -- 172.21.15.117:0/671028731 learned_addr learned my addr 172.21.15.117:0/671028731 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:46:01.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.800+0000 7ff214cd5700 1 --2- 172.21.15.117:0/671028731 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff200004430 0x7ff210149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:01.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.801+0000 7ff2154d6700 1 --2- 172.21.15.117:0/671028731 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff2100b5ed0 0x7ff2101384b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:01.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.801+0000 7ff20ffff700 1 -- 172.21.15.117:0/671028731 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff200004430 msgr2=0x7ff210149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:46:01.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.801+0000 7ff20ffff700 1 --2- 172.21.15.117:0/671028731 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff200004430 0x7ff210149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:01.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.801+0000 7ff20ffff700 1 -- 172.21.15.117:0/671028731 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff2100b5ed0 msgr2=0x7ff2101384b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:46:01.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.801+0000 7ff20ffff700 1 --2- 172.21.15.117:0/671028731 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff2100b5ed0 0x7ff2101384b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:01.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.801+0000 7ff20ffff700 1 -- 172.21.15.117:0/671028731 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2101d1cd0 con 0x7ff2101df1f0 2023-07-19T20:46:01.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.801+0000 7ff20ffff700 1 --2- 172.21.15.117:0/671028731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2101df1f0 0x7ff2101d28c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc001930 tx=0x7ff1fc000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:46:01.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.801+0000 7ff20d7fa700 1 -- 172.21.15.117:0/671028731 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc001ad0 con 0x7ff2101df1f0 2023-07-19T20:46:01.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.801+0000 7ff20d7fa700 1 -- 172.21.15.117:0/671028731 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc0070d0 con 0x7ff2101df1f0 2023-07-19T20:46:01.822 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.801+0000 7ff216f39700 1 -- 172.21.15.117:0/671028731 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2101d1fb0 con 0x7ff2101df1f0 2023-07-19T20:46:01.822 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.801+0000 7ff20d7fa700 1 -- 172.21.15.117:0/671028731 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc007480 con 0x7ff2101df1f0 2023-07-19T20:46:01.823 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.801+0000 7ff216f39700 1 -- 172.21.15.117:0/671028731 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21014a7b0 con 0x7ff2101df1f0 2023-07-19T20:46:01.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.802+0000 7ff216f39700 1 -- 172.21.15.117:0/671028731 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2100b5d20 con 0x7ff2101df1f0 2023-07-19T20:46:01.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.802+0000 7ff20d7fa700 1 -- 172.21.15.117:0/671028731 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7ff1fc0075e0 con 0x7ff2101df1f0 2023-07-19T20:46:01.825 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.803+0000 7ff20d7fa700 1 --2- 172.21.15.117:0/671028731 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff1f406a660 0x7ff1f406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:01.825 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.803+0000 7ff214cd5700 1 --2- 172.21.15.117:0/671028731 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff1f406a660 0x7ff1f406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:01.825 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.803+0000 7ff20d7fa700 1 -- 172.21.15.117:0/671028731 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1fc089de0 con 0x7ff2101df1f0 2023-07-19T20:46:01.825 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.803+0000 7ff214cd5700 1 --2- 172.21.15.117:0/671028731 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff1f406a660 0x7ff1f406cb10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff2040044b0 tx=0x7ff204012040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:46:01.826 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:01.807+0000 7ff20d7fa700 1 -- 172.21.15.117:0/671028731 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff1fc055270 con 0x7ff2101df1f0 2023-07-19T20:46:02.067 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.073+0000 7ff216f39700 1 -- 172.21.15.117:0/671028731 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff210067940 con 0x7ff2101df1f0 2023-07-19T20:46:02.067 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.074+0000 7ff20d7fa700 1 -- 172.21.15.117:0/671028731 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7ff1fc01c320 con 0x7ff2101df1f0 2023-07-19T20:46:02.068 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:46:02.068 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","modified":"2023-07-19T20:43:45.824759Z","created":"2023-07-19T20:43:45.824759Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:3300","nonce":0},{"type":"v1","addr":"172.21.15.124:6789","nonce":0}]},"addr":"172.21.15.124:6789/0","public_addr":"172.21.15.124:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:3301","nonce":0},{"type":"v1","addr":"172.21.15.124:6790","nonce":0}]},"addr":"172.21.15.124:6790/0","public_addr":"172.21.15.124:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-07-19T20:46:02.069 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.076+0000 7ff216f39700 1 -- 172.21.15.117:0/671028731 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff1f406a660 msgr2=0x7ff1f406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:46:02.069 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.076+0000 7ff216f39700 1 --2- 172.21.15.117:0/671028731 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff1f406a660 0x7ff1f406cb10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff2040044b0 tx=0x7ff204012040 comp rx=0 tx=0).stop 2023-07-19T20:46:02.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.076+0000 7ff216f39700 1 -- 172.21.15.117:0/671028731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2101df1f0 msgr2=0x7ff2101d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:46:02.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.076+0000 7ff216f39700 1 --2- 172.21.15.117:0/671028731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2101df1f0 0x7ff2101d28c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc001930 tx=0x7ff1fc000fe0 comp rx=0 tx=0).stop 2023-07-19T20:46:02.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.076+0000 7ff216f39700 1 -- 172.21.15.117:0/671028731 shutdown_connections 2023-07-19T20:46:02.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.076+0000 7ff216f39700 1 --2- 172.21.15.117:0/671028731 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7ff1f406a660 0x7ff1f406cb10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:02.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.076+0000 7ff216f39700 1 --2- 172.21.15.117:0/671028731 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff2100b5ed0 0x7ff2101384b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:02.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.076+0000 7ff216f39700 1 --2- 172.21.15.117:0/671028731 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff200004430 0x7ff210149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:02.070 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.076+0000 7ff216f39700 1 --2- 172.21.15.117:0/671028731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2101df1f0 0x7ff2101d28c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:02.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.076+0000 7ff216f39700 1 -- 172.21.15.117:0/671028731 >> 172.21.15.117:0/671028731 conn(0x7ff2100bdc00 msgr2=0x7ff210141640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:46:02.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.076+0000 7ff216f39700 1 -- 172.21.15.117:0/671028731 shutdown_connections 2023-07-19T20:46:02.071 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.076+0000 7ff216f39700 1 -- 172.21.15.117:0/671028731 wait complete. 2023-07-19T20:46:02.071 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2023-07-19T20:46:02.082 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-07-19T20:46:02.204 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.211+0000 7f4d84758700 1 Processor -- start 2023-07-19T20:46:02.205 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.211+0000 7f4d84758700 1 -- start start 2023-07-19T20:46:02.206 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d84758700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d7c1449d0 0x7f4d7c0bae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:02.206 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d84758700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4d7c14a7a0 0x7f4d7c0bf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:02.206 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d84758700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c070f60 con 0x7f4d7c0713f0 2023-07-19T20:46:02.207 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d84758700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7c14aff0 con 0x7f4d7c14a7a0 2023-07-19T20:46:02.207 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d84758700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c14b2d0 con 0x7f4d7c1449d0 2023-07-19T20:46:02.207 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d824f4700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d7c1449d0 0x7f4d7c0bae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:02.207 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d81cf3700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4d7c14a7a0 0x7f4d7c0bf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:02.207 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d82cf5700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f4d7c0713f0 0x7f4d7c071850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.117:34580/0 (socket says 172.21.15.117:34580) 2023-07-19T20:46:02.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d82cf5700 1 -- 172.21.15.117:0/712276187 learned_addr learned my addr 172.21.15.117:0/712276187 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:46:02.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d824f4700 1 --2- 172.21.15.117:0/712276187 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d7c1449d0 0x7f4d7c0bae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.117:43666/0 (socket says 172.21.15.117:43666) 2023-07-19T20:46:02.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d824f4700 1 -- 172.21.15.117:0/712276187 >> v2:172.21.15.124:3300/0 conn(0x7f4d7c14a7a0 msgr2=0x7f4d7c0bf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:46:02.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d824f4700 1 --2- 172.21.15.117:0/712276187 >> v2:172.21.15.124:3300/0 conn(0x7f4d7c14a7a0 0x7f4d7c0bf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:02.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d824f4700 1 -- 172.21.15.117:0/712276187 >> v1:172.21.15.124:6789/0 conn(0x7f4d7c0713f0 legacy=0x7f4d7c071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:46:02.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d824f4700 1 -- 172.21.15.117:0/712276187 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c14b5b0 con 0x7f4d7c1449d0 2023-07-19T20:46:02.208 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d81cf3700 1 --2- 172.21.15.117:0/712276187 >> v2:172.21.15.124:3300/0 conn(0x7f4d7c14a7a0 0x7f4d7c0bf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:46:02.209 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.212+0000 7f4d824f4700 1 --2- 172.21.15.117:0/712276187 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d7c1449d0 0x7f4d7c0bae80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009840 tx=0x7f4d78009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=866f0fa5311e4a22 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:46:02.209 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.213+0000 7f4d814f2700 1 -- 172.21.15.117:0/712276187 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78011830 con 0x7f4d7c1449d0 2023-07-19T20:46:02.209 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.213+0000 7f4d814f2700 1 -- 172.21.15.117:0/712276187 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d78011990 con 0x7f4d7c1449d0 2023-07-19T20:46:02.209 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.213+0000 7f4d814f2700 1 -- 172.21.15.117:0/712276187 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78011d20 con 0x7f4d7c1449d0 2023-07-19T20:46:02.212 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.213+0000 7f4d84758700 1 -- 172.21.15.117:0/712276187 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d7c1449d0 msgr2=0x7f4d7c0bae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:46:02.212 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.213+0000 7f4d84758700 1 --2- 172.21.15.117:0/712276187 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d7c1449d0 0x7f4d7c0bae80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009840 tx=0x7f4d78009b50 comp rx=0 tx=0).stop 2023-07-19T20:46:02.212 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.213+0000 7f4d84758700 1 -- 172.21.15.117:0/712276187 shutdown_connections 2023-07-19T20:46:02.212 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.213+0000 7f4d84758700 1 --2- 172.21.15.117:0/712276187 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d7c1449d0 0x7f4d7c0bae80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:02.212 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.213+0000 7f4d84758700 1 --2- 172.21.15.117:0/712276187 >> v2:172.21.15.124:3300/0 conn(0x7f4d7c14a7a0 0x7f4d7c0bf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:02.213 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.213+0000 7f4d84758700 1 -- 172.21.15.117:0/712276187 >> 172.21.15.117:0/712276187 conn(0x7f4d7c0a1250 msgr2=0x7f4d7c0be980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:46:02.213 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.213+0000 7f4d84758700 1 -- 172.21.15.117:0/712276187 shutdown_connections 2023-07-19T20:46:02.213 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.213+0000 7f4d84758700 1 -- 172.21.15.117:0/712276187 wait complete. 2023-07-19T20:46:02.213 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.214+0000 7f4d84758700 1 Processor -- start 2023-07-19T20:46:02.213 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.214+0000 7f4d84758700 1 -- start start 2023-07-19T20:46:02.214 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d84758700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d7c0713f0 0x7f4d7c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:02.214 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d84758700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d7c1449d0 0x7f4d7c1e0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:02.214 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d84758700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d7c14a7a0 0x7f4d7c1e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:02.214 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d84758700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0a1fb0 con 0x7f4d7c14a7a0 2023-07-19T20:46:02.214 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d84758700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0a4010 con 0x7f4d7c0713f0 2023-07-19T20:46:02.214 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d84758700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0a19f0 con 0x7f4d7c1449d0 2023-07-19T20:46:02.214 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d82cf5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d7c14a7a0 0x7f4d7c1e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:02.214 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d824f4700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d7c0713f0 0x7f4d7c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:02.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d82cf5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d7c14a7a0 0x7f4d7c1e0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47962/0 (socket says 172.21.15.117:47962) 2023-07-19T20:46:02.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d82cf5700 1 -- 172.21.15.117:0/507563788 learned_addr learned my addr 172.21.15.117:0/507563788 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:46:02.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d81cf3700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d7c1449d0 0x7f4d7c1e0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:02.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d824f4700 1 -- 172.21.15.117:0/507563788 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d7c1449d0 msgr2=0x7f4d7c1e0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:46:02.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d824f4700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d7c1449d0 0x7f4d7c1e0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:02.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d824f4700 1 -- 172.21.15.117:0/507563788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d7c14a7a0 msgr2=0x7f4d7c1e0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:46:02.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d824f4700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d7c14a7a0 0x7f4d7c1e0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:02.215 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d824f4700 1 -- 172.21.15.117:0/507563788 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c0094a0 con 0x7f4d7c0713f0 2023-07-19T20:46:02.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d81cf3700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d7c1449d0 0x7f4d7c1e0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:46:02.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.215+0000 7f4d82cf5700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d7c14a7a0 0x7f4d7c1e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:46:02.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.216+0000 7f4d824f4700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d7c0713f0 0x7f4d7c0a36f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4d78016000 tx=0x7f4d78004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:46:02.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.216+0000 7f4d72ffd700 1 -- 172.21.15.117:0/507563788 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780036a0 con 0x7f4d7c0713f0 2023-07-19T20:46:02.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.216+0000 7f4d72ffd700 1 -- 172.21.15.117:0/507563788 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7801e070 con 0x7f4d7c0713f0 2023-07-19T20:46:02.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.216+0000 7f4d84758700 1 -- 172.21.15.117:0/507563788 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d780094a0 con 0x7f4d7c0713f0 2023-07-19T20:46:02.216 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.216+0000 7f4d72ffd700 1 -- 172.21.15.117:0/507563788 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78003a40 con 0x7f4d7c0713f0 2023-07-19T20:46:02.217 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.216+0000 7f4d84758700 1 -- 172.21.15.117:0/507563788 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c1485d0 con 0x7f4d7c0713f0 2023-07-19T20:46:02.217 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.217+0000 7f4d84758700 1 -- 172.21.15.117:0/507563788 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7c0bce70 con 0x7f4d7c0713f0 2023-07-19T20:46:02.217 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.217+0000 7f4d72ffd700 1 -- 172.21.15.117:0/507563788 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f4d78003ba0 con 0x7f4d7c0713f0 2023-07-19T20:46:02.217 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.218+0000 7f4d72ffd700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4d6006a690 0x7f4d6006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:46:02.217 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.218+0000 7f4d72ffd700 1 -- 172.21.15.117:0/507563788 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4d78089be0 con 0x7f4d7c0713f0 2023-07-19T20:46:02.217 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.218+0000 7f4d81cf3700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4d6006a690 0x7f4d6006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:46:02.218 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.218+0000 7f4d81cf3700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4d6006a690 0x7f4d6006cb40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c149b50 tx=0x7f4d6c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:46:02.218 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.223+0000 7f4d72ffd700 1 -- 172.21.15.117:0/507563788 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f4d78054fd0 con 0x7f4d7c0713f0 2023-07-19T20:46:02.483 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.490+0000 7f4d84758700 1 -- 172.21.15.117:0/507563788 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f4d7c074890 con 0x7f4d7c0713f0 2023-07-19T20:46:02.484 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.491+0000 7f4d72ffd700 1 -- 172.21.15.117:0/507563788 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7f4d780585f0 con 0x7f4d7c0713f0 2023-07-19T20:46:02.485 INFO:teuthology.orchestra.run.smithi117.stdout:[client.admin] 2023-07-19T20:46:02.485 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQACS7hkwU4VBhAAiPG9OjvC296T9MaER6pAOw== 2023-07-19T20:46:02.487 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.493+0000 7f4d84758700 1 -- 172.21.15.117:0/507563788 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4d6006a690 msgr2=0x7f4d6006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:46:02.487 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.493+0000 7f4d84758700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4d6006a690 0x7f4d6006cb40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c149b50 tx=0x7f4d6c009210 comp rx=0 tx=0).stop 2023-07-19T20:46:02.487 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.493+0000 7f4d84758700 1 -- 172.21.15.117:0/507563788 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d7c0713f0 msgr2=0x7f4d7c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:46:02.488 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.493+0000 7f4d84758700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d7c0713f0 0x7f4d7c0a36f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4d78016000 tx=0x7f4d78004750 comp rx=0 tx=0).stop 2023-07-19T20:46:02.488 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.493+0000 7f4d84758700 1 -- 172.21.15.117:0/507563788 shutdown_connections 2023-07-19T20:46:02.488 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.493+0000 7f4d84758700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f4d6006a690 0x7f4d6006cb40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:02.488 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.493+0000 7f4d84758700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d7c14a7a0 0x7f4d7c1e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:02.488 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.493+0000 7f4d84758700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d7c0713f0 0x7f4d7c0a36f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:02.488 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.493+0000 7f4d84758700 1 --2- 172.21.15.117:0/507563788 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d7c1449d0 0x7f4d7c1e0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:46:02.489 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.493+0000 7f4d84758700 1 -- 172.21.15.117:0/507563788 >> 172.21.15.117:0/507563788 conn(0x7f4d7c0a1250 msgr2=0x7f4d7c0bc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:46:02.489 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.493+0000 7f4d84758700 1 -- 172.21.15.117:0/507563788 shutdown_connections 2023-07-19T20:46:02.489 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:46:02.493+0000 7f4d84758700 1 -- 172.21.15.117:0/507563788 wait complete. 2023-07-19T20:46:02.499 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:46:02.499 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/tmp/tmp.WX1oxq0LGuxfstests-dev/local.config 2023-07-19T20:46:02.571 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.117:6789:/test export TEST_DIR=/tmp/tmp.XYGNwUVwe6test export SCRATCH_DEV=172.21.15.117:6789:/scratch export SCRATCH_MNT=/tmp/tmp.moYJlVBlsTscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQACS7hkwU4VBhAAiPG9OjvC296T9MaER6pAOw==" 2023-07-19T20:46:02.572 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:46:02.572 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/tmp/tmp.WX1oxq0LGuxfstests-dev/ceph.exclude 2023-07-19T20:46:02.685 DEBUG:teuthology.orchestra.run.smithi130:> (cd /tmp/tmp.WX1oxq0LGuxfstests-dev && exec sudo make) 2023-07-19T20:46:02.822 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize -cfi 2023-07-19T20:46:03.307 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: putting auxiliary files in '.'. 2023-07-19T20:46:03.307 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file './config.guess' 2023-07-19T20:46:03.317 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file './config.sub' 2023-07-19T20:46:03.330 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file './install-sh' 2023-07-19T20:46:03.342 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file './ltmain.sh' 2023-07-19T20:46:03.405 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-07-19T20:46:03.406 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-07-19T20:46:03.418 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-07-19T20:46:03.432 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-07-19T20:46:03.445 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-07-19T20:46:03.458 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-07-19T20:46:03.474 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-07-19T20:46:03.477 INFO:teuthology.orchestra.run.smithi130.stdout:cp include/install-sh . 2023-07-19T20:46:03.480 INFO:teuthology.orchestra.run.smithi130.stdout:aclocal -I m4 2023-07-19T20:46:04.794 INFO:teuthology.orchestra.run.smithi130.stdout:autoheader 2023-07-19T20:46:05.174 INFO:teuthology.orchestra.run.smithi130.stdout:autoconf 2023-07-19T20:46:05.390 INFO:teuthology.orchestra.run.smithi130.stdout:./configure \ 2023-07-19T20:46:05.391 INFO:teuthology.orchestra.run.smithi130.stdout: --libexecdir=/usr/lib \ 2023-07-19T20:46:05.391 INFO:teuthology.orchestra.run.smithi130.stdout: --exec_prefix=/var/lib 2023-07-19T20:46:05.913 INFO:teuthology.orchestra.run.smithi130.stdout:checking build system type... x86_64-pc-linux-gnu 2023-07-19T20:46:05.913 INFO:teuthology.orchestra.run.smithi130.stdout:checking host system type... x86_64-pc-linux-gnu 2023-07-19T20:46:05.917 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to print strings... printf 2023-07-19T20:46:05.918 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gcc... gcc 2023-07-19T20:46:06.063 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether the C compiler works... yes 2023-07-19T20:46:06.064 INFO:teuthology.orchestra.run.smithi130.stdout:checking for C compiler default output file name... a.out 2023-07-19T20:46:06.113 INFO:teuthology.orchestra.run.smithi130.stdout:checking for suffix of executables... 2023-07-19T20:46:06.184 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether we are cross compiling... no 2023-07-19T20:46:06.222 INFO:teuthology.orchestra.run.smithi130.stdout:checking for suffix of object files... o 2023-07-19T20:46:06.256 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether we are using the GNU C compiler... yes 2023-07-19T20:46:06.290 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether gcc accepts -g... yes 2023-07-19T20:46:06.339 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gcc option to accept ISO C89... none needed 2023-07-19T20:46:06.345 INFO:teuthology.orchestra.run.smithi130.stdout:checking for a sed that does not truncate output... /bin/sed 2023-07-19T20:46:06.350 INFO:teuthology.orchestra.run.smithi130.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-07-19T20:46:06.353 INFO:teuthology.orchestra.run.smithi130.stdout:checking for egrep... /bin/grep -E 2023-07-19T20:46:06.359 INFO:teuthology.orchestra.run.smithi130.stdout:checking for fgrep... /bin/grep -F 2023-07-19T20:46:06.365 INFO:teuthology.orchestra.run.smithi130.stdout:checking for ld used by gcc... /bin/ld 2023-07-19T20:46:06.368 INFO:teuthology.orchestra.run.smithi130.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-07-19T20:46:06.378 INFO:teuthology.orchestra.run.smithi130.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-07-19T20:46:06.418 INFO:teuthology.orchestra.run.smithi130.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-07-19T20:46:06.419 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether ln -s works... yes 2023-07-19T20:46:06.440 INFO:teuthology.orchestra.run.smithi130.stdout:checking the maximum length of command line arguments... 1572864 2023-07-19T20:46:06.449 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-07-19T20:46:06.450 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-07-19T20:46:06.450 INFO:teuthology.orchestra.run.smithi130.stdout:checking for /bin/ld option to reload object files... -r 2023-07-19T20:46:06.450 INFO:teuthology.orchestra.run.smithi130.stdout:checking for objdump... objdump 2023-07-19T20:46:06.450 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to recognize dependent libraries... pass_all 2023-07-19T20:46:06.451 INFO:teuthology.orchestra.run.smithi130.stdout:checking for dlltool... no 2023-07-19T20:46:06.451 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-07-19T20:46:06.451 INFO:teuthology.orchestra.run.smithi130.stdout:checking for ar... ar 2023-07-19T20:46:06.502 INFO:teuthology.orchestra.run.smithi130.stdout:checking for archiver @FILE support... @ 2023-07-19T20:46:06.503 INFO:teuthology.orchestra.run.smithi130.stdout:checking for strip... strip 2023-07-19T20:46:06.503 INFO:teuthology.orchestra.run.smithi130.stdout:checking for ranlib... ranlib 2023-07-19T20:46:06.503 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gawk... gawk 2023-07-19T20:46:06.612 INFO:teuthology.orchestra.run.smithi130.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-07-19T20:46:06.615 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sysroot... no 2023-07-19T20:46:06.623 INFO:teuthology.orchestra.run.smithi130.stdout:checking for a working dd... /bin/dd 2023-07-19T20:46:06.631 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-07-19T20:46:06.659 INFO:teuthology.orchestra.run.smithi130.stdout:checking for mt... no 2023-07-19T20:46:06.665 INFO:teuthology.orchestra.run.smithi130.stdout:checking if : is a manifest tool... no 2023-07-19T20:46:06.726 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to run the C preprocessor... gcc -E 2023-07-19T20:46:06.976 INFO:teuthology.orchestra.run.smithi130.stdout:checking for ANSI C header files... yes 2023-07-19T20:46:07.019 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/types.h... yes 2023-07-19T20:46:07.080 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/stat.h... yes 2023-07-19T20:46:07.131 INFO:teuthology.orchestra.run.smithi130.stdout:checking for stdlib.h... yes 2023-07-19T20:46:07.184 INFO:teuthology.orchestra.run.smithi130.stdout:checking for string.h... yes 2023-07-19T20:46:07.248 INFO:teuthology.orchestra.run.smithi130.stdout:checking for memory.h... yes 2023-07-19T20:46:07.301 INFO:teuthology.orchestra.run.smithi130.stdout:checking for strings.h... yes 2023-07-19T20:46:07.359 INFO:teuthology.orchestra.run.smithi130.stdout:checking for inttypes.h... yes 2023-07-19T20:46:07.412 INFO:teuthology.orchestra.run.smithi130.stdout:checking for stdint.h... yes 2023-07-19T20:46:07.471 INFO:teuthology.orchestra.run.smithi130.stdout:checking for unistd.h... yes 2023-07-19T20:46:07.529 INFO:teuthology.orchestra.run.smithi130.stdout:checking for dlfcn.h... yes 2023-07-19T20:46:07.539 INFO:teuthology.orchestra.run.smithi130.stdout:checking for objdir... .libs 2023-07-19T20:46:07.677 INFO:teuthology.orchestra.run.smithi130.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-07-19T20:46:07.678 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-07-19T20:46:07.716 INFO:teuthology.orchestra.run.smithi130.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-07-19T20:46:07.754 INFO:teuthology.orchestra.run.smithi130.stdout:checking if gcc static flag -static works... no 2023-07-19T20:46:07.806 INFO:teuthology.orchestra.run.smithi130.stdout:checking if gcc supports -c -o file.o... yes 2023-07-19T20:46:07.807 INFO:teuthology.orchestra.run.smithi130.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-07-19T20:46:07.822 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-07-19T20:46:07.870 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether -lc should be explicitly linked in... no 2023-07-19T20:46:07.970 INFO:teuthology.orchestra.run.smithi130.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-07-19T20:46:07.970 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to hardcode library paths into programs... immediate 2023-07-19T20:46:07.983 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether stripping libraries is possible... yes 2023-07-19T20:46:07.983 INFO:teuthology.orchestra.run.smithi130.stdout:checking if libtool supports shared libraries... yes 2023-07-19T20:46:07.983 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether to build shared libraries... yes 2023-07-19T20:46:07.983 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether to build static libraries... yes 2023-07-19T20:46:07.995 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gcc... (cached) gcc 2023-07-19T20:46:08.033 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-19T20:46:08.034 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-19T20:46:08.034 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-19T20:46:08.034 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gmake... /usr/bin/gmake 2023-07-19T20:46:08.035 INFO:teuthology.orchestra.run.smithi130.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-07-19T20:46:08.035 INFO:teuthology.orchestra.run.smithi130.stdout:checking for tar... /bin/tar 2023-07-19T20:46:08.036 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gzip... /bin/gzip 2023-07-19T20:46:08.052 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether gcc -MM is supported... yes 2023-07-19T20:46:08.052 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sort... /bin/sort 2023-07-19T20:46:08.052 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether ln -s works... yes 2023-07-19T20:46:08.053 INFO:teuthology.orchestra.run.smithi130.stdout:checking for rpm... /bin/rpm 2023-07-19T20:46:08.061 INFO:teuthology.orchestra.run.smithi130.stdout:checking for rpmbuild... no 2023-07-19T20:46:08.116 INFO:teuthology.orchestra.run.smithi130.stdout:checking assert.h usability... yes 2023-07-19T20:46:08.131 INFO:teuthology.orchestra.run.smithi130.stdout:checking assert.h presence... yes 2023-07-19T20:46:08.132 INFO:teuthology.orchestra.run.smithi130.stdout:checking for assert.h... yes 2023-07-19T20:46:08.188 INFO:teuthology.orchestra.run.smithi130.stdout:checking bstring.h usability... no 2023-07-19T20:46:08.212 INFO:teuthology.orchestra.run.smithi130.stdout:checking bstring.h presence... no 2023-07-19T20:46:08.213 INFO:teuthology.orchestra.run.smithi130.stdout:checking for bstring.h... no 2023-07-19T20:46:08.261 INFO:teuthology.orchestra.run.smithi130.stdout:checking libgen.h usability... yes 2023-07-19T20:46:08.277 INFO:teuthology.orchestra.run.smithi130.stdout:checking libgen.h presence... yes 2023-07-19T20:46:08.277 INFO:teuthology.orchestra.run.smithi130.stdout:checking for libgen.h... yes 2023-07-19T20:46:08.336 INFO:teuthology.orchestra.run.smithi130.stdout:checking dirent.h usability... yes 2023-07-19T20:46:08.353 INFO:teuthology.orchestra.run.smithi130.stdout:checking dirent.h presence... yes 2023-07-19T20:46:08.353 INFO:teuthology.orchestra.run.smithi130.stdout:checking for dirent.h... yes 2023-07-19T20:46:08.437 INFO:teuthology.orchestra.run.smithi130.stdout:checking errno.h usability... yes 2023-07-19T20:46:08.453 INFO:teuthology.orchestra.run.smithi130.stdout:checking errno.h presence... yes 2023-07-19T20:46:08.454 INFO:teuthology.orchestra.run.smithi130.stdout:checking for errno.h... yes 2023-07-19T20:46:08.513 INFO:teuthology.orchestra.run.smithi130.stdout:checking malloc.h usability... yes 2023-07-19T20:46:08.530 INFO:teuthology.orchestra.run.smithi130.stdout:checking malloc.h presence... yes 2023-07-19T20:46:08.530 INFO:teuthology.orchestra.run.smithi130.stdout:checking for malloc.h... yes 2023-07-19T20:46:08.586 INFO:teuthology.orchestra.run.smithi130.stdout:checking uuid.h usability... no 2023-07-19T20:46:08.610 INFO:teuthology.orchestra.run.smithi130.stdout:checking uuid.h presence... no 2023-07-19T20:46:08.610 INFO:teuthology.orchestra.run.smithi130.stdout:checking for uuid.h... no 2023-07-19T20:46:08.671 INFO:teuthology.orchestra.run.smithi130.stdout:checking uuid/uuid.h usability... yes 2023-07-19T20:46:08.690 INFO:teuthology.orchestra.run.smithi130.stdout:checking uuid/uuid.h presence... yes 2023-07-19T20:46:08.690 INFO:teuthology.orchestra.run.smithi130.stdout:checking for uuid/uuid.h... yes 2023-07-19T20:46:08.746 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/uuid.h usability... no 2023-07-19T20:46:08.771 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/uuid.h presence... no 2023-07-19T20:46:08.771 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/uuid.h... no 2023-07-19T20:46:08.826 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/file.h usability... yes 2023-07-19T20:46:08.843 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/file.h presence... yes 2023-07-19T20:46:08.843 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/file.h... yes 2023-07-19T20:46:08.908 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/fcntl.h usability... yes 2023-07-19T20:46:08.925 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/fcntl.h presence... yes 2023-07-19T20:46:08.925 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/fcntl.h... yes 2023-07-19T20:46:08.985 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/syssgi.h usability... no 2023-07-19T20:46:09.005 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/syssgi.h presence... no 2023-07-19T20:46:09.006 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/syssgi.h... no 2023-07-19T20:46:09.072 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/param.h usability... yes 2023-07-19T20:46:09.093 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/param.h presence... yes 2023-07-19T20:46:09.093 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/param.h... yes 2023-07-19T20:46:09.107 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/stat.h... (cached) yes 2023-07-19T20:46:09.169 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/statvfs.h usability... yes 2023-07-19T20:46:09.185 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/statvfs.h presence... yes 2023-07-19T20:46:09.185 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/statvfs.h... yes 2023-07-19T20:46:09.242 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/time.h usability... yes 2023-07-19T20:46:09.258 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/time.h presence... yes 2023-07-19T20:46:09.259 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/time.h... yes 2023-07-19T20:46:09.329 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/ioctl.h usability... yes 2023-07-19T20:46:09.346 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/ioctl.h presence... yes 2023-07-19T20:46:09.347 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/ioctl.h... yes 2023-07-19T20:46:09.406 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/wait.h usability... yes 2023-07-19T20:46:09.426 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/wait.h presence... yes 2023-07-19T20:46:09.426 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/wait.h... yes 2023-07-19T20:46:09.441 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/types.h... (cached) yes 2023-07-19T20:46:09.453 INFO:teuthology.orchestra.run.smithi130.stdout:checking for strings.h... (cached) yes 2023-07-19T20:46:09.520 INFO:teuthology.orchestra.run.smithi130.stdout:checking err.h usability... yes 2023-07-19T20:46:09.536 INFO:teuthology.orchestra.run.smithi130.stdout:checking err.h presence... yes 2023-07-19T20:46:09.536 INFO:teuthology.orchestra.run.smithi130.stdout:checking for err.h... yes 2023-07-19T20:46:09.594 INFO:teuthology.orchestra.run.smithi130.stdout:checking linux/falloc.h usability... yes 2023-07-19T20:46:09.609 INFO:teuthology.orchestra.run.smithi130.stdout:checking linux/falloc.h presence... yes 2023-07-19T20:46:09.609 INFO:teuthology.orchestra.run.smithi130.stdout:checking for linux/falloc.h... yes 2023-07-19T20:46:09.665 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-07-19T20:46:09.690 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-07-19T20:46:09.690 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/fs/xfs_fsops.h... no 2023-07-19T20:46:09.738 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/fs/xfs_itable.h usability... no 2023-07-19T20:46:09.763 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/fs/xfs_itable.h presence... no 2023-07-19T20:46:09.763 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/fs/xfs_itable.h... no 2023-07-19T20:46:09.813 INFO:teuthology.orchestra.run.smithi130.stdout:checking xfs/platform_defs.h usability... no 2023-07-19T20:46:09.836 INFO:teuthology.orchestra.run.smithi130.stdout:checking xfs/platform_defs.h presence... no 2023-07-19T20:46:09.836 INFO:teuthology.orchestra.run.smithi130.stdout:checking for xfs/platform_defs.h... no 2023-07-19T20:46:09.885 INFO:teuthology.orchestra.run.smithi130.stdout:checking btrfs/ioctl.h usability... no 2023-07-19T20:46:09.909 INFO:teuthology.orchestra.run.smithi130.stdout:checking btrfs/ioctl.h presence... no 2023-07-19T20:46:09.910 INFO:teuthology.orchestra.run.smithi130.stdout:checking for btrfs/ioctl.h... no 2023-07-19T20:46:09.958 INFO:teuthology.orchestra.run.smithi130.stdout:checking cifs/ioctl.h usability... no 2023-07-19T20:46:09.982 INFO:teuthology.orchestra.run.smithi130.stdout:checking cifs/ioctl.h presence... no 2023-07-19T20:46:09.982 INFO:teuthology.orchestra.run.smithi130.stdout:checking for cifs/ioctl.h... no 2023-07-19T20:46:10.032 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/mman.h usability... yes 2023-07-19T20:46:10.051 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/mman.h presence... yes 2023-07-19T20:46:10.051 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/mman.h... yes 2023-07-19T20:46:10.087 INFO:teuthology.orchestra.run.smithi130.stdout:checking for xfs/xfs_log_format.h... no 2023-07-19T20:46:10.155 INFO:teuthology.orchestra.run.smithi130.stdout:checking for uuid_compare... no 2023-07-19T20:46:10.211 INFO:teuthology.orchestra.run.smithi130.stdout:checking for uuid_compare in -luuid... yes 2023-07-19T20:46:10.295 INFO:teuthology.orchestra.run.smithi130.stdout:checking for xfs/xfs.h... yes 2023-07-19T20:46:10.328 INFO:teuthology.orchestra.run.smithi130.stdout:checking for xfs/libxfs.h... no 2023-07-19T20:46:10.366 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether xlog_assign_lsn is declared... no 2023-07-19T20:46:10.419 INFO:teuthology.orchestra.run.smithi130.stdout:checking for xfs/xqm.h... yes 2023-07-19T20:46:10.498 INFO:teuthology.orchestra.run.smithi130.stdout:checking xfsctl from xfs/xfs.h... ok 2023-07-19T20:46:10.542 INFO:teuthology.orchestra.run.smithi130.stdout:checking xfs/handle.h usability... yes 2023-07-19T20:46:10.558 INFO:teuthology.orchestra.run.smithi130.stdout:checking xfs/handle.h presence... yes 2023-07-19T20:46:10.559 INFO:teuthology.orchestra.run.smithi130.stdout:checking for xfs/handle.h... yes 2023-07-19T20:46:10.617 INFO:teuthology.orchestra.run.smithi130.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-07-19T20:46:10.670 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/acl.h usability... yes 2023-07-19T20:46:10.687 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/acl.h presence... yes 2023-07-19T20:46:10.688 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/acl.h... yes 2023-07-19T20:46:10.747 INFO:teuthology.orchestra.run.smithi130.stdout:checking acl/libacl.h usability... yes 2023-07-19T20:46:10.766 INFO:teuthology.orchestra.run.smithi130.stdout:checking acl/libacl.h presence... yes 2023-07-19T20:46:10.766 INFO:teuthology.orchestra.run.smithi130.stdout:checking for acl/libacl.h... yes 2023-07-19T20:46:10.829 INFO:teuthology.orchestra.run.smithi130.stdout:checking for acl_init in -lacl... yes 2023-07-19T20:46:10.891 INFO:teuthology.orchestra.run.smithi130.stdout:checking gdbm-ndbm.h usability... no 2023-07-19T20:46:10.916 INFO:teuthology.orchestra.run.smithi130.stdout:checking gdbm-ndbm.h presence... no 2023-07-19T20:46:10.916 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gdbm-ndbm.h... no 2023-07-19T20:46:10.959 INFO:teuthology.orchestra.run.smithi130.stdout:checking gdbm/ndbm.h usability... no 2023-07-19T20:46:10.982 INFO:teuthology.orchestra.run.smithi130.stdout:checking gdbm/ndbm.h presence... no 2023-07-19T20:46:10.983 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gdbm/ndbm.h... no 2023-07-19T20:46:11.025 INFO:teuthology.orchestra.run.smithi130.stdout:checking ndbm.h usability... no 2023-07-19T20:46:11.049 INFO:teuthology.orchestra.run.smithi130.stdout:checking ndbm.h presence... no 2023-07-19T20:46:11.049 INFO:teuthology.orchestra.run.smithi130.stdout:checking for ndbm.h... no 2023-07-19T20:46:11.096 INFO:teuthology.orchestra.run.smithi130.stdout:checking libaio.h usability... yes 2023-07-19T20:46:11.119 INFO:teuthology.orchestra.run.smithi130.stdout:checking libaio.h presence... yes 2023-07-19T20:46:11.120 INFO:teuthology.orchestra.run.smithi130.stdout:checking for libaio.h... yes 2023-07-19T20:46:11.164 INFO:teuthology.orchestra.run.smithi130.stdout:checking liburing.h usability... no 2023-07-19T20:46:11.188 INFO:teuthology.orchestra.run.smithi130.stdout:checking liburing.h presence... no 2023-07-19T20:46:11.188 INFO:teuthology.orchestra.run.smithi130.stdout:checking for liburing.h... no 2023-07-19T20:46:11.230 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/capability.h usability... no 2023-07-19T20:46:11.255 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/capability.h presence... no 2023-07-19T20:46:11.255 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/capability.h... no 2023-07-19T20:46:11.299 INFO:teuthology.orchestra.run.smithi130.stdout:checking linux/fiemap.h usability... yes 2023-07-19T20:46:11.315 INFO:teuthology.orchestra.run.smithi130.stdout:checking linux/fiemap.h presence... yes 2023-07-19T20:46:11.315 INFO:teuthology.orchestra.run.smithi130.stdout:checking for linux/fiemap.h... yes 2023-07-19T20:46:11.377 INFO:teuthology.orchestra.run.smithi130.stdout:checking for fallocate... yes 2023-07-19T20:46:11.436 INFO:teuthology.orchestra.run.smithi130.stdout:checking for open_by_handle_at... yes 2023-07-19T20:46:11.483 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/prctl.h usability... yes 2023-07-19T20:46:11.500 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/prctl.h presence... yes 2023-07-19T20:46:11.501 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/prctl.h... yes 2023-07-19T20:46:11.547 INFO:teuthology.orchestra.run.smithi130.stdout:checking linux/fs.h usability... yes 2023-07-19T20:46:11.564 INFO:teuthology.orchestra.run.smithi130.stdout:checking linux/fs.h presence... yes 2023-07-19T20:46:11.565 INFO:teuthology.orchestra.run.smithi130.stdout:checking for linux/fs.h... yes 2023-07-19T20:46:11.608 INFO:teuthology.orchestra.run.smithi130.stdout:checking btrfsutil.h usability... no 2023-07-19T20:46:11.631 INFO:teuthology.orchestra.run.smithi130.stdout:checking btrfsutil.h presence... no 2023-07-19T20:46:11.631 INFO:teuthology.orchestra.run.smithi130.stdout:checking for btrfsutil.h... no 2023-07-19T20:46:11.693 INFO:teuthology.orchestra.run.smithi130.stdout:checking for copy_file_range... yes 2023-07-19T20:46:11.756 INFO:teuthology.orchestra.run.smithi130.stdout:checking for SEEK_DATA... yes 2023-07-19T20:46:11.839 INFO:teuthology.orchestra.run.smithi130.stdout:checking for BMV_OF_SHARED... yes 2023-07-19T20:46:11.902 INFO:teuthology.orchestra.run.smithi130.stdout:checking for nftw... yes 2023-07-19T20:46:11.964 INFO:teuthology.orchestra.run.smithi130.stdout:checking for RLIMIT_NOFILE... yes 2023-07-19T20:46:12.002 INFO:teuthology.orchestra.run.smithi130.stdout:checking for FIEXCHANGE_RANGE... no 2023-07-19T20:46:12.063 INFO:teuthology.orchestra.run.smithi130.stdout:checking for renameat2... yes 2023-07-19T20:46:12.124 INFO:teuthology.orchestra.run.smithi130.stdout:checking for reallocarray... yes 2023-07-19T20:46:12.158 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct mount_attr... no 2023-07-19T20:46:12.234 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct btrfs_qgroup_limit... yes 2023-07-19T20:46:12.308 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-07-19T20:46:12.382 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-07-19T20:46:12.455 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-07-19T20:46:12.528 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-07-19T20:46:12.601 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-07-19T20:46:12.675 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-07-19T20:46:12.729 INFO:teuthology.orchestra.run.smithi130.stdout:checking linux/btrfs.h usability... yes 2023-07-19T20:46:12.745 INFO:teuthology.orchestra.run.smithi130.stdout:checking linux/btrfs.h presence... yes 2023-07-19T20:46:12.746 INFO:teuthology.orchestra.run.smithi130.stdout:checking for linux/btrfs.h... yes 2023-07-19T20:46:12.806 INFO:teuthology.orchestra.run.smithi130.stdout:checking linux/btrfs_tree.h usability... yes 2023-07-19T20:46:12.824 INFO:teuthology.orchestra.run.smithi130.stdout:checking linux/btrfs_tree.h presence... yes 2023-07-19T20:46:12.824 INFO:teuthology.orchestra.run.smithi130.stdout:checking for linux/btrfs_tree.h... yes 2023-07-19T20:46:12.897 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-07-19T20:46:12.926 INFO:teuthology.orchestra.run.smithi130.stdout:configure: creating ./config.status 2023-07-19T20:46:13.834 INFO:teuthology.orchestra.run.smithi130.stdout:config.status: creating include/builddefs 2023-07-19T20:46:13.863 INFO:teuthology.orchestra.run.smithi130.stdout:config.status: creating include/config.h 2023-07-19T20:46:13.885 INFO:teuthology.orchestra.run.smithi130.stdout:config.status: executing libtool commands 2023-07-19T20:46:13.968 INFO:teuthology.orchestra.run.smithi130.stdout:Building include 2023-07-19T20:46:13.972 INFO:teuthology.orchestra.run.smithi130.stdout:Building lib 2023-07-19T20:46:13.978 INFO:teuthology.orchestra.run.smithi130.stdout: [LTDEP] 2023-07-19T20:46:14.178 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] dataascii.lo 2023-07-19T20:46:14.381 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] databin.lo 2023-07-19T20:46:14.614 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] datapid.lo 2023-07-19T20:46:14.704 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:46:14.707 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:46:14.709 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:46:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] file_lock.lo 2023-07-19T20:46:15.047 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] forker.lo 2023-07-19T20:46:15.266 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] pattern.lo 2023-07-19T20:46:15.469 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] open_flags.lo 2023-07-19T20:46:15.697 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] random_range.lo 2023-07-19T20:46:16.002 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] string_to_tokens.lo 2023-07-19T20:46:16.188 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] str_to_bytes.lo 2023-07-19T20:46:16.403 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] tlibio.lo 2023-07-19T20:46:16.720 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] write_log.lo 2023-07-19T20:46:17.043 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] random.lo 2023-07-19T20:46:17.245 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] 2023-07-19T20:46:17.377 INFO:teuthology.orchestra.run.smithi130.stdout:Building ltp 2023-07-19T20:46:17.383 INFO:teuthology.orchestra.run.smithi130.stdout: [DEP] 2023-07-19T20:46:17.625 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] doio 2023-07-19T20:46:18.356 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fsstress 2023-07-19T20:46:19.713 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fsx 2023-07-19T20:46:20.647 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] growfiles 2023-07-19T20:46:21.241 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] iogen 2023-07-19T20:46:21.691 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-stress 2023-07-19T20:46:22.200 INFO:teuthology.orchestra.run.smithi130.stdout:Building src 2023-07-19T20:46:22.210 INFO:teuthology.orchestra.run.smithi130.stdout: [DEP] 2023-07-19T20:46:24.761 INFO:teuthology.orchestra.run.smithi130.stdout: [DEP] 2023-07-19T20:46:24.811 INFO:teuthology.orchestra.run.smithi130.stdout: [DEP] 2023-07-19T20:46:24.828 INFO:teuthology.orchestra.run.smithi130.stdout: [DEP] 2023-07-19T20:46:25.170 INFO:teuthology.orchestra.run.smithi130.stdout: [DEP] 2023-07-19T20:46:25.212 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] dirstress 2023-07-19T20:46:25.549 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fill 2023-07-19T20:46:25.801 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fill2 2023-07-19T20:46:26.129 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] getpagesize 2023-07-19T20:46:26.364 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] holes 2023-07-19T20:46:26.659 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] lstat64 2023-07-19T20:46:26.942 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] nametest 2023-07-19T20:46:27.279 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] permname 2023-07-19T20:46:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] randholes 2023-07-19T20:46:27.930 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] runas 2023-07-19T20:46:28.220 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] truncfile 2023-07-19T20:46:28.503 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] usemem 2023-07-19T20:46:28.755 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] mmapcat 2023-07-19T20:46:29.004 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] append_reader 2023-07-19T20:46:29.254 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] append_writer 2023-07-19T20:46:29.505 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] dirperf 2023-07-19T20:46:29.826 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] metaperf 2023-07-19T20:46:30.176 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] devzero 2023-07-19T20:46:30.452 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] feature 2023-07-19T20:46:30.769 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] alloc 2023-07-19T20:46:31.084 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fault 2023-07-19T20:46:31.346 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fstest 2023-07-19T20:46:31.683 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_access_root 2023-07-19T20:46:31.939 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] godown 2023-07-19T20:46:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] resvtest 2023-07-19T20:46:32.497 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] writemod 2023-07-19T20:46:32.741 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] writev_on_pagefault 2023-07-19T20:46:33.001 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] makeextents 2023-07-19T20:46:33.281 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] itrash 2023-07-19T20:46:33.536 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] rename 2023-07-19T20:46:33.775 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] multi_open_unlink 2023-07-19T20:46:34.041 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] unwritten_sync 2023-07-19T20:46:34.323 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] genhashnames 2023-07-19T20:46:34.608 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_holes 2023-07-19T20:46:34.854 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_mmap_writev 2023-07-19T20:46:35.103 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_truncate_cmtime 2023-07-19T20:46:35.362 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] dirhash_collide 2023-07-19T20:46:35.644 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_rename_overwrite 2023-07-19T20:46:35.884 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] holetest 2023-07-19T20:46:36.206 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_truncate_self 2023-07-19T20:46:36.441 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] af_unix 2023-07-19T20:46:36.695 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_mmap_stale_pmd 2023-07-19T20:46:36.948 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_mmap_cow_race 2023-07-19T20:46:37.213 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_mmap_fallocate 2023-07-19T20:46:37.465 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fsync-err 2023-07-19T20:46:37.747 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_mmap_write_ro 2023-07-19T20:46:37.999 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_ext4_dax_journal_corruption 2023-07-19T20:46:38.259 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_ext4_dax_inline_corruption 2023-07-19T20:46:38.516 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_ofd_locks 2023-07-19T20:46:38.816 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_mmap_collision 2023-07-19T20:46:39.112 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] mmap-write-concurrent 2023-07-19T20:46:39.381 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_get_file_time 2023-07-19T20:46:39.628 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_create_short_dirs 2023-07-19T20:46:39.895 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_create_long_dirs 2023-07-19T20:46:40.158 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_enospc 2023-07-19T20:46:40.442 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_mmap_writev_overlap 2023-07-19T20:46:40.710 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] checkpoint_journal 2023-07-19T20:46:40.966 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] mmap-rw-fault 2023-07-19T20:46:41.250 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] allocstale 2023-07-19T20:46:41.522 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_mmap_cow_memory_failure 2023-07-19T20:46:41.794 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fake-dump-rootino 2023-07-19T20:46:42.045 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] dio-buf-fault 2023-07-19T20:46:42.298 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfsctl 2023-07-19T20:46:42.588 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] bstat 2023-07-19T20:46:42.893 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_mtab 2023-07-19T20:46:43.176 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] getdevicesize 2023-07-19T20:46:43.416 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] preallo_rw_pattern_reader 2023-07-19T20:46:43.678 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] preallo_rw_pattern_writer 2023-07-19T20:46:43.940 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] ftrunc 2023-07-19T20:46:44.188 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] trunc 2023-07-19T20:46:44.450 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fs_perms 2023-07-19T20:46:44.715 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] testx 2023-07-19T20:46:44.817 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:46:44.819 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:46:44.822 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:46:44.948 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] looptest 2023-07-19T20:46:45.240 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] locktest 2023-07-19T20:46:45.640 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] unwritten_mmap 2023-07-19T20:46:45.905 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] bulkstat_unlink_test 2023-07-19T20:46:46.208 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] deduperace 2023-07-19T20:46:46.504 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] bulkstat_unlink_test_modified 2023-07-19T20:46:46.804 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_dir_offset 2023-07-19T20:46:47.050 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_futimens 2023-07-19T20:46:47.291 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_immutable 2023-07-19T20:46:47.978 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] stale_handle 2023-07-19T20:46:48.251 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] pwrite_mmap_blocked 2023-07-19T20:46:48.506 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_dir_offset2 2023-07-19T20:46:48.798 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] seek_sanity_test 2023-07-19T20:46:49.307 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] seek_copy_test 2023-07-19T20:46:49.583 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_readdir_1 2023-07-19T20:46:49.833 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_readdir_2 2023-07-19T20:46:50.084 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fsync-tester 2023-07-19T20:46:50.430 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] nsexec 2023-07-19T20:46:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] cloner 2023-07-19T20:46:50.985 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] renameat2 2023-07-19T20:46:51.253 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_getcwd 2023-07-19T20:46:51.513 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] e4compact 2023-07-19T20:46:51.813 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] test-nextquota 2023-07-19T20:46:52.084 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] punch-alternating 2023-07-19T20:46:52.358 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] attr-list-by-handle-cursor-test 2023-07-19T20:46:52.627 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] listxattr 2023-07-19T20:46:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] dio-interleaved 2023-07-19T20:46:53.134 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_dir_type 2023-07-19T20:46:53.391 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] dio-invalidate-cache 2023-07-19T20:46:53.695 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] stat_test 2023-07-19T20:46:54.092 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_encrypted_d_revalidate 2023-07-19T20:46:54.359 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] attr_replace_test 2023-07-19T20:46:54.622 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] swapon 2023-07-19T20:46:54.887 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] mkswap 2023-07-19T20:46:55.139 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_attr_corruption 2023-07-19T20:46:55.391 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_open_tmpfiles 2023-07-19T20:46:55.673 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fscrypt-crypt-util 2023-07-19T20:46:56.384 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] bulkstat_null_ocount 2023-07-19T20:46:56.647 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] splice-test 2023-07-19T20:46:56.928 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] chprojid_fail 2023-07-19T20:46:57.193 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] detached_mounts_propagation 2023-07-19T20:46:57.482 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] ext4_resize 2023-07-19T20:46:57.733 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_readdir_3 2023-07-19T20:46:58.027 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] splice2pipe 2023-07-19T20:46:58.291 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] uuid_ioctl 2023-07-19T20:46:58.549 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fiemap-tester 2023-07-19T20:46:58.914 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_stripealign 2023-07-19T20:46:59.169 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] open_by_handle 2023-07-19T20:46:59.520 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] t_mmap_dio 2023-07-19T20:46:59.782 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfsfind 2023-07-19T20:47:00.080 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fssum 2023-07-19T20:47:00.604 INFO:teuthology.orchestra.run.smithi130.stdout:Building log-writes 2023-07-19T20:47:00.614 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] replay-log 2023-07-19T20:47:01.027 INFO:teuthology.orchestra.run.smithi130.stdout:Building perf 2023-07-19T20:47:01.034 INFO:teuthology.orchestra.run.smithi130.stdout:Building aio-dio-regress 2023-07-19T20:47:01.045 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-dio-append-write-fallocate-race 2023-07-19T20:47:01.323 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-dio-fcntl-race 2023-07-19T20:47:01.592 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-dio-subblock-eof-read 2023-07-19T20:47:01.839 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-dio-append-write-read-race 2023-07-19T20:47:02.119 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-dio-invalidate-readahead 2023-07-19T20:47:02.388 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-dio-hole-filling-race 2023-07-19T20:47:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-07-19T20:47:02.882 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-last-ref-held-by-io 2023-07-19T20:47:03.160 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-dio-cycle-write 2023-07-19T20:47:03.448 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-dio-extend-stat 2023-07-19T20:47:03.718 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-07-19T20:47:03.955 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-dio-invalidate-failure 2023-07-19T20:47:04.220 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aiodio_sparse2 2023-07-19T20:47:04.541 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aiocp 2023-07-19T20:47:04.866 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-dio-cow-race 2023-07-19T20:47:05.126 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-dio-write-verify 2023-07-19T20:47:05.420 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] aio-dio-eof-race 2023-07-19T20:47:05.707 INFO:teuthology.orchestra.run.smithi130.stdout:Building vfs 2023-07-19T20:47:05.717 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] vfstest 2023-07-19T20:47:07.692 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] mount-idmapped 2023-07-19T20:47:08.168 INFO:teuthology.orchestra.run.smithi130.stdout:Building m4 2023-07-19T20:47:08.176 INFO:teuthology.orchestra.run.smithi130.stdout:Building common 2023-07-19T20:47:08.183 INFO:teuthology.orchestra.run.smithi130.stdout:Building tests 2023-07-19T20:47:08.196 INFO:teuthology.orchestra.run.smithi130.stdout:Building perf 2023-07-19T20:47:08.203 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/perf/group.list 2023-07-19T20:47:08.233 INFO:teuthology.orchestra.run.smithi130.stdout:Building ext4 2023-07-19T20:47:08.243 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/ext4/group.list 2023-07-19T20:47:08.339 INFO:teuthology.orchestra.run.smithi130.stdout:Building ocfs2 2023-07-19T20:47:08.348 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/ocfs2/group.list 2023-07-19T20:47:08.382 INFO:teuthology.orchestra.run.smithi130.stdout:Building overlay 2023-07-19T20:47:08.392 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/overlay/group.list 2023-07-19T20:47:08.489 INFO:teuthology.orchestra.run.smithi130.stdout:Building cifs 2023-07-19T20:47:08.498 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/cifs/group.list 2023-07-19T20:47:08.530 INFO:teuthology.orchestra.run.smithi130.stdout:Building generic 2023-07-19T20:47:08.543 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/generic/group.list 2023-07-19T20:47:08.788 INFO:teuthology.orchestra.run.smithi130.stdout:Building shared 2023-07-19T20:47:08.798 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/shared/group.list 2023-07-19T20:47:08.841 INFO:teuthology.orchestra.run.smithi130.stdout:Building nfs 2023-07-19T20:47:08.851 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/nfs/group.list 2023-07-19T20:47:08.888 INFO:teuthology.orchestra.run.smithi130.stdout:Building f2fs 2023-07-19T20:47:08.898 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/f2fs/group.list 2023-07-19T20:47:08.941 INFO:teuthology.orchestra.run.smithi130.stdout:Building udf 2023-07-19T20:47:08.951 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/udf/group.list 2023-07-19T20:47:08.982 INFO:teuthology.orchestra.run.smithi130.stdout:Building ceph 2023-07-19T20:47:08.990 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/ceph/group.list 2023-07-19T20:47:09.026 INFO:teuthology.orchestra.run.smithi130.stdout:Building xfs 2023-07-19T20:47:09.038 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/xfs/group.list 2023-07-19T20:47:09.288 INFO:teuthology.orchestra.run.smithi130.stdout:Building btrfs 2023-07-19T20:47:09.299 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/btrfs/group.list 2023-07-19T20:47:09.448 INFO:teuthology.orchestra.run.smithi130.stdout:Building tmpfs 2023-07-19T20:47:09.458 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/tmpfs/group.list 2023-07-19T20:47:09.492 INFO:teuthology.orchestra.run.smithi130.stdout:Building selftest 2023-07-19T20:47:09.502 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/selftest/group.list 2023-07-19T20:47:09.536 DEBUG:teuthology.orchestra.run.smithi130:> (cd /tmp/tmp.WX1oxq0LGuxfstests-dev && exec sudo make install) 2023-07-19T20:47:09.668 INFO:teuthology.orchestra.run.smithi130.stdout:Building include 2023-07-19T20:47:09.676 INFO:teuthology.orchestra.run.smithi130.stdout:Building lib 2023-07-19T20:47:09.684 INFO:teuthology.orchestra.run.smithi130.stdout:Building ltp 2023-07-19T20:47:09.692 INFO:teuthology.orchestra.run.smithi130.stdout:Building src 2023-07-19T20:47:09.754 INFO:teuthology.orchestra.run.smithi130.stdout:Building log-writes 2023-07-19T20:47:09.761 INFO:teuthology.orchestra.run.smithi130.stdout:Building perf 2023-07-19T20:47:09.768 INFO:teuthology.orchestra.run.smithi130.stdout:Building aio-dio-regress 2023-07-19T20:47:09.776 INFO:teuthology.orchestra.run.smithi130.stdout:Building vfs 2023-07-19T20:47:09.784 INFO:teuthology.orchestra.run.smithi130.stdout:Building m4 2023-07-19T20:47:09.793 INFO:teuthology.orchestra.run.smithi130.stdout:Building common 2023-07-19T20:47:09.798 INFO:teuthology.orchestra.run.smithi130.stdout:Building tests 2023-07-19T20:47:09.808 INFO:teuthology.orchestra.run.smithi130.stdout:Building perf 2023-07-19T20:47:09.820 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/perf/group.list 2023-07-19T20:47:09.848 INFO:teuthology.orchestra.run.smithi130.stdout:Building ext4 2023-07-19T20:47:09.858 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/ext4/group.list 2023-07-19T20:47:09.952 INFO:teuthology.orchestra.run.smithi130.stdout:Building ocfs2 2023-07-19T20:47:09.961 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/ocfs2/group.list 2023-07-19T20:47:09.996 INFO:teuthology.orchestra.run.smithi130.stdout:Building overlay 2023-07-19T20:47:10.006 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/overlay/group.list 2023-07-19T20:47:10.104 INFO:teuthology.orchestra.run.smithi130.stdout:Building cifs 2023-07-19T20:47:10.114 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/cifs/group.list 2023-07-19T20:47:10.146 INFO:teuthology.orchestra.run.smithi130.stdout:Building generic 2023-07-19T20:47:10.158 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/generic/group.list 2023-07-19T20:47:10.398 INFO:teuthology.orchestra.run.smithi130.stdout:Building shared 2023-07-19T20:47:10.408 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/shared/group.list 2023-07-19T20:47:10.453 INFO:teuthology.orchestra.run.smithi130.stdout:Building nfs 2023-07-19T20:47:10.463 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/nfs/group.list 2023-07-19T20:47:10.499 INFO:teuthology.orchestra.run.smithi130.stdout:Building f2fs 2023-07-19T20:47:10.509 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/f2fs/group.list 2023-07-19T20:47:10.553 INFO:teuthology.orchestra.run.smithi130.stdout:Building udf 2023-07-19T20:47:10.563 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/udf/group.list 2023-07-19T20:47:10.593 INFO:teuthology.orchestra.run.smithi130.stdout:Building ceph 2023-07-19T20:47:10.602 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/ceph/group.list 2023-07-19T20:47:10.639 INFO:teuthology.orchestra.run.smithi130.stdout:Building xfs 2023-07-19T20:47:10.651 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/xfs/group.list 2023-07-19T20:47:10.894 INFO:teuthology.orchestra.run.smithi130.stdout:Building btrfs 2023-07-19T20:47:10.905 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/btrfs/group.list 2023-07-19T20:47:11.052 INFO:teuthology.orchestra.run.smithi130.stdout:Building tmpfs 2023-07-19T20:47:11.062 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/tmpfs/group.list 2023-07-19T20:47:11.097 INFO:teuthology.orchestra.run.smithi130.stdout:Building selftest 2023-07-19T20:47:11.107 INFO:teuthology.orchestra.run.smithi130.stdout: [GROUP] /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/selftest/group.list 2023-07-19T20:47:11.139 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-07-19T20:47:11.140 INFO:teuthology.orchestra.run.smithi130.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-19T20:47:11.140 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-07-19T20:47:11.143 INFO:teuthology.orchestra.run.smithi130.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-19T20:47:11.144 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-07-19T20:47:11.147 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-07-19T20:47:11.170 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-07-19T20:47:11.346 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-07-19T20:47:11.370 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-07-19T20:47:11.399 INFO:teuthology.orchestra.run.smithi130.stdout:Building log-writes 2023-07-19T20:47:11.407 INFO:teuthology.orchestra.run.smithi130.stdout:Building perf 2023-07-19T20:47:11.414 INFO:teuthology.orchestra.run.smithi130.stdout:Building aio-dio-regress 2023-07-19T20:47:11.422 INFO:teuthology.orchestra.run.smithi130.stdout:Building vfs 2023-07-19T20:47:11.428 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake -C log-writes install 2023-07-19T20:47:11.430 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-07-19T20:47:11.454 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-07-19T20:47:11.477 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake -C perf install 2023-07-19T20:47:11.480 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-07-19T20:47:11.503 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-07-19T20:47:11.563 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-07-19T20:47:11.566 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-07-19T20:47:11.589 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-07-19T20:47:11.731 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake -C vfs install 2023-07-19T20:47:11.733 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-07-19T20:47:11.757 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-07-19T20:47:11.789 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-07-19T20:47:11.812 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-07-19T20:47:14.800 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-07-19T20:47:14.935 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:47:14.937 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:47:14.940 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:47:15.022 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-07-19T20:47:15.078 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-07-19T20:47:15.083 INFO:teuthology.orchestra.run.smithi130.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-19T20:47:15.084 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-07-19T20:47:15.084 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-07-19T20:47:15.107 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-07-19T20:47:15.461 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-07-19T20:47:15.463 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/btrfs/ install 2023-07-19T20:47:15.468 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-07-19T20:47:15.491 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 299 /var/lib/xfstests/tests/btrfs 2023-07-19T20:47:17.645 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-07-19T20:47:17.668 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 036.out 275.out 016.out 175.out 240.out 180.out 069.out 282.out 015.out 280.out 140.out 056.out 008.out 004.out 199.out 233.out 194.out 234.out 248.out 109.out 033.out 252.out 270.out 040.out 176.out 202.out 137.out 125.out 078.out 152.out 003.out 264.out 243.out 192.out 148.out 075.out 178.out 284.out 052.out 256.out 207.out 228.out 128.out 028.out 183.out 225.out 094.out 046.out 273.out 090.out 251.out 089.out 206.out 215.out 115.out 197.out 250.out 266.out 051.out 246.out 219.out 119.out 244.out 232.out 121.out 112.out 012.out 195.out 107.out 162.out 083.out 147.out 288.out 242.out 187.out 024.out 220.out 153.out 020.out 102.out 002.out 171.out 261.out 135.out 156.out 092.out 255.out 072.out 068.out 143.out 048.out 062.out 084.out 129.out 029.out 229.out 103.out 254.out 111.out 011.out 155.out 134.out 170.out 260.out 034.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 276.out 114.out 138.out 095.out 038.out 145.out 160.out 091.out 081.out 071.out 061.out 085.out 265.out 200.out 100.out 025.out 258.out 286.out 269.out 039.out 196.out 098.out 080.out 070.out 060.out 208.out 106.out 009.out 167.out 217.out 120.out 191.out 117.out 017.out 211.out 158.out 182.out 066.out 146.out 212.out 188.out 065.out 204.out 104.out 041.out 177.out 279.out 241.out 235.out 253.out 257.out 124.out 035.out 172.out 278.out 058.out 262.out 169.out 042.out 193.out 097.out 271.out 283.out 236.out 186.out 053.out 133.out 164.out 154.out 239.out 189.out 037.out 139.out 267.out 141.out 214.out 014.out 223.out 086.out 132.out 179.out 144.out 032.out 277.out 205.out 136.out 005.out 096.out 198.out 108.out 190.out 173.out 050.out 105.out 291.out 185.out 067.out 088.out 285.out 209.out 123.out 044.out 201.out 019.out 001.out 287.out 142.out 237.out 151.out 231.out 163.out 131.out 213.out 113.out 013.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 227.out 010.out 263.out 127.out 230.out 166.out 130.out 023.out 073.out 099.out 082.out 030.out 203.out 063.out 055.out 076.out 245.out 122.out 074.out 222.out 159.out 249.out 022.out 289.out 174.out 006.out 045.out 281.out 290.out 299.out 224.out 181.out 149.out 064.out 218.out 118.out 018.out 047.out 168.out 007.out 093.out 079.out 054.out 059.out 150.out 049.out 226.out 126.out 165.out 026.out 021.out 077.out 221.out 087.out /var/lib/xfstests/tests/btrfs 2023-07-19T20:47:19.827 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/ceph/ install 2023-07-19T20:47:19.829 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-07-19T20:47:19.853 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-07-19T20:47:19.905 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-07-19T20:47:19.929 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-07-19T20:47:19.983 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/cifs/ install 2023-07-19T20:47:19.984 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-07-19T20:47:20.007 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-07-19T20:47:20.030 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-07-19T20:47:20.053 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-07-19T20:47:20.077 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/ext4/ install 2023-07-19T20:47:20.080 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-07-19T20:47:20.103 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-07-19T20:47:20.615 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-07-19T20:47:20.638 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-07-19T20:47:21.174 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/f2fs/ install 2023-07-19T20:47:21.177 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-07-19T20:47:21.200 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-07-19T20:47:21.230 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-07-19T20:47:21.254 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-07-19T20:47:21.285 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/generic/ install 2023-07-19T20:47:21.291 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-07-19T20:47:21.314 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 /var/lib/xfstests/tests/generic 2023-07-19T20:47:26.663 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-07-19T20:47:26.686 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 310.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 243.out 592.out 282.out 272.out 728.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 120.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 655.out 591.out 064.out 471.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 673.out 260.out 312.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 295.out 390.out 497.out 160.out 691.out 274.out 061.out 239.out 457.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 309.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 365.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 012.out 634.out 340.out 156.out 572.out 240.out 180.out 549.out 473.out 633.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 566.out 433.out 704.out 108.out 504.out 404.out 304.out 104.out 175.out 297.out 393.out 333.out 599.out 476.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 352.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 480.out 436.out 544.out 169.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 376.out 724.out 206.out 663.out 651.out 248.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 142.out 715.out 279.out 222.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 682.out 472.out 684.out 674.out 550.out 052.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 487.out 688.out 643.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 030.out 244.out 128.out 385.out 005.out 336.out 579.out 236.out 405.out 667.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 505.out 305.out 105.out 263.out 144.out 291.out 437.out 044.out 719.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 548.out 560.out 166.out 707.out 461.out 381.out 445.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 150.out 613.out 326.out 082.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 485.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 173.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 729.out 378.out 004.out 458.out 062.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 547.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 280.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 676.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 301.out 431.out 635.out 288.out 722.out 331.out 377.out 713.out 535.out 513.out 554.out 622.out 313.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 534.out 427.out 210.out 449.out 327.out 330.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 532.out 245.out 522.out 422.out 624.out 322.out 394.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 533.out 512.out 221.out 087.out 212.out 538.out 112.out 342.out 021.out 195.out 388.out 483.out 397.out 070.out 596.out 720.out 565.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 167.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 111.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 110.out 010.out 001.out 141.out 495.out 048.out 665.out 589.out 095.out 581.out 697.out 145.out 641.out 464.out 491.out 081.out 075.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 259.out 090.out 080.out 708.out 608.out 508.out 409.out 307.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 531.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out 452.out 096.out /var/lib/xfstests/tests/generic 2023-07-19T20:47:32.073 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/nfs/ install 2023-07-19T20:47:32.075 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-07-19T20:47:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-07-19T20:47:32.122 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-07-19T20:47:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-07-19T20:47:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/ocfs2/ install 2023-07-19T20:47:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-07-19T20:47:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-07-19T20:47:32.218 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-07-19T20:47:32.241 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-07-19T20:47:32.265 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/overlay/ install 2023-07-19T20:47:32.268 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-07-19T20:47:32.291 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-07-19T20:47:33.008 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-07-19T20:47:33.032 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 110.out 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 023.out 073.out 078.out 030.out 058.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 009.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 107.out 007.out 028.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 025.out 056.out 057.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 037.out 103.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-07-19T20:47:33.755 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/perf/ install 2023-07-19T20:47:33.758 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-07-19T20:47:33.781 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-07-19T20:47:33.804 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-07-19T20:47:33.827 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-07-19T20:47:33.853 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/selftest/ install 2023-07-19T20:47:33.854 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-07-19T20:47:33.877 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-07-19T20:47:33.937 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-07-19T20:47:33.960 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-07-19T20:47:34.020 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/shared/ install 2023-07-19T20:47:34.023 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-07-19T20:47:34.046 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-07-19T20:47:34.084 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-07-19T20:47:34.107 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-07-19T20:47:34.145 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/tmpfs/ install 2023-07-19T20:47:34.148 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-07-19T20:47:34.171 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-07-19T20:47:34.194 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-07-19T20:47:34.218 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-07-19T20:47:34.241 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/udf/ install 2023-07-19T20:47:34.244 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-07-19T20:47:34.267 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-07-19T20:47:34.291 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-07-19T20:47:34.314 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-07-19T20:47:34.338 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.WX1oxq0LGuxfstests-dev/tests/xfs/ install 2023-07-19T20:47:34.343 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-07-19T20:47:34.366 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-07-19T20:47:39.423 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-07-19T20:47:39.447 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 308.out 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 759.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 474.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 363.out 131.out 243.out 183.out 547.out 738.out 260.out 718.out 034.out 465.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 085.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 042.out 497.out 466.out 193.out 097.out 392.out 283.out 541.out 770.out 709.out 755.out 309.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 280.out 434.out 140.out 766.out 185.out 408.out 383.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 254.out 335.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 496.out 751.out 433.out 176.out 134.out 393.out 333.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 267.out 390.out 399.out 781.out 017.out 169.out 593.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 276.out 290.out 094.out 451.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 305.out 395.out 515.out 415.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 464.out 475.out 536.out 228.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 342.out 580.out 136.out 036.out 198.out 723.out 008.out 790.out 505.out 405.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 562.out 419.out 219.out 123.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 350.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 207.out 493.out 786.out 007.out 251.out 380.out 093.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 788.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 148.out 301.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 590.out 368.out 486.out 223.out 132.out 023.out 459.out 032.out 798.out 277.out 748.out 527.out 146.out 398.out 366.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 725.out 731.out 782.out 374.out 583.out 285.out 127.out 256.out 501.out 376.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 010.out 230.out 083.out 473.out 299.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 026.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 448.out 234.out 022.out 174.out 779.out 490.out 565.out 090.out 423.out 154.out 271.out 149.out 518.out 318.out 264.out 218.out 118.out 018.out 329.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 021.out 195.out 388.out 483.out 397.out 070.out 373.out 720.out 481.out 196.out 520.out 129.out 446.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 357.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 175.out 714.out 559.out 710.out 410.out 310.out 401.out 101.out 001.out 141.out 495.out 048.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 757.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 307.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out /var/lib/xfstests/tests/xfs 2023-07-19T20:47:44.566 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-07-19T20:47:44.590 INFO:teuthology.orchestra.run.smithi130.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-07-19T20:47:44.613 INFO:teuthology.orchestra.run.smithi130.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-07-19T20:47:44.636 INFO:teuthology.orchestra.run.smithi130.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-07-19T20:47:44.663 DEBUG:teuthology.orchestra.run.smithi130:> (cd /tmp/tmp.ViZlSiF0Gpxfsprogs-dev && exec sudo make) 2023-07-19T20:47:44.782 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize -c -i -f 2023-07-19T20:47:45.056 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:47:45.060 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:47:45.064 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:47:45.069 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-07-19T20:47:45.069 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file './config.guess' 2023-07-19T20:47:45.077 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file './config.sub' 2023-07-19T20:47:45.087 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file './install-sh' 2023-07-19T20:47:45.099 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file './ltmain.sh' 2023-07-19T20:47:45.161 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-07-19T20:47:45.161 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-07-19T20:47:45.174 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-07-19T20:47:45.186 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-07-19T20:47:45.199 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-07-19T20:47:45.212 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-07-19T20:47:45.229 INFO:teuthology.orchestra.run.smithi130.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-07-19T20:47:45.232 INFO:teuthology.orchestra.run.smithi130.stdout:cp include/install-sh . 2023-07-19T20:47:45.234 INFO:teuthology.orchestra.run.smithi130.stdout:aclocal -I m4 2023-07-19T20:47:46.484 INFO:teuthology.orchestra.run.smithi130.stdout:autoconf 2023-07-19T20:47:46.909 INFO:teuthology.orchestra.run.smithi130.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-07-19T20:47:47.047 INFO:teuthology.orchestra.run.smithi130.stdout:configure: loading site script /usr/share/config.site 2023-07-19T20:47:47.087 INFO:teuthology.orchestra.run.smithi130.stdout:checking for a BSD-compatible install... /bin/install -c 2023-07-19T20:47:47.184 INFO:teuthology.orchestra.run.smithi130.stdout:checking build system type... x86_64-pc-linux-gnu 2023-07-19T20:47:47.184 INFO:teuthology.orchestra.run.smithi130.stdout:checking host system type... x86_64-pc-linux-gnu 2023-07-19T20:47:47.188 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to print strings... printf 2023-07-19T20:47:47.188 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gcc... gcc 2023-07-19T20:47:47.281 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether the C compiler works... yes 2023-07-19T20:47:47.281 INFO:teuthology.orchestra.run.smithi130.stdout:checking for C compiler default output file name... a.out 2023-07-19T20:47:47.331 INFO:teuthology.orchestra.run.smithi130.stdout:checking for suffix of executables... 2023-07-19T20:47:47.387 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether we are cross compiling... no 2023-07-19T20:47:47.425 INFO:teuthology.orchestra.run.smithi130.stdout:checking for suffix of object files... o 2023-07-19T20:47:47.459 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether we are using the GNU C compiler... yes 2023-07-19T20:47:47.495 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether gcc accepts -g... yes 2023-07-19T20:47:47.539 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gcc option to accept ISO C89... none needed 2023-07-19T20:47:47.547 INFO:teuthology.orchestra.run.smithi130.stdout:checking for a sed that does not truncate output... /bin/sed 2023-07-19T20:47:47.552 INFO:teuthology.orchestra.run.smithi130.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-07-19T20:47:47.555 INFO:teuthology.orchestra.run.smithi130.stdout:checking for egrep... /bin/grep -E 2023-07-19T20:47:47.558 INFO:teuthology.orchestra.run.smithi130.stdout:checking for fgrep... /bin/grep -F 2023-07-19T20:47:47.566 INFO:teuthology.orchestra.run.smithi130.stdout:checking for ld used by gcc... /bin/ld 2023-07-19T20:47:47.570 INFO:teuthology.orchestra.run.smithi130.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-07-19T20:47:47.586 INFO:teuthology.orchestra.run.smithi130.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-07-19T20:47:47.614 INFO:teuthology.orchestra.run.smithi130.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-07-19T20:47:47.615 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether ln -s works... yes 2023-07-19T20:47:47.623 INFO:teuthology.orchestra.run.smithi130.stdout:checking the maximum length of command line arguments... 1572864 2023-07-19T20:47:47.629 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-07-19T20:47:47.629 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-07-19T20:47:47.629 INFO:teuthology.orchestra.run.smithi130.stdout:checking for /bin/ld option to reload object files... -r 2023-07-19T20:47:47.629 INFO:teuthology.orchestra.run.smithi130.stdout:checking for objdump... objdump 2023-07-19T20:47:47.629 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to recognize dependent libraries... pass_all 2023-07-19T20:47:47.630 INFO:teuthology.orchestra.run.smithi130.stdout:checking for dlltool... no 2023-07-19T20:47:47.631 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-07-19T20:47:47.631 INFO:teuthology.orchestra.run.smithi130.stdout:checking for ar... ar 2023-07-19T20:47:47.676 INFO:teuthology.orchestra.run.smithi130.stdout:checking for archiver @FILE support... @ 2023-07-19T20:47:47.677 INFO:teuthology.orchestra.run.smithi130.stdout:checking for strip... strip 2023-07-19T20:47:47.677 INFO:teuthology.orchestra.run.smithi130.stdout:checking for ranlib... ranlib 2023-07-19T20:47:47.677 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gawk... gawk 2023-07-19T20:47:47.787 INFO:teuthology.orchestra.run.smithi130.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-07-19T20:47:47.790 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sysroot... no 2023-07-19T20:47:47.797 INFO:teuthology.orchestra.run.smithi130.stdout:checking for a working dd... /bin/dd 2023-07-19T20:47:47.804 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-07-19T20:47:47.832 INFO:teuthology.orchestra.run.smithi130.stdout:checking for mt... no 2023-07-19T20:47:47.838 INFO:teuthology.orchestra.run.smithi130.stdout:checking if : is a manifest tool... no 2023-07-19T20:47:47.880 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to run the C preprocessor... gcc -E 2023-07-19T20:47:48.068 INFO:teuthology.orchestra.run.smithi130.stdout:checking for ANSI C header files... yes 2023-07-19T20:47:48.112 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/types.h... yes 2023-07-19T20:47:48.165 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/stat.h... yes 2023-07-19T20:47:48.217 INFO:teuthology.orchestra.run.smithi130.stdout:checking for stdlib.h... yes 2023-07-19T20:47:48.271 INFO:teuthology.orchestra.run.smithi130.stdout:checking for string.h... yes 2023-07-19T20:47:48.324 INFO:teuthology.orchestra.run.smithi130.stdout:checking for memory.h... yes 2023-07-19T20:47:48.378 INFO:teuthology.orchestra.run.smithi130.stdout:checking for strings.h... yes 2023-07-19T20:47:48.432 INFO:teuthology.orchestra.run.smithi130.stdout:checking for inttypes.h... yes 2023-07-19T20:47:48.489 INFO:teuthology.orchestra.run.smithi130.stdout:checking for stdint.h... yes 2023-07-19T20:47:48.542 INFO:teuthology.orchestra.run.smithi130.stdout:checking for unistd.h... yes 2023-07-19T20:47:48.598 INFO:teuthology.orchestra.run.smithi130.stdout:checking for dlfcn.h... yes 2023-07-19T20:47:48.602 INFO:teuthology.orchestra.run.smithi130.stdout:checking for objdir... .libs 2023-07-19T20:47:48.738 INFO:teuthology.orchestra.run.smithi130.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-07-19T20:47:48.738 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-07-19T20:47:48.777 INFO:teuthology.orchestra.run.smithi130.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-07-19T20:47:48.814 INFO:teuthology.orchestra.run.smithi130.stdout:checking if gcc static flag -static works... no 2023-07-19T20:47:48.867 INFO:teuthology.orchestra.run.smithi130.stdout:checking if gcc supports -c -o file.o... yes 2023-07-19T20:47:48.867 INFO:teuthology.orchestra.run.smithi130.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-07-19T20:47:48.882 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-07-19T20:47:48.932 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether -lc should be explicitly linked in... no 2023-07-19T20:47:49.022 INFO:teuthology.orchestra.run.smithi130.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-07-19T20:47:49.022 INFO:teuthology.orchestra.run.smithi130.stdout:checking how to hardcode library paths into programs... immediate 2023-07-19T20:47:49.025 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether stripping libraries is possible... yes 2023-07-19T20:47:49.025 INFO:teuthology.orchestra.run.smithi130.stdout:checking if libtool supports shared libraries... yes 2023-07-19T20:47:49.025 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether to build shared libraries... yes 2023-07-19T20:47:49.025 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether to build static libraries... yes 2023-07-19T20:47:49.026 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gcc... (cached) gcc 2023-07-19T20:47:49.065 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-19T20:47:49.065 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-19T20:47:49.065 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-19T20:47:49.079 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gcc... (cached) gcc 2023-07-19T20:47:49.118 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-19T20:47:49.118 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-19T20:47:49.118 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-19T20:47:49.127 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gcc... (cached) gcc 2023-07-19T20:47:49.165 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-19T20:47:49.166 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-19T20:47:49.166 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-19T20:47:49.167 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gmake... /bin/gmake 2023-07-19T20:47:49.167 INFO:teuthology.orchestra.run.smithi130.stdout:checking for tar... /bin/tar 2023-07-19T20:47:49.167 INFO:teuthology.orchestra.run.smithi130.stdout:checking for gzip... /bin/gzip 2023-07-19T20:47:49.182 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether gcc -MM is supported... yes 2023-07-19T20:47:49.183 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sort... /bin/sort 2023-07-19T20:47:49.184 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether ln -s works... yes 2023-07-19T20:47:49.185 INFO:teuthology.orchestra.run.smithi130.stdout:checking for msgfmt... /bin/msgfmt 2023-07-19T20:47:49.186 INFO:teuthology.orchestra.run.smithi130.stdout:checking for msgmerge... /bin/msgmerge 2023-07-19T20:47:49.186 INFO:teuthology.orchestra.run.smithi130.stdout:checking for xgettext... /bin/xgettext 2023-07-19T20:47:49.186 INFO:teuthology.orchestra.run.smithi130.stdout:checking for rpm... /bin/rpm 2023-07-19T20:47:49.193 INFO:teuthology.orchestra.run.smithi130.stdout:checking for rpmbuild... no 2023-07-19T20:47:49.241 INFO:teuthology.orchestra.run.smithi130.stdout:checking ini.h usability... yes 2023-07-19T20:47:49.259 INFO:teuthology.orchestra.run.smithi130.stdout:checking ini.h presence... yes 2023-07-19T20:47:49.259 INFO:teuthology.orchestra.run.smithi130.stdout:checking for ini.h... yes 2023-07-19T20:47:49.318 INFO:teuthology.orchestra.run.smithi130.stdout:checking for ini_parse in -linih... yes 2023-07-19T20:47:49.369 INFO:teuthology.orchestra.run.smithi130.stdout:checking uuid.h usability... no 2023-07-19T20:47:49.394 INFO:teuthology.orchestra.run.smithi130.stdout:checking uuid.h presence... no 2023-07-19T20:47:49.395 INFO:teuthology.orchestra.run.smithi130.stdout:checking for uuid.h... no 2023-07-19T20:47:49.443 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/uuid.h usability... no 2023-07-19T20:47:49.467 INFO:teuthology.orchestra.run.smithi130.stdout:checking sys/uuid.h presence... no 2023-07-19T20:47:49.467 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sys/uuid.h... no 2023-07-19T20:47:49.517 INFO:teuthology.orchestra.run.smithi130.stdout:checking uuid/uuid.h usability... yes 2023-07-19T20:47:49.536 INFO:teuthology.orchestra.run.smithi130.stdout:checking uuid/uuid.h presence... yes 2023-07-19T20:47:49.537 INFO:teuthology.orchestra.run.smithi130.stdout:checking for uuid/uuid.h... yes 2023-07-19T20:47:49.611 INFO:teuthology.orchestra.run.smithi130.stdout:checking for uuid_compare... no 2023-07-19T20:47:49.668 INFO:teuthology.orchestra.run.smithi130.stdout:checking for uuid_compare in -luuid... yes 2023-07-19T20:47:49.716 INFO:teuthology.orchestra.run.smithi130.stdout:checking pthread.h usability... yes 2023-07-19T20:47:49.736 INFO:teuthology.orchestra.run.smithi130.stdout:checking pthread.h presence... yes 2023-07-19T20:47:49.736 INFO:teuthology.orchestra.run.smithi130.stdout:checking for pthread.h... yes 2023-07-19T20:47:49.796 INFO:teuthology.orchestra.run.smithi130.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-07-19T20:47:49.849 INFO:teuthology.orchestra.run.smithi130.stdout:checking urcu.h usability... yes 2023-07-19T20:47:49.874 INFO:teuthology.orchestra.run.smithi130.stdout:checking urcu.h presence... yes 2023-07-19T20:47:49.875 INFO:teuthology.orchestra.run.smithi130.stdout:checking for urcu.h... yes 2023-07-19T20:47:49.926 INFO:teuthology.orchestra.run.smithi130.stdout:checking for liburcu... yes 2023-07-19T20:47:49.967 INFO:teuthology.orchestra.run.smithi130.stdout:checking for fadvise ... yes 2023-07-19T20:47:50.006 INFO:teuthology.orchestra.run.smithi130.stdout:checking for madvise ... yes 2023-07-19T20:47:50.045 INFO:teuthology.orchestra.run.smithi130.stdout:checking for mincore ... yes 2023-07-19T20:47:50.093 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sendfile ... yes 2023-07-19T20:47:50.133 INFO:teuthology.orchestra.run.smithi130.stdout:checking for getmntent ... yes 2023-07-19T20:47:50.195 INFO:teuthology.orchestra.run.smithi130.stdout:checking for fallocate... yes 2023-07-19T20:47:50.256 INFO:teuthology.orchestra.run.smithi130.stdout:checking for fiemap... yes 2023-07-19T20:47:50.319 INFO:teuthology.orchestra.run.smithi130.stdout:checking for pwritev2... yes 2023-07-19T20:47:50.380 INFO:teuthology.orchestra.run.smithi130.stdout:checking for preadv... yes 2023-07-19T20:47:50.443 INFO:teuthology.orchestra.run.smithi130.stdout:checking for copy_file_range... yes 2023-07-19T20:47:50.504 INFO:teuthology.orchestra.run.smithi130.stdout:checking for sync_file_range... yes 2023-07-19T20:47:50.566 INFO:teuthology.orchestra.run.smithi130.stdout:checking for syncfs... yes 2023-07-19T20:47:50.610 INFO:teuthology.orchestra.run.smithi130.stdout:checking mntent.h usability... yes 2023-07-19T20:47:50.626 INFO:teuthology.orchestra.run.smithi130.stdout:checking mntent.h presence... yes 2023-07-19T20:47:50.626 INFO:teuthology.orchestra.run.smithi130.stdout:checking for mntent.h... yes 2023-07-19T20:47:50.670 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether fls is declared... no 2023-07-19T20:47:50.728 INFO:teuthology.orchestra.run.smithi130.stdout:checking for readdir... yes 2023-07-19T20:47:50.778 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether fsetxattr is declared... yes 2023-07-19T20:47:50.825 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether mremap is declared... yes 2023-07-19T20:47:50.894 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct fsxattr... yes 2023-07-19T20:47:50.932 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-07-19T20:47:50.963 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct fscrypt_add_key_arg... no 2023-07-19T20:47:51.034 INFO:teuthology.orchestra.run.smithi130.stdout:checking for GETFSMAP... yes 2023-07-19T20:47:51.105 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct statfs... yes 2023-07-19T20:47:51.144 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct statfs.f_flags... yes 2023-07-19T20:47:51.179 INFO:teuthology.orchestra.run.smithi130.stdout:checking for MAP_SYNC... yes 2023-07-19T20:47:51.315 INFO:teuthology.orchestra.run.smithi130.stdout:checking for library containing dm_task_create... -ldevmapper 2023-07-19T20:47:51.355 INFO:teuthology.orchestra.run.smithi130.stdout:checking for mallinfo ... yes 2023-07-19T20:47:51.390 INFO:teuthology.orchestra.run.smithi130.stdout:checking for mallinfo2 ... no 2023-07-19T20:47:51.435 INFO:teuthology.orchestra.run.smithi130.stdout:checking attr/attributes.h usability... yes 2023-07-19T20:47:51.452 INFO:teuthology.orchestra.run.smithi130.stdout:checking attr/attributes.h presence... yes 2023-07-19T20:47:51.452 INFO:teuthology.orchestra.run.smithi130.stdout:checking for attr/attributes.h... yes 2023-07-19T20:47:51.493 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct attrlist_cursor... yes 2023-07-19T20:47:51.496 INFO:teuthology.orchestra.run.smithi130.stdout:checking for pkg-config... /bin/pkg-config 2023-07-19T20:47:51.510 INFO:teuthology.orchestra.run.smithi130.stdout:checking pkg-config is at least version 0.9.0... yes 2023-07-19T20:47:51.523 INFO:teuthology.orchestra.run.smithi130.stdout:checking for libicu... yes 2023-07-19T20:47:51.574 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether openat is declared... yes 2023-07-19T20:47:51.626 INFO:teuthology.orchestra.run.smithi130.stdout:checking whether fstatat is declared... yes 2023-07-19T20:47:51.675 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct sg_io_hdr ... yes 2023-07-19T20:47:51.716 INFO:teuthology.orchestra.run.smithi130.stdout:checking for struct hd_geometry ... yes 2023-07-19T20:47:51.743 INFO:teuthology.orchestra.run.smithi130.stdout:checking for systemd... yes 2023-07-19T20:47:51.746 INFO:teuthology.orchestra.run.smithi130.stdout:checking for systemd system unit dir... /usr/lib/systemd/system 2023-07-19T20:47:51.747 INFO:teuthology.orchestra.run.smithi130.stdout:checking for system crontab dir... /etc/cron.d 2023-07-19T20:47:51.881 INFO:teuthology.orchestra.run.smithi130.stdout:checking for library containing blkid_probe_all... -lblkid 2023-07-19T20:47:51.949 INFO:teuthology.orchestra.run.smithi130.stdout:checking for blkid_probe_get_topology... yes 2023-07-19T20:47:52.039 INFO:teuthology.orchestra.run.smithi130.stdout:checking size of long... 8 2023-07-19T20:47:52.130 INFO:teuthology.orchestra.run.smithi130.stdout:checking size of char *... 8 2023-07-19T20:47:52.161 INFO:teuthology.orchestra.run.smithi130.stdout:checking for umode_t... no 2023-07-19T20:47:52.242 INFO:teuthology.orchestra.run.smithi130.stdout:checking for atomic64_t support in liburcu... yes 2023-07-19T20:47:52.275 INFO:teuthology.orchestra.run.smithi130.stdout:configure: creating ./config.status 2023-07-19T20:47:53.200 INFO:teuthology.orchestra.run.smithi130.stdout:config.status: creating include/builddefs 2023-07-19T20:47:53.227 INFO:teuthology.orchestra.run.smithi130.stdout:config.status: creating include/platform_defs.h 2023-07-19T20:47:53.249 INFO:teuthology.orchestra.run.smithi130.stdout:config.status: executing libtool commands 2023-07-19T20:47:53.338 INFO:teuthology.orchestra.run.smithi130.stdout: [HEADERS] include 2023-07-19T20:47:53.354 INFO:teuthology.orchestra.run.smithi130.stdout: [HEADERS] libxfs 2023-07-19T20:47:53.382 INFO:teuthology.orchestra.run.smithi130.stdout:Building include 2023-07-19T20:47:53.391 INFO:teuthology.orchestra.run.smithi130.stdout: [LN] disk 2023-07-19T20:47:53.395 INFO:teuthology.orchestra.run.smithi130.stdout:Building libfrog 2023-07-19T20:47:53.402 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] gen_crc32table 2023-07-19T20:47:53.473 INFO:teuthology.orchestra.run.smithi130.stdout: [GENERATE] crc32table.h 2023-07-19T20:47:53.965 INFO:teuthology.orchestra.run.smithi130.stdout: [TEST] CRC32 2023-07-19T20:47:54.141 INFO:teuthology.orchestra.run.smithi130.stdout:CRC_LE_BITS = 64 2023-07-19T20:47:54.141 INFO:teuthology.orchestra.run.smithi130.stdout:crc32c: tests passed, 225944 bytes in 56 usec 2023-07-19T20:47:54.145 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] avl64.lo 2023-07-19T20:47:54.740 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] bitmap.lo 2023-07-19T20:47:55.198 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] bulkstat.lo 2023-07-19T20:47:55.714 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] convert.lo 2023-07-19T20:47:56.189 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] crc32.lo 2023-07-19T20:47:56.550 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fsgeom.lo 2023-07-19T20:47:57.001 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] list_sort.lo 2023-07-19T20:47:57.350 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] linux.lo 2023-07-19T20:47:57.810 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] logging.lo 2023-07-19T20:47:58.106 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] paths.lo 2023-07-19T20:47:58.670 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] projects.lo 2023-07-19T20:47:59.102 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] ptvar.lo 2023-07-19T20:47:59.488 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] radix-tree.lo 2023-07-19T20:48:00.127 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] randbytes.lo 2023-07-19T20:48:00.477 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] scrub.lo 2023-07-19T20:48:00.820 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] util.lo 2023-07-19T20:48:01.175 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] workqueue.lo 2023-07-19T20:48:01.586 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] libfrog.la 2023-07-19T20:48:01.727 INFO:teuthology.orchestra.run.smithi130.stdout:Building libxfs 2023-07-19T20:48:03.442 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] cache.lo 2023-07-19T20:48:04.099 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] defer_item.lo 2023-07-19T20:48:04.663 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] init.lo 2023-07-19T20:48:05.494 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] kmem.lo 2023-07-19T20:48:05.919 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] logitem.lo 2023-07-19T20:48:06.377 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] rdwr.lo 2023-07-19T20:48:07.315 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] topology.lo 2023-07-19T20:48:07.822 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] trans.lo 2023-07-19T20:48:08.457 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] util.lo 2023-07-19T20:48:09.090 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_ag.lo 2023-07-19T20:48:09.993 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_ag_resv.lo 2023-07-19T20:48:10.487 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_alloc.lo 2023-07-19T20:48:12.022 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_alloc_btree.lo 2023-07-19T20:48:12.636 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_attr.lo 2023-07-19T20:48:13.363 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_attr_leaf.lo 2023-07-19T20:48:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_attr_remote.lo 2023-07-19T20:48:15.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:48:15.163 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:48:15.166 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:48:15.500 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_bit.lo 2023-07-19T20:48:15.922 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_bmap.lo 2023-07-19T20:48:18.946 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_bmap_btree.lo 2023-07-19T20:48:19.606 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_btree.lo 2023-07-19T20:48:21.796 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_btree_staging.lo 2023-07-19T20:48:22.381 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_da_btree.lo 2023-07-19T20:48:23.715 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_defer.lo 2023-07-19T20:48:24.351 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_dir2.lo 2023-07-19T20:48:24.978 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_dir2_block.lo 2023-07-19T20:48:25.940 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_dir2_data.lo 2023-07-19T20:48:26.854 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_dir2_leaf.lo 2023-07-19T20:48:27.885 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_dir2_node.lo 2023-07-19T20:48:29.029 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_dir2_sf.lo 2023-07-19T20:48:29.921 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_dquot_buf.lo 2023-07-19T20:48:30.442 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_ialloc.lo 2023-07-19T20:48:31.827 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_iext_tree.lo 2023-07-19T20:48:32.679 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_inode_buf.lo 2023-07-19T20:48:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_inode_fork.lo 2023-07-19T20:48:34.202 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_ialloc_btree.lo 2023-07-19T20:48:34.856 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_log_rlimit.lo 2023-07-19T20:48:35.305 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_refcount.lo 2023-07-19T20:48:36.222 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_refcount_btree.lo 2023-07-19T20:48:36.813 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_rmap.lo 2023-07-19T20:48:38.054 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_rmap_btree.lo 2023-07-19T20:48:38.713 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_rtbitmap.lo 2023-07-19T20:48:39.443 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_sb.lo 2023-07-19T20:48:40.350 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_symlink_remote.lo 2023-07-19T20:48:40.847 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_trans_inode.lo 2023-07-19T20:48:41.280 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_trans_resv.lo 2023-07-19T20:48:41.984 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_types.lo 2023-07-19T20:48:42.472 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] libxfs.la 2023-07-19T20:48:42.741 INFO:teuthology.orchestra.run.smithi130.stdout:Building libxlog 2023-07-19T20:48:42.839 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_log_recover.lo 2023-07-19T20:48:43.747 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] util.lo 2023-07-19T20:48:44.245 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] libxlog.la 2023-07-19T20:48:44.363 INFO:teuthology.orchestra.run.smithi130.stdout:Building libxcmd 2023-07-19T20:48:44.502 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] command.lo 2023-07-19T20:48:44.968 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] input.lo 2023-07-19T20:48:45.290 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:48:45.298 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:48:45.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:48:45.410 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] help.lo 2023-07-19T20:48:45.783 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] quit.lo 2023-07-19T20:48:46.138 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] libxcmd.la 2023-07-19T20:48:46.259 INFO:teuthology.orchestra.run.smithi130.stdout:Building libhandle 2023-07-19T20:48:46.344 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] handle.lo 2023-07-19T20:48:46.826 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] jdm.lo 2023-07-19T20:48:47.238 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] libhandle.la 2023-07-19T20:48:47.396 INFO:teuthology.orchestra.run.smithi130.stdout:Building copy 2023-07-19T20:48:47.455 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_copy.o 2023-07-19T20:48:47.893 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] xfs_copy 2023-07-19T20:48:48.110 INFO:teuthology.orchestra.run.smithi130.stdout:Building db 2023-07-19T20:48:50.227 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] addr.o 2023-07-19T20:48:50.351 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] agf.o 2023-07-19T20:48:50.470 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] agfl.o 2023-07-19T20:48:50.587 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] agi.o 2023-07-19T20:48:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] attr.o 2023-07-19T20:48:50.919 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] attrshort.o 2023-07-19T20:48:51.055 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] bit.o 2023-07-19T20:48:51.193 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] block.o 2023-07-19T20:48:51.347 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] bmap.o 2023-07-19T20:48:51.558 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] btblock.o 2023-07-19T20:48:51.705 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] bmroot.o 2023-07-19T20:48:51.884 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] check.o 2023-07-19T20:48:53.586 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] command.o 2023-07-19T20:48:53.711 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] crc.o 2023-07-19T20:48:53.843 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] debug.o 2023-07-19T20:48:53.952 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] dir2.o 2023-07-19T20:48:54.259 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] dir2sf.o 2023-07-19T20:48:54.417 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] dquot.o 2023-07-19T20:48:54.545 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] echo.o 2023-07-19T20:48:54.652 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] faddr.o 2023-07-19T20:48:54.843 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] field.o 2023-07-19T20:48:54.972 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] flist.o 2023-07-19T20:48:55.168 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fprint.o 2023-07-19T20:48:55.344 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] frag.o 2023-07-19T20:48:55.590 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] freesp.o 2023-07-19T20:48:55.799 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] hash.o 2023-07-19T20:48:55.878 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c: In function ‘hash_f’: 2023-07-19T20:48:55.880 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:76:37: warning: pointer targets in passing argument 1 of ‘libxfs_da_hashname’ differ in signedness [-Wpointer-sign] 2023-07-19T20:48:55.880 INFO:teuthology.orchestra.run.smithi130.stderr: hashval = libxfs_da_hashname(argv[c], strlen(argv[c])); 2023-07-19T20:48:55.881 INFO:teuthology.orchestra.run.smithi130.stderr: ~~~~^~~ 2023-07-19T20:48:55.881 INFO:teuthology.orchestra.run.smithi130.stderr:In file included from ../include/libxfs.h:10, 2023-07-19T20:48:55.881 INFO:teuthology.orchestra.run.smithi130.stderr: from hash.c:7: 2023-07-19T20:48:55.881 INFO:teuthology.orchestra.run.smithi130.stderr:../libxfs/libxfs_api_defs.h:69:27: note: expected ‘const uint8_t *’ {aka ‘const unsigned char *’} but argument is of type ‘char *’ 2023-07-19T20:48:55.882 INFO:teuthology.orchestra.run.smithi130.stderr: #define xfs_da_hashname libxfs_da_hashname 2023-07-19T20:48:55.882 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~~~~~~~~~~ 2023-07-19T20:48:55.882 INFO:teuthology.orchestra.run.smithi130.stderr:../libxfs/xfs_da_btree.h:223:6: note: in expansion of macro ‘xfs_da_hashname’ 2023-07-19T20:48:55.882 INFO:teuthology.orchestra.run.smithi130.stderr: uint xfs_da_hashname(const uint8_t *name_string, int name_length); 2023-07-19T20:48:55.883 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~~~~~~~ 2023-07-19T20:48:55.883 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c: In function ‘collide_dirents’: 2023-07-19T20:48:55.883 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:258:22: warning: pointer targets in passing argument 2 of ‘openat’ differ in signedness [-Wpointer-sign] 2023-07-19T20:48:55.883 INFO:teuthology.orchestra.run.smithi130.stderr: newfd = openat(fd, name, O_CREAT, 0600); 2023-07-19T20:48:55.884 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~ 2023-07-19T20:48:55.885 INFO:teuthology.orchestra.run.smithi130.stderr:In file included from /usr/include/features.h:438, 2023-07-19T20:48:55.885 INFO:teuthology.orchestra.run.smithi130.stderr: from /usr/include/bits/libc-header-start.h:33, 2023-07-19T20:48:55.885 INFO:teuthology.orchestra.run.smithi130.stderr: from /usr/include/stdio.h:27, 2023-07-19T20:48:55.886 INFO:teuthology.orchestra.run.smithi130.stderr: from ../include/platform_defs.h:10, 2023-07-19T20:48:55.886 INFO:teuthology.orchestra.run.smithi130.stderr: from ../include/libxfs.h:11, 2023-07-19T20:48:55.886 INFO:teuthology.orchestra.run.smithi130.stderr: from hash.c:7: 2023-07-19T20:48:55.886 INFO:teuthology.orchestra.run.smithi130.stderr:/usr/include/fcntl.h:223:12: note: expected ‘const char *’ but argument is of type ‘const unsigned char *’ 2023-07-19T20:48:55.887 INFO:teuthology.orchestra.run.smithi130.stderr: extern int __REDIRECT (openat, (int __fd, const char *__file, int __oflag, 2023-07-19T20:48:55.887 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~~ 2023-07-19T20:48:55.887 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:273:11: warning: pointer targets in passing argument 1 of ‘strncpy’ differ in signedness [-Wpointer-sign] 2023-07-19T20:48:55.887 INFO:teuthology.orchestra.run.smithi130.stderr: strncpy(direntname, name, MAXNAMELEN); 2023-07-19T20:48:55.888 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~~ 2023-07-19T20:48:55.888 INFO:teuthology.orchestra.run.smithi130.stderr:In file included from ../include/platform_defs.h:17, 2023-07-19T20:48:55.888 INFO:teuthology.orchestra.run.smithi130.stderr: from ../include/libxfs.h:11, 2023-07-19T20:48:55.889 INFO:teuthology.orchestra.run.smithi130.stderr: from hash.c:7: 2023-07-19T20:48:55.889 INFO:teuthology.orchestra.run.smithi130.stderr:/usr/include/string.h:125:14: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-07-19T20:48:55.889 INFO:teuthology.orchestra.run.smithi130.stderr: extern char *strncpy (char *__restrict __dest, 2023-07-19T20:48:55.890 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~ 2023-07-19T20:48:55.890 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:273:23: warning: pointer targets in passing argument 2 of ‘strncpy’ differ in signedness [-Wpointer-sign] 2023-07-19T20:48:55.891 INFO:teuthology.orchestra.run.smithi130.stderr: strncpy(direntname, name, MAXNAMELEN); 2023-07-19T20:48:55.891 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~ 2023-07-19T20:48:55.891 INFO:teuthology.orchestra.run.smithi130.stderr:In file included from ../include/platform_defs.h:17, 2023-07-19T20:48:55.891 INFO:teuthology.orchestra.run.smithi130.stderr: from ../include/libxfs.h:11, 2023-07-19T20:48:55.892 INFO:teuthology.orchestra.run.smithi130.stderr: from hash.c:7: 2023-07-19T20:48:55.892 INFO:teuthology.orchestra.run.smithi130.stderr:/usr/include/string.h:125:14: note: expected ‘const char * restrict’ but argument is of type ‘const unsigned char *’ 2023-07-19T20:48:55.892 INFO:teuthology.orchestra.run.smithi130.stderr: extern char *strncpy (char *__restrict __dest, 2023-07-19T20:48:55.892 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~ 2023-07-19T20:48:55.893 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:278:23: warning: pointer targets in passing argument 2 of ‘linkat’ differ in signedness [-Wpointer-sign] 2023-07-19T20:48:55.893 INFO:teuthology.orchestra.run.smithi130.stderr: error = linkat(fd, name, fd, direntname, 0); 2023-07-19T20:48:55.893 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~ 2023-07-19T20:48:55.894 INFO:teuthology.orchestra.run.smithi130.stderr:In file included from ../include/platform_defs.h:19, 2023-07-19T20:48:55.895 INFO:teuthology.orchestra.run.smithi130.stderr: from ../include/libxfs.h:11, 2023-07-19T20:48:55.895 INFO:teuthology.orchestra.run.smithi130.stderr: from hash.c:7: 2023-07-19T20:48:55.895 INFO:teuthology.orchestra.run.smithi130.stderr:/usr/include/unistd.h:795:12: note: expected ‘const char *’ but argument is of type ‘const unsigned char *’ 2023-07-19T20:48:55.896 INFO:teuthology.orchestra.run.smithi130.stderr: extern int linkat (int __fromfd, const char *__from, int __tofd, 2023-07-19T20:48:55.896 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~ 2023-07-19T20:48:55.896 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:278:33: warning: pointer targets in passing argument 4 of ‘linkat’ differ in signedness [-Wpointer-sign] 2023-07-19T20:48:55.896 INFO:teuthology.orchestra.run.smithi130.stderr: error = linkat(fd, name, fd, direntname, 0); 2023-07-19T20:48:55.896 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~~ 2023-07-19T20:48:55.896 INFO:teuthology.orchestra.run.smithi130.stderr:In file included from ../include/platform_defs.h:19, 2023-07-19T20:48:55.897 INFO:teuthology.orchestra.run.smithi130.stderr: from ../include/libxfs.h:11, 2023-07-19T20:48:55.897 INFO:teuthology.orchestra.run.smithi130.stderr: from hash.c:7: 2023-07-19T20:48:55.897 INFO:teuthology.orchestra.run.smithi130.stderr:/usr/include/unistd.h:795:12: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-07-19T20:48:55.897 INFO:teuthology.orchestra.run.smithi130.stderr: extern int linkat (int __fromfd, const char *__from, int __tofd, 2023-07-19T20:48:55.897 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~ 2023-07-19T20:48:55.897 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c: In function ‘collide_xattrs’: 2023-07-19T20:48:55.897 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:318:12: warning: pointer targets in passing argument 1 of ‘snprintf’ differ in signedness [-Wpointer-sign] 2023-07-19T20:48:55.897 INFO:teuthology.orchestra.run.smithi130.stderr: snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-07-19T20:48:55.898 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~ 2023-07-19T20:48:55.898 INFO:teuthology.orchestra.run.smithi130.stderr:In file included from ../include/platform_defs.h:10, 2023-07-19T20:48:55.898 INFO:teuthology.orchestra.run.smithi130.stderr: from ../include/libxfs.h:11, 2023-07-19T20:48:55.898 INFO:teuthology.orchestra.run.smithi130.stderr: from hash.c:7: 2023-07-19T20:48:55.898 INFO:teuthology.orchestra.run.smithi130.stderr:/usr/include/stdio.h:354:12: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-07-19T20:48:55.898 INFO:teuthology.orchestra.run.smithi130.stderr: extern int snprintf (char *__restrict __s, size_t __maxlen, 2023-07-19T20:48:55.898 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~ 2023-07-19T20:48:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:319:25: warning: pointer targets in passing argument 2 of ‘fsetxattr’ differ in signedness [-Wpointer-sign] 2023-07-19T20:48:55.899 INFO:teuthology.orchestra.run.smithi130.stderr: error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-07-19T20:48:55.899 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~ 2023-07-19T20:48:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:In file included from hash.c:16: 2023-07-19T20:48:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:/usr/include/sys/xattr.h:54:12: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-07-19T20:48:55.899 INFO:teuthology.orchestra.run.smithi130.stderr: extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-07-19T20:48:55.899 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~ 2023-07-19T20:48:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:332:12: warning: pointer targets in passing argument 1 of ‘snprintf’ differ in signedness [-Wpointer-sign] 2023-07-19T20:48:55.900 INFO:teuthology.orchestra.run.smithi130.stderr: snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-07-19T20:48:55.900 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~ 2023-07-19T20:48:55.900 INFO:teuthology.orchestra.run.smithi130.stderr:In file included from ../include/platform_defs.h:10, 2023-07-19T20:48:55.900 INFO:teuthology.orchestra.run.smithi130.stderr: from ../include/libxfs.h:11, 2023-07-19T20:48:55.900 INFO:teuthology.orchestra.run.smithi130.stderr: from hash.c:7: 2023-07-19T20:48:55.900 INFO:teuthology.orchestra.run.smithi130.stderr:/usr/include/stdio.h:354:12: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-07-19T20:48:55.900 INFO:teuthology.orchestra.run.smithi130.stderr: extern int snprintf (char *__restrict __s, size_t __maxlen, 2023-07-19T20:48:55.901 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~ 2023-07-19T20:48:55.901 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:337:26: warning: pointer targets in passing argument 2 of ‘fsetxattr’ differ in signedness [-Wpointer-sign] 2023-07-19T20:48:55.901 INFO:teuthology.orchestra.run.smithi130.stderr: error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-07-19T20:48:55.901 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~ 2023-07-19T20:48:55.901 INFO:teuthology.orchestra.run.smithi130.stderr:In file included from hash.c:16: 2023-07-19T20:48:55.901 INFO:teuthology.orchestra.run.smithi130.stderr:/usr/include/sys/xattr.h:54:12: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-07-19T20:48:55.901 INFO:teuthology.orchestra.run.smithi130.stderr: extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-07-19T20:48:55.902 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~ 2023-07-19T20:48:55.903 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c: In function ‘hashcoll_f’: 2023-07-19T20:48:55.903 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:417:31: warning: pointer targets in passing argument 2 of ‘collide_xattrs’ differ in signedness [-Wpointer-sign] 2023-07-19T20:48:55.903 INFO:teuthology.orchestra.run.smithi130.stderr: error = collide_xattrs(nr, buf, len, fd); 2023-07-19T20:48:55.903 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~ 2023-07-19T20:48:55.903 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:298:1: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-07-19T20:48:55.903 INFO:teuthology.orchestra.run.smithi130.stderr: collide_xattrs( 2023-07-19T20:48:55.903 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~~~~~~ 2023-07-19T20:48:55.904 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:419:32: warning: pointer targets in passing argument 2 of ‘collide_dirents’ differ in signedness [-Wpointer-sign] 2023-07-19T20:48:55.904 INFO:teuthology.orchestra.run.smithi130.stderr: error = collide_dirents(nr, buf, len, fd); 2023-07-19T20:48:55.904 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~ 2023-07-19T20:48:55.904 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:232:1: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-07-19T20:48:55.904 INFO:teuthology.orchestra.run.smithi130.stderr: collide_dirents( 2023-07-19T20:48:55.904 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~~~~~~~ 2023-07-19T20:48:55.904 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:431:35: warning: pointer targets in passing argument 2 of ‘collide_xattrs’ differ in signedness [-Wpointer-sign] 2023-07-19T20:48:55.905 INFO:teuthology.orchestra.run.smithi130.stderr: error = collide_xattrs(nr, argv[c], len, fd); 2023-07-19T20:48:55.905 INFO:teuthology.orchestra.run.smithi130.stderr: ~~~~^~~ 2023-07-19T20:48:55.905 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:298:1: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-07-19T20:48:55.905 INFO:teuthology.orchestra.run.smithi130.stderr: collide_xattrs( 2023-07-19T20:48:55.905 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~~~~~~ 2023-07-19T20:48:55.905 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:433:36: warning: pointer targets in passing argument 2 of ‘collide_dirents’ differ in signedness [-Wpointer-sign] 2023-07-19T20:48:55.905 INFO:teuthology.orchestra.run.smithi130.stderr: error = collide_dirents(nr, argv[c], len, fd); 2023-07-19T20:48:55.906 INFO:teuthology.orchestra.run.smithi130.stderr: ~~~~^~~ 2023-07-19T20:48:55.906 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c:232:1: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-07-19T20:48:55.906 INFO:teuthology.orchestra.run.smithi130.stderr: collide_dirents( 2023-07-19T20:48:55.906 INFO:teuthology.orchestra.run.smithi130.stderr: ^~~~~~~~~~~~~~~ 2023-07-19T20:48:55.950 INFO:teuthology.orchestra.run.smithi130.stderr:hash.c: At top level: 2023-07-19T20:48:55.950 INFO:teuthology.orchestra.run.smithi130.stderr:cc1: warning: unrecognized command line option ‘-Wno-address-of-packed-member’ 2023-07-19T20:48:55.974 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] help.o 2023-07-19T20:48:56.089 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] init.o 2023-07-19T20:48:56.230 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] inode.o 2023-07-19T20:48:56.518 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] input.o 2023-07-19T20:48:56.673 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] io.o 2023-07-19T20:48:56.889 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] logformat.o 2023-07-19T20:48:57.022 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] malloc.o 2023-07-19T20:48:57.136 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] metadump.o 2023-07-19T20:48:57.909 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] output.o 2023-07-19T20:48:58.031 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] print.o 2023-07-19T20:48:58.197 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] quit.o 2023-07-19T20:48:58.302 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] sb.o 2023-07-19T20:48:58.581 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] sig.o 2023-07-19T20:48:58.693 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] strvec.o 2023-07-19T20:48:58.815 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] text.o 2023-07-19T20:48:58.934 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] type.o 2023-07-19T20:48:59.072 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] write.o 2023-07-19T20:48:59.316 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] attrset.o 2023-07-19T20:48:59.461 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] symlink.o 2023-07-19T20:48:59.574 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fsmap.o 2023-07-19T20:48:59.712 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fuzz.o 2023-07-19T20:48:59.887 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] obfuscate.o 2023-07-19T20:49:00.040 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] btdump.o 2023-07-19T20:49:00.228 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] btheight.o 2023-07-19T20:49:00.403 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] convert.o 2023-07-19T20:49:00.556 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] info.o 2023-07-19T20:49:00.688 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] namei.o 2023-07-19T20:49:00.902 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] timelimit.o 2023-07-19T20:49:01.027 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] xfs_db 2023-07-19T20:49:01.332 INFO:teuthology.orchestra.run.smithi130.stdout:Building estimate 2023-07-19T20:49:01.391 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_estimate.o 2023-07-19T20:49:01.539 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] xfs_estimate 2023-07-19T20:49:01.638 INFO:teuthology.orchestra.run.smithi130.stdout:Building fsck 2023-07-19T20:49:01.645 INFO:teuthology.orchestra.run.smithi130.stdout:Building fsr 2023-07-19T20:49:01.707 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_fsr.o 2023-07-19T20:49:02.119 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] xfs_fsr 2023-07-19T20:49:02.265 INFO:teuthology.orchestra.run.smithi130.stdout:Building growfs 2023-07-19T20:49:02.324 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_growfs.o 2023-07-19T20:49:02.513 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] xfs_growfs 2023-07-19T20:49:02.726 INFO:teuthology.orchestra.run.smithi130.stdout:Building io 2023-07-19T20:49:04.153 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] init.o 2023-07-19T20:49:04.268 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] attr.o 2023-07-19T20:49:04.410 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] bmap.o 2023-07-19T20:49:04.588 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] bulkstat.o 2023-07-19T20:49:04.743 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] crc32cselftest.o 2023-07-19T20:49:04.831 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] cowextsize.o 2023-07-19T20:49:04.940 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] encrypt.o 2023-07-19T20:49:05.143 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] file.o 2023-07-19T20:49:05.244 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] freeze.o 2023-07-19T20:49:05.332 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fsuuid.o 2023-07-19T20:49:05.444 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fsync.o 2023-07-19T20:49:05.526 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] getrusage.o 2023-07-19T20:49:05.619 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] imap.o 2023-07-19T20:49:05.710 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] inject.o 2023-07-19T20:49:05.808 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] label.o 2023-07-19T20:49:05.924 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] link.o 2023-07-19T20:49:06.007 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] mmap.o 2023-07-19T20:49:06.207 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] open.o 2023-07-19T20:49:06.469 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] parent.o 2023-07-19T20:49:06.623 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] pread.o 2023-07-19T20:49:06.796 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] prealloc.o 2023-07-19T20:49:06.935 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] pwrite.o 2023-07-19T20:49:07.088 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] reflink.o 2023-07-19T20:49:07.216 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] resblks.o 2023-07-19T20:49:07.301 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] scrub.o 2023-07-19T20:49:07.428 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] seek.o 2023-07-19T20:49:07.534 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] shutdown.o 2023-07-19T20:49:07.620 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] stat.o 2023-07-19T20:49:07.814 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] swapext.o 2023-07-19T20:49:07.902 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] sync.o 2023-07-19T20:49:07.983 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] truncate.o 2023-07-19T20:49:08.066 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] utimes.o 2023-07-19T20:49:08.151 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fadvise.o 2023-07-19T20:49:08.243 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] madvise.o 2023-07-19T20:49:08.335 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] mincore.o 2023-07-19T20:49:08.433 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] sendfile.o 2023-07-19T20:49:08.537 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fiemap.o 2023-07-19T20:49:08.687 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] copy_file_range.o 2023-07-19T20:49:08.789 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] sync_file_range.o 2023-07-19T20:49:08.879 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] readdir.o 2023-07-19T20:49:08.979 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] log_writes.o 2023-07-19T20:49:09.072 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fsmap.o 2023-07-19T20:49:09.298 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] xfs_io 2023-07-19T20:49:09.530 INFO:teuthology.orchestra.run.smithi130.stdout:Building logprint 2023-07-19T20:49:09.823 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] logprint.o 2023-07-19T20:49:09.965 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] log_copy.o 2023-07-19T20:49:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] log_dump.o 2023-07-19T20:49:10.205 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] log_misc.o 2023-07-19T20:49:10.683 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] log_print_all.o 2023-07-19T20:49:10.925 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] log_print_trans.o 2023-07-19T20:49:11.044 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] log_redo.o 2023-07-19T20:49:11.287 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] xfs_logprint 2023-07-19T20:49:11.512 INFO:teuthology.orchestra.run.smithi130.stdout:Building mkfs 2023-07-19T20:49:11.608 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] proto.o 2023-07-19T20:49:11.865 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_mkfs.o 2023-07-19T20:49:12.559 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] mkfs.xfs 2023-07-19T20:49:12.778 INFO:teuthology.orchestra.run.smithi130.stdout:Building quota 2023-07-19T20:49:13.171 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] init.o 2023-07-19T20:49:13.273 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] util.o 2023-07-19T20:49:13.426 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] edit.o 2023-07-19T20:49:13.619 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] free.o 2023-07-19T20:49:13.765 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] linux.o 2023-07-19T20:49:13.845 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] path.o 2023-07-19T20:49:13.953 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] project.o 2023-07-19T20:49:14.094 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] quot.o 2023-07-19T20:49:14.244 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] quota.o 2023-07-19T20:49:14.405 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] report.o 2023-07-19T20:49:14.624 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] state.o 2023-07-19T20:49:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] xfs_quota 2023-07-19T20:49:14.947 INFO:teuthology.orchestra.run.smithi130.stdout:Building mdrestore 2023-07-19T20:49:15.008 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_mdrestore.o 2023-07-19T20:49:15.169 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] xfs_mdrestore 2023-07-19T20:49:15.359 INFO:teuthology.orchestra.run.smithi130.stdout:Building repair 2023-07-19T20:49:15.416 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:49:15.421 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:49:15.424 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:49:16.753 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] agheader.o 2023-07-19T20:49:16.975 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] agbtree.o 2023-07-19T20:49:17.206 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] attr_repair.o 2023-07-19T20:49:17.559 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] avl.o 2023-07-19T20:49:17.777 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] bulkload.o 2023-07-19T20:49:17.901 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] bmap.o 2023-07-19T20:49:18.056 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] btree.o 2023-07-19T20:49:18.376 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] da_util.o 2023-07-19T20:49:18.597 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] dino_chunks.o 2023-07-19T20:49:18.968 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] dinode.o 2023-07-19T20:49:19.697 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] dir2.o 2023-07-19T20:49:20.109 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] globals.o 2023-07-19T20:49:20.212 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] incore_bmc.o 2023-07-19T20:49:20.322 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] incore.o 2023-07-19T20:49:20.470 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] incore_ext.o 2023-07-19T20:49:20.689 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] incore_ino.o 2023-07-19T20:49:20.950 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] init.o 2023-07-19T20:49:21.091 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] phase1.o 2023-07-19T20:49:21.219 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] phase2.o 2023-07-19T20:49:21.409 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] phase3.o 2023-07-19T20:49:21.552 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] phase4.o 2023-07-19T20:49:21.742 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] phase5.o 2023-07-19T20:49:21.996 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] phase6.o 2023-07-19T20:49:22.846 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] phase7.o 2023-07-19T20:49:22.984 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] prefetch.o 2023-07-19T20:49:23.323 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] progress.o 2023-07-19T20:49:23.520 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] quotacheck.o 2023-07-19T20:49:23.725 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] rmap.o 2023-07-19T20:49:24.111 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] rt.o 2023-07-19T20:49:24.273 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] sb.o 2023-07-19T20:49:24.498 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] scan.o 2023-07-19T20:49:25.254 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] slab.o 2023-07-19T20:49:25.418 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] threads.o 2023-07-19T20:49:25.532 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] versions.o 2023-07-19T20:49:25.664 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_repair.o 2023-07-19T20:49:25.963 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] xfs_repair 2023-07-19T20:49:26.263 INFO:teuthology.orchestra.run.smithi130.stdout:Building rtcp 2023-07-19T20:49:26.323 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_rtcp.o 2023-07-19T20:49:26.496 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] xfs_rtcp 2023-07-19T20:49:26.614 INFO:teuthology.orchestra.run.smithi130.stdout:Building m4 2023-07-19T20:49:26.622 INFO:teuthology.orchestra.run.smithi130.stdout:Building man 2023-07-19T20:49:26.638 INFO:teuthology.orchestra.run.smithi130.stdout:Building man2 2023-07-19T20:49:26.643 INFO:teuthology.orchestra.run.smithi130.stdout:Building man3 2023-07-19T20:49:26.654 INFO:teuthology.orchestra.run.smithi130.stdout:Building man5 2023-07-19T20:49:26.663 INFO:teuthology.orchestra.run.smithi130.stdout:Building man8 2023-07-19T20:49:26.683 INFO:teuthology.orchestra.run.smithi130.stdout: [SED] mkfs.xfs.8 2023-07-19T20:49:26.691 INFO:teuthology.orchestra.run.smithi130.stdout:Building doc 2023-07-19T20:49:26.700 INFO:teuthology.orchestra.run.smithi130.stdout: [ZIP] CHANGES.gz 2023-07-19T20:49:26.714 INFO:teuthology.orchestra.run.smithi130.stdout:Building debian 2023-07-19T20:49:26.721 INFO:teuthology.orchestra.run.smithi130.stdout:Building spaceman 2023-07-19T20:49:27.017 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] info.o 2023-07-19T20:49:27.128 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] init.o 2023-07-19T20:49:27.255 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] file.o 2023-07-19T20:49:27.380 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] health.o 2023-07-19T20:49:27.544 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] prealloc.o 2023-07-19T20:49:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] trim.o 2023-07-19T20:49:27.792 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] freesp.o 2023-07-19T20:49:27.975 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] xfs_spaceman 2023-07-19T20:49:28.125 INFO:teuthology.orchestra.run.smithi130.stdout:Building scrub 2023-07-19T20:49:28.875 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] common.o 2023-07-19T20:49:29.014 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] counter.o 2023-07-19T20:49:29.088 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] descr.o 2023-07-19T20:49:29.177 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] disk.o 2023-07-19T20:49:29.301 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] filemap.o 2023-07-19T20:49:29.396 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] fscounters.o 2023-07-19T20:49:29.498 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] inodes.o 2023-07-19T20:49:29.649 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] phase1.o 2023-07-19T20:49:29.761 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] phase2.o 2023-07-19T20:49:29.868 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] phase3.o 2023-07-19T20:49:29.989 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] phase4.o 2023-07-19T20:49:30.091 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] phase5.o 2023-07-19T20:49:30.232 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] phase6.o 2023-07-19T20:49:30.414 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] phase7.o 2023-07-19T20:49:30.535 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] progress.o 2023-07-19T20:49:30.644 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] read_verify.o 2023-07-19T20:49:30.770 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] repair.o 2023-07-19T20:49:30.894 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] scrub.o 2023-07-19T20:49:31.097 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] spacemap.o 2023-07-19T20:49:31.216 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] vfs.o 2023-07-19T20:49:31.338 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] xfs_scrub.o 2023-07-19T20:49:31.529 INFO:teuthology.orchestra.run.smithi130.stdout: [CC] unicrash.o 2023-07-19T20:49:31.712 INFO:teuthology.orchestra.run.smithi130.stdout: [LD] xfs_scrub 2023-07-19T20:49:32.032 INFO:teuthology.orchestra.run.smithi130.stdout: [SED] xfs_scrub_all 2023-07-19T20:49:32.045 INFO:teuthology.orchestra.run.smithi130.stdout: [SED] xfs_scrub@.service 2023-07-19T20:49:32.048 INFO:teuthology.orchestra.run.smithi130.stdout: [SED] xfs_scrub_all.service 2023-07-19T20:49:32.056 INFO:teuthology.orchestra.run.smithi130.stdout: [SED] xfs_scrub_fail@.service 2023-07-19T20:49:32.063 INFO:teuthology.orchestra.run.smithi130.stdout: [SED] xfs_scrub_all.cron 2023-07-19T20:49:32.071 INFO:teuthology.orchestra.run.smithi130.stdout:Building po 2023-07-19T20:49:32.099 INFO:teuthology.orchestra.run.smithi130.stdout: [GETTXT] xfsprogs.pot 2023-07-19T20:49:32.312 INFO:teuthology.orchestra.run.smithi130.stdout: [MSGFMT] pl.mo 2023-07-19T20:49:32.363 INFO:teuthology.orchestra.run.smithi130.stderr:3104 translated messages. 2023-07-19T20:49:32.365 INFO:teuthology.orchestra.run.smithi130.stdout: [MSGFMT] de.mo 2023-07-19T20:49:32.400 INFO:teuthology.orchestra.run.smithi130.stderr:2345 translated messages. 2023-07-19T20:49:32.402 INFO:teuthology.orchestra.run.smithi130.stdout:gmake[2]: Nothing to be done for 'include'. 2023-07-19T20:49:32.406 DEBUG:teuthology.orchestra.run.smithi130:> (cd /tmp/tmp.ViZlSiF0Gpxfsprogs-dev && exec sudo make install) 2023-07-19T20:49:32.488 INFO:teuthology.orchestra.run.smithi130.stdout:Installing libfrog-install 2023-07-19T20:49:32.940 INFO:teuthology.orchestra.run.smithi130.stdout:Installing libxfs-install 2023-07-19T20:49:34.647 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-07-19T20:49:34.672 INFO:teuthology.orchestra.run.smithi130.stdout:Installing libxlog-install 2023-07-19T20:49:34.765 INFO:teuthology.orchestra.run.smithi130.stdout:Installing libxcmd-install 2023-07-19T20:49:34.901 INFO:teuthology.orchestra.run.smithi130.stdout:Installing libhandle-install 2023-07-19T20:49:34.980 INFO:teuthology.orchestra.run.smithi130.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib64; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib64; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib64 2023-07-19T20:49:35.076 INFO:teuthology.orchestra.run.smithi130.stdout:Installing copy-install 2023-07-19T20:49:35.129 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-19T20:49:35.153 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-07-19T20:49:35.220 INFO:teuthology.orchestra.run.smithi130.stdout:Installing db-install 2023-07-19T20:49:37.328 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-19T20:49:37.351 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-07-19T20:49:37.422 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-07-19T20:49:37.446 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-07-19T20:49:37.469 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-07-19T20:49:37.496 INFO:teuthology.orchestra.run.smithi130.stdout:Installing estimate-install 2023-07-19T20:49:37.548 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-19T20:49:37.570 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-07-19T20:49:37.628 INFO:teuthology.orchestra.run.smithi130.stdout:Installing fsck-install 2023-07-19T20:49:37.631 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-07-19T20:49:37.654 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-07-19T20:49:37.679 INFO:teuthology.orchestra.run.smithi130.stdout:Installing fsr-install 2023-07-19T20:49:37.732 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-19T20:49:37.755 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-07-19T20:49:37.814 INFO:teuthology.orchestra.run.smithi130.stdout:Installing growfs-install 2023-07-19T20:49:37.866 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-19T20:49:37.889 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-07-19T20:49:37.957 INFO:teuthology.orchestra.run.smithi130.stdout:Installing io-install 2023-07-19T20:49:39.384 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-19T20:49:39.410 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-07-19T20:49:39.465 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-07-19T20:49:39.521 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-07-19T20:49:39.579 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-07-19T20:49:39.634 INFO:teuthology.orchestra.run.smithi130.stdout:Installing logprint-install 2023-07-19T20:49:39.916 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-19T20:49:39.939 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-07-19T20:49:40.007 INFO:teuthology.orchestra.run.smithi130.stdout:Installing mkfs-install 2023-07-19T20:49:40.101 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-07-19T20:49:40.124 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-07-19T20:49:40.189 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-07-19T20:49:40.213 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf /usr/share/xfsprogs/mkfs 2023-07-19T20:49:40.275 INFO:teuthology.orchestra.run.smithi130.stdout:Installing quota-install 2023-07-19T20:49:40.650 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-19T20:49:40.675 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-07-19T20:49:40.734 INFO:teuthology.orchestra.run.smithi130.stdout:Installing mdrestore-install 2023-07-19T20:49:40.784 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-19T20:49:40.807 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-07-19T20:49:40.874 INFO:teuthology.orchestra.run.smithi130.stdout:Installing repair-install 2023-07-19T20:49:42.258 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-07-19T20:49:42.280 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-07-19T20:49:42.354 INFO:teuthology.orchestra.run.smithi130.stdout:Installing rtcp-install 2023-07-19T20:49:42.413 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-19T20:49:42.429 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-07-19T20:49:42.487 INFO:teuthology.orchestra.run.smithi130.stdout:Installing m4-install 2023-07-19T20:49:42.490 INFO:teuthology.orchestra.run.smithi130.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-19T20:49:42.494 INFO:teuthology.orchestra.run.smithi130.stdout:Installing man-install 2023-07-19T20:49:42.500 INFO:teuthology.orchestra.run.smithi130.stdout:gmake[2]: Nothing to be done for 'install'. 2023-07-19T20:49:42.506 INFO:teuthology.orchestra.run.smithi130.stdout:gmake[2]: Nothing to be done for 'install'. 2023-07-19T20:49:42.512 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-07-19T20:49:42.542 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-07-19T20:49:42.574 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-07-19T20:49:42.601 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-07-19T20:49:42.635 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-07-19T20:49:42.670 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-07-19T20:49:42.695 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-07-19T20:49:42.722 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-07-19T20:49:42.752 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-07-19T20:49:42.780 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-07-19T20:49:42.809 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-07-19T20:49:42.839 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-07-19T20:49:42.869 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-07-19T20:49:42.895 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-07-19T20:49:42.926 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-07-19T20:49:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-07-19T20:49:42.987 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-07-19T20:49:43.011 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-07-19T20:49:43.039 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-07-19T20:49:43.068 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-07-19T20:49:43.096 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-07-19T20:49:43.125 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-07-19T20:49:43.154 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-07-19T20:49:43.183 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-07-19T20:49:43.211 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-07-19T20:49:43.240 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-07-19T20:49:43.269 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-07-19T20:49:43.297 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-07-19T20:49:43.327 INFO:teuthology.orchestra.run.smithi130.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-07-19T20:49:43.353 INFO:teuthology.orchestra.run.smithi130.stdout:Installing doc-install 2023-07-19T20:49:43.356 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-07-19T20:49:43.380 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-07-19T20:49:43.412 INFO:teuthology.orchestra.run.smithi130.stdout:Installing debian-install 2023-07-19T20:49:43.417 INFO:teuthology.orchestra.run.smithi130.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-19T20:49:43.418 INFO:teuthology.orchestra.run.smithi130.stdout:Installing spaceman-install 2023-07-19T20:49:43.707 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-19T20:49:43.730 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-07-19T20:49:43.789 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-07-19T20:49:43.812 INFO:teuthology.orchestra.run.smithi130.stdout:Installing scrub-install 2023-07-19T20:49:44.553 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-19T20:49:44.576 INFO:teuthology.orchestra.run.smithi130.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-07-19T20:49:44.633 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-07-19T20:49:44.656 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/systemd/system 2023-07-19T20:49:44.679 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /usr/lib/systemd/system 2023-07-19T20:49:44.725 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-07-19T20:49:44.749 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib64/xfsprogs 2023-07-19T20:49:44.772 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-07-19T20:49:44.794 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib64/xfsprogs 2023-07-19T20:49:44.820 INFO:teuthology.orchestra.run.smithi130.stdout:Installing po-install 2023-07-19T20:49:44.934 INFO:teuthology.orchestra.run.smithi130.stdout:Installing include-install 2023-07-19T20:49:44.937 INFO:teuthology.orchestra.run.smithi130.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-07-19T20:49:44.961 INFO:teuthology.orchestra.run.smithi130.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-07-19T20:49:44.983 INFO:teuthology.orchestra.run.smithi130.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-07-19T20:49:45.010 INFO:tasks.cephfs.test_fscrypt:client is kernel mounted 2023-07-19T20:49:45.010 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-07-19T20:49:45.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.148+0000 7f34affb5700 1 Processor -- start 2023-07-19T20:49:45.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.148+0000 7f34affb5700 1 -- start start 2023-07-19T20:49:45.146 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.149+0000 7f34affb5700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34a80bacb0 0x7f34a80702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:49:45.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.149+0000 7f34affb5700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a80729d0 con 0x7f34a80b8da0 2023-07-19T20:49:45.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.149+0000 7f34affb5700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a80717c0 con 0x7f34a8071be0 2023-07-19T20:49:45.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.149+0000 7f34affb5700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a80715e0 con 0x7f34a80bacb0 2023-07-19T20:49:45.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.149+0000 7f34add51700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34a80bacb0 0x7f34a80702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:49:45.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.149+0000 7f34add51700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34a80bacb0 0x7f34a80702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39866/0 (socket says 172.21.15.117:39866) 2023-07-19T20:49:45.147 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.149+0000 7f34add51700 1 -- 172.21.15.117:0/2686410241 learned_addr learned my addr 172.21.15.117:0/2686410241 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:49:45.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.149+0000 7f34ae552700 1 --1- 172.21.15.117:0/2686410241 >> v1:172.21.15.117:6789/0 conn(0x7f34a80b8da0 0x7f34a80b91a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:57478/0 (socket says 172.21.15.117:57478) 2023-07-19T20:49:45.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.150+0000 7f34add51700 1 -- 172.21.15.117:0/2686410241 >> v1:172.21.15.124:6789/0 conn(0x7f34a8071be0 legacy=0x7f34a81446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:49:45.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.150+0000 7f34add51700 1 -- 172.21.15.117:0/2686410241 >> v1:172.21.15.117:6789/0 conn(0x7f34a80b8da0 legacy=0x7f34a80b91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:49:45.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.150+0000 7f34add51700 1 -- 172.21.15.117:0/2686410241 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a8072130 con 0x7f34a80bacb0 2023-07-19T20:49:45.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.150+0000 7f34acd4f700 1 -- 172.21.15.117:0/2686410241 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929336492 0 0) 0x7f34a80729d0 con 0x7f34a80b8da0 2023-07-19T20:49:45.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.150+0000 7f34add51700 1 --2- 172.21.15.117:0/2686410241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a80bacb0 0x7f34a80702f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f34980098f0 tx=0x7f3498009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab24321b7e1d4b30 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:49:45.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.150+0000 7f34acd4f700 1 -- 172.21.15.117:0/2686410241 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498004230 con 0x7f34a80bacb0 2023-07-19T20:49:45.148 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.150+0000 7f34acd4f700 1 -- 172.21.15.117:0/2686410241 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3498004390 con 0x7f34a80bacb0 2023-07-19T20:49:45.149 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.150+0000 7f34acd4f700 1 -- 172.21.15.117:0/2686410241 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34980036a0 con 0x7f34a80bacb0 2023-07-19T20:49:45.149 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.150+0000 7f34affb5700 1 -- 172.21.15.117:0/2686410241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a80bacb0 msgr2=0x7f34a80702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:49:45.150 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.150+0000 7f34affb5700 1 --2- 172.21.15.117:0/2686410241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a80bacb0 0x7f34a80702f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f34980098f0 tx=0x7f3498009c00 comp rx=0 tx=0).stop 2023-07-19T20:49:45.150 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.150+0000 7f34affb5700 1 -- 172.21.15.117:0/2686410241 shutdown_connections 2023-07-19T20:49:45.150 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.150+0000 7f34affb5700 1 --2- 172.21.15.117:0/2686410241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a80bacb0 0x7f34a80702f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.150 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.151+0000 7f34affb5700 1 -- 172.21.15.117:0/2686410241 >> 172.21.15.117:0/2686410241 conn(0x7f34a80be4b0 msgr2=0x7f34a80ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:49:45.150 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.151+0000 7f34affb5700 1 -- 172.21.15.117:0/2686410241 shutdown_connections 2023-07-19T20:49:45.150 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.151+0000 7f34affb5700 1 -- 172.21.15.117:0/2686410241 wait complete. 2023-07-19T20:49:45.150 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.152+0000 7f34affb5700 1 Processor -- start 2023-07-19T20:49:45.151 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.152+0000 7f34affb5700 1 -- start start 2023-07-19T20:49:45.152 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.152+0000 7f34affb5700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34a8071be0 0x7f34a80b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:49:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.152+0000 7f34affb5700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34a80b8da0 0x7f34a81d4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:49:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.152+0000 7f34affb5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a80bacb0 0x7f34a80b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:49:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.152+0000 7f34affb5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a81d4a40 con 0x7f34a80bacb0 2023-07-19T20:49:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.152+0000 7f34affb5700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80bcf50 con 0x7f34a80b8da0 2023-07-19T20:49:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.152+0000 7f34affb5700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80b6ce0 con 0x7f34a8071be0 2023-07-19T20:49:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.152+0000 7f34ae552700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a80bacb0 0x7f34a80b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:49:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.152+0000 7f34ae552700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a80bacb0 0x7f34a80b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39872/0 (socket says 172.21.15.117:39872) 2023-07-19T20:49:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.152+0000 7f34ae552700 1 -- 172.21.15.117:0/927768554 learned_addr learned my addr 172.21.15.117:0/927768554 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:49:45.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.152+0000 7f34add51700 1 --2- 172.21.15.117:0/927768554 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34a8071be0 0x7f34a80b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:49:45.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.152+0000 7f34ad550700 1 --2- 172.21.15.117:0/927768554 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34a80b8da0 0x7f34a81d4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:49:45.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.153+0000 7f34ae552700 1 -- 172.21.15.117:0/927768554 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34a8071be0 msgr2=0x7f34a80b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:49:45.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.153+0000 7f34ae552700 1 --2- 172.21.15.117:0/927768554 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34a8071be0 0x7f34a80b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.153+0000 7f34ae552700 1 -- 172.21.15.117:0/927768554 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34a80b8da0 msgr2=0x7f34a81d4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:49:45.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.153+0000 7f34ae552700 1 --2- 172.21.15.117:0/927768554 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34a80b8da0 0x7f34a81d4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.154 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.153+0000 7f34ae552700 1 -- 172.21.15.117:0/927768554 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3498009550 con 0x7f34a80bacb0 2023-07-19T20:49:45.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.153+0000 7f34ae552700 1 --2- 172.21.15.117:0/927768554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a80bacb0 0x7f34a80b67a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f34a000cca0 tx=0x7f34a000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:49:45.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.153+0000 7f349e7fc700 1 -- 172.21.15.117:0/927768554 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000ab70 con 0x7f34a80bacb0 2023-07-19T20:49:45.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.153+0000 7f349e7fc700 1 -- 172.21.15.117:0/927768554 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a000acd0 con 0x7f34a80bacb0 2023-07-19T20:49:45.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.153+0000 7f34affb5700 1 -- 172.21.15.117:0/927768554 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a80bd1f0 con 0x7f34a80bacb0 2023-07-19T20:49:45.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.153+0000 7f349e7fc700 1 -- 172.21.15.117:0/927768554 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0007310 con 0x7f34a80bacb0 2023-07-19T20:49:45.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.153+0000 7f34affb5700 1 -- 172.21.15.117:0/927768554 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a80b6250 con 0x7f34a80bacb0 2023-07-19T20:49:45.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.154+0000 7f34affb5700 1 -- 172.21.15.117:0/927768554 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a8067940 con 0x7f34a80bacb0 2023-07-19T20:49:45.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.154+0000 7f349e7fc700 1 -- 172.21.15.117:0/927768554 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f34a0007470 con 0x7f34a80bacb0 2023-07-19T20:49:45.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.155+0000 7f349e7fc700 1 --2- 172.21.15.117:0/927768554 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f348c06a660 0x7f348c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:49:45.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.155+0000 7f34add51700 1 --2- 172.21.15.117:0/927768554 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f348c06a660 0x7f348c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:49:45.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.155+0000 7f349e7fc700 1 -- 172.21.15.117:0/927768554 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f34a00885a0 con 0x7f34a80bacb0 2023-07-19T20:49:45.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.155+0000 7f34add51700 1 --2- 172.21.15.117:0/927768554 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f348c06a660 0x7f348c06cb10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3498009130 tx=0x7f3498008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:49:45.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.159+0000 7f349e7fc700 1 -- 172.21.15.117:0/927768554 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f34a0053a10 con 0x7f34a80bacb0 2023-07-19T20:49:45.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.423+0000 7f34affb5700 1 -- 172.21.15.117:0/927768554 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f34a80b4940 con 0x7f34a80bacb0 2023-07-19T20:49:45.420 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.423+0000 7f349e7fc700 1 -- 172.21.15.117:0/927768554 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7f34a0018510 con 0x7f34a80bacb0 2023-07-19T20:49:45.421 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-19T20:49:45.421 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"46db5732-4a4f-4d1e-835b-9507e9513c02","modified":"2023-07-19T20:43:45.824759Z","created":"2023-07-19T20:43:45.824759Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:3300","nonce":0},{"type":"v1","addr":"172.21.15.124:6789","nonce":0}]},"addr":"172.21.15.124:6789/0","public_addr":"172.21.15.124:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:3301","nonce":0},{"type":"v1","addr":"172.21.15.124:6790","nonce":0}]},"addr":"172.21.15.124:6790/0","public_addr":"172.21.15.124:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-07-19T20:49:45.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.425+0000 7f34affb5700 1 -- 172.21.15.117:0/927768554 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f348c06a660 msgr2=0x7f348c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:49:45.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.425+0000 7f34affb5700 1 --2- 172.21.15.117:0/927768554 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f348c06a660 0x7f348c06cb10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3498009130 tx=0x7f3498008030 comp rx=0 tx=0).stop 2023-07-19T20:49:45.423 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.425+0000 7f34affb5700 1 -- 172.21.15.117:0/927768554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a80bacb0 msgr2=0x7f34a80b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:49:45.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.425+0000 7f34affb5700 1 --2- 172.21.15.117:0/927768554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a80bacb0 0x7f34a80b67a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f34a000cca0 tx=0x7f34a000a060 comp rx=0 tx=0).stop 2023-07-19T20:49:45.424 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.425+0000 7f34affb5700 1 -- 172.21.15.117:0/927768554 shutdown_connections 2023-07-19T20:49:45.425 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.425+0000 7f34affb5700 1 --2- 172.21.15.117:0/927768554 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f348c06a660 0x7f348c06cb10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.425+0000 7f34affb5700 1 --2- 172.21.15.117:0/927768554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a80bacb0 0x7f34a80b67a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.425+0000 7f34affb5700 1 --2- 172.21.15.117:0/927768554 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34a8071be0 0x7f34a80b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.425+0000 7f34affb5700 1 --2- 172.21.15.117:0/927768554 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34a80b8da0 0x7f34a81d4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.425+0000 7f34affb5700 1 -- 172.21.15.117:0/927768554 >> 172.21.15.117:0/927768554 conn(0x7f34a80be4b0 msgr2=0x7f34a8144470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:49:45.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.425+0000 7f34affb5700 1 -- 172.21.15.117:0/927768554 shutdown_connections 2023-07-19T20:49:45.426 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.425+0000 7f34affb5700 1 -- 172.21.15.117:0/927768554 wait complete. 2023-07-19T20:49:45.426 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2023-07-19T20:49:45.435 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-07-19T20:49:45.533 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:49:45.535 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:49:45.541 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:49:45.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.563+0000 7f9e0695e700 1 Processor -- start 2023-07-19T20:49:45.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.563+0000 7f9e0695e700 1 -- start start 2023-07-19T20:49:45.562 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.564+0000 7f9e0695e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9e001447e0 0x7f9e000b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:49:45.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.564+0000 7f9e0695e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9e0006baf0 0x7f9e00070110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:49:45.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.564+0000 7f9e0695e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e000b9770 con 0x7f9e0006f560 2023-07-19T20:49:45.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.564+0000 7f9e0695e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e00070db0 con 0x7f9e001447e0 2023-07-19T20:49:45.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.564+0000 7f9e0695e700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0006b6a0 con 0x7f9e0006baf0 2023-07-19T20:49:45.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.564+0000 7f9e04efb700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9e0006f560 0x7f9e000b7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:57486/0 (socket says 172.21.15.117:57486) 2023-07-19T20:49:45.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.564+0000 7f9e04efb700 1 -- 172.21.15.117:0/3537644719 learned_addr learned my addr 172.21.15.117:0/3537644719 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-07-19T20:49:45.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.564+0000 7f9dff7fe700 1 --2- 172.21.15.117:0/3537644719 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9e0006baf0 0x7f9e00070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:49:45.563 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.564+0000 7f9dfffff700 1 --2- 172.21.15.117:0/3537644719 >> v2:172.21.15.124:3300/0 conn(0x7f9e001447e0 0x7f9e000b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:49:45.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.564+0000 7f9dfeffd700 1 -- 172.21.15.117:0/3537644719 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208356960 0 0) 0x7f9e000b9770 con 0x7f9e0006f560 2023-07-19T20:49:45.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.564+0000 7f9dfeffd700 1 -- 172.21.15.117:0/3537644719 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9de80046c0 con 0x7f9e0006f560 2023-07-19T20:49:45.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.565+0000 7f9dff7fe700 1 -- 172.21.15.117:0/3537644719 >> v2:172.21.15.124:3300/0 conn(0x7f9e001447e0 msgr2=0x7f9e000b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-19T20:49:45.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.565+0000 7f9dff7fe700 1 --2- 172.21.15.117:0/3537644719 >> v2:172.21.15.124:3300/0 conn(0x7f9e001447e0 0x7f9e000b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.565+0000 7f9dff7fe700 1 -- 172.21.15.117:0/3537644719 >> v1:172.21.15.117:6789/0 conn(0x7f9e0006f560 legacy=0x7f9e000b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:49:45.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.565+0000 7f9dff7fe700 1 -- 172.21.15.117:0/3537644719 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e000b8a70 con 0x7f9e0006baf0 2023-07-19T20:49:45.564 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.565+0000 7f9dfffff700 1 --2- 172.21.15.117:0/3537644719 >> v2:172.21.15.124:3300/0 conn(0x7f9e001447e0 0x7f9e000b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-19T20:49:45.565 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.565+0000 7f9dff7fe700 1 --2- 172.21.15.117:0/3537644719 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9e0006baf0 0x7f9e00070110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009840 tx=0x7f9df4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe62463fd25ee592 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:49:45.565 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.565+0000 7f9dfeffd700 1 -- 172.21.15.117:0/3537644719 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4011830 con 0x7f9e0006baf0 2023-07-19T20:49:45.565 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.565+0000 7f9dfeffd700 1 -- 172.21.15.117:0/3537644719 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df4011990 con 0x7f9e0006baf0 2023-07-19T20:49:45.565 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.565+0000 7f9dfeffd700 1 -- 172.21.15.117:0/3537644719 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4011d20 con 0x7f9e0006baf0 2023-07-19T20:49:45.565 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.566+0000 7f9e0695e700 1 -- 172.21.15.117:0/3537644719 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9e0006baf0 msgr2=0x7f9e00070110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:49:45.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.566+0000 7f9e0695e700 1 --2- 172.21.15.117:0/3537644719 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9e0006baf0 0x7f9e00070110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009840 tx=0x7f9df4009b50 comp rx=0 tx=0).stop 2023-07-19T20:49:45.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.566+0000 7f9e0695e700 1 -- 172.21.15.117:0/3537644719 shutdown_connections 2023-07-19T20:49:45.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.566+0000 7f9e0695e700 1 --2- 172.21.15.117:0/3537644719 >> v2:172.21.15.124:3300/0 conn(0x7f9e001447e0 0x7f9e000b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.566+0000 7f9e0695e700 1 --2- 172.21.15.117:0/3537644719 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9e0006baf0 0x7f9e00070110 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.566+0000 7f9e0695e700 1 -- 172.21.15.117:0/3537644719 >> 172.21.15.117:0/3537644719 conn(0x7f9e000bdc00 msgr2=0x7f9e000b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:49:45.570 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.566+0000 7f9e0695e700 1 -- 172.21.15.117:0/3537644719 shutdown_connections 2023-07-19T20:49:45.571 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.566+0000 7f9e0695e700 1 -- 172.21.15.117:0/3537644719 wait complete. 2023-07-19T20:49:45.571 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.568+0000 7f9e0695e700 1 Processor -- start 2023-07-19T20:49:45.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.568+0000 7f9e0695e700 1 -- start start 2023-07-19T20:49:45.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.568+0000 7f9e0695e700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9e0006baf0 0x7f9e000b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:49:45.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.568+0000 7f9e0695e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9e0006f560 0x7f9e001d52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:49:45.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.568+0000 7f9e0695e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e001447e0 0x7f9e000b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:49:45.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.568+0000 7f9e0695e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e001d5810 con 0x7f9e001447e0 2023-07-19T20:49:45.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.568+0000 7f9e0695e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e00147970 con 0x7f9e0006f560 2023-07-19T20:49:45.572 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.568+0000 7f9e0695e700 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e00148180 con 0x7f9e0006baf0 2023-07-19T20:49:45.573 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9e04efb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e001447e0 0x7f9e000b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:49:45.573 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9e04efb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e001447e0 0x7f9e000b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39886/0 (socket says 172.21.15.117:39886) 2023-07-19T20:49:45.573 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9e04efb700 1 -- 172.21.15.117:0/2433267074 learned_addr learned my addr 172.21.15.117:0/2433267074 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-07-19T20:49:45.573 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9dfffff700 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9e0006baf0 0x7f9e000b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:49:45.573 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9dff7fe700 1 --2- 172.21.15.117:0/2433267074 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9e0006f560 0x7f9e001d52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:49:45.573 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9e04efb700 1 -- 172.21.15.117:0/2433267074 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9e0006baf0 msgr2=0x7f9e000b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:49:45.573 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9e04efb700 1 --2- 172.21.15.117:0/2433267074 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9e0006baf0 0x7f9e000b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.574 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9e04efb700 1 -- 172.21.15.117:0/2433267074 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9e0006f560 msgr2=0x7f9e001d52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:49:45.574 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9e04efb700 1 --2- 172.21.15.117:0/2433267074 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9e0006f560 0x7f9e001d52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.574 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9e04efb700 1 -- 172.21.15.117:0/2433267074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df00094a0 con 0x7f9e001447e0 2023-07-19T20:49:45.574 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9e04efb700 1 --2- 172.21.15.117:0/2433267074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e001447e0 0x7f9e000b49c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9df800cb40 tx=0x7f9df800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:49:45.574 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9dfcff9700 1 -- 172.21.15.117:0/2433267074 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df800a9e0 con 0x7f9e001447e0 2023-07-19T20:49:45.574 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9dfcff9700 1 -- 172.21.15.117:0/2433267074 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df800ab40 con 0x7f9e001447e0 2023-07-19T20:49:45.574 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9e0695e700 1 -- 172.21.15.117:0/2433267074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df40094a0 con 0x7f9e001447e0 2023-07-19T20:49:45.574 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9dfcff9700 1 -- 172.21.15.117:0/2433267074 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df8012400 con 0x7f9e001447e0 2023-07-19T20:49:45.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.569+0000 7f9e0695e700 1 -- 172.21.15.117:0/2433267074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e000b6240 con 0x7f9e001447e0 2023-07-19T20:49:45.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.570+0000 7f9e0695e700 1 -- 172.21.15.117:0/2433267074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e00067940 con 0x7f9e001447e0 2023-07-19T20:49:45.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.571+0000 7f9dfcff9700 1 -- 172.21.15.117:0/2433267074 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88201+0+0 (secure 0 0 0) 0x7f9df801b3b0 con 0x7f9e001447e0 2023-07-19T20:49:45.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.571+0000 7f9dfcff9700 1 --2- 172.21.15.117:0/2433267074 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f9dec06a660 0x7f9dec06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-19T20:49:45.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.571+0000 7f9dfcff9700 1 -- 172.21.15.117:0/2433267074 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f9df8088620 con 0x7f9e001447e0 2023-07-19T20:49:45.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.571+0000 7f9dfffff700 1 --2- 172.21.15.117:0/2433267074 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f9dec06a660 0x7f9dec06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-19T20:49:45.575 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.572+0000 7f9dfffff700 1 --2- 172.21.15.117:0/2433267074 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f9dec06a660 0x7f9dec06cb10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009cd0 tx=0x7f9df0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-19T20:49:45.576 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.575+0000 7f9dfcff9700 1 -- 172.21.15.117:0/2433267074 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9df804c2c0 con 0x7f9e001447e0 2023-07-19T20:49:45.841 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.844+0000 7f9e0695e700 1 -- 172.21.15.117:0/2433267074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f9e000b46e0 con 0x7f9e001447e0 2023-07-19T20:49:45.842 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.844+0000 7f9dfcff9700 1 -- 172.21.15.117:0/2433267074 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7f9e000b46e0 con 0x7f9e001447e0 2023-07-19T20:49:45.842 INFO:teuthology.orchestra.run.smithi117.stdout:[client.admin] 2023-07-19T20:49:45.842 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQACS7hkwU4VBhAAiPG9OjvC296T9MaER6pAOw== 2023-07-19T20:49:45.844 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.847+0000 7f9e0695e700 1 -- 172.21.15.117:0/2433267074 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f9dec06a660 msgr2=0x7f9dec06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:49:45.844 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.847+0000 7f9e0695e700 1 --2- 172.21.15.117:0/2433267074 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f9dec06a660 0x7f9dec06cb10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009cd0 tx=0x7f9df0009210 comp rx=0 tx=0).stop 2023-07-19T20:49:45.844 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.847+0000 7f9e0695e700 1 -- 172.21.15.117:0/2433267074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e001447e0 msgr2=0x7f9e000b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-19T20:49:45.844 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.847+0000 7f9e0695e700 1 --2- 172.21.15.117:0/2433267074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e001447e0 0x7f9e000b49c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9df800cb40 tx=0x7f9df800ce50 comp rx=0 tx=0).stop 2023-07-19T20:49:45.845 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.847+0000 7f9e0695e700 1 -- 172.21.15.117:0/2433267074 shutdown_connections 2023-07-19T20:49:45.845 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.847+0000 7f9e0695e700 1 --2- 172.21.15.117:0/2433267074 >> [v2:172.21.15.117:6832/146126,v1:172.21.15.117:6833/146126] conn(0x7f9dec06a660 0x7f9dec06cb10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.846 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.847+0000 7f9e0695e700 1 --2- 172.21.15.117:0/2433267074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e001447e0 0x7f9e000b49c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.846 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.847+0000 7f9e0695e700 1 --2- 172.21.15.117:0/2433267074 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9e0006baf0 0x7f9e000b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.846 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.847+0000 7f9e0695e700 1 --2- 172.21.15.117:0/2433267074 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9e0006f560 0x7f9e001d52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-19T20:49:45.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.847+0000 7f9e0695e700 1 -- 172.21.15.117:0/2433267074 >> 172.21.15.117:0/2433267074 conn(0x7f9e000bdc00 msgr2=0x7f9e00142750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-19T20:49:45.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.847+0000 7f9e0695e700 1 -- 172.21.15.117:0/2433267074 shutdown_connections 2023-07-19T20:49:45.847 INFO:teuthology.orchestra.run.smithi117.stderr:2023-07-19T20:49:45.847+0000 7f9e0695e700 1 -- 172.21.15.117:0/2433267074 wait complete. 2023-07-19T20:49:45.857 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-07-19T20:49:45.857 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/tmp/tmp.WX1oxq0LGuxfstests-dev/local.config 2023-07-19T20:49:45.928 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.117:6789:/test export TEST_DIR=/tmp/tmp.XYGNwUVwe6test export SCRATCH_DEV=172.21.15.117:6789:/scratch export SCRATCH_MNT=/tmp/tmp.moYJlVBlsTscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQACS7hkwU4VBhAAiPG9OjvC296T9MaER6pAOw==,test_dummy_encryption" 2023-07-19T20:49:45.929 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-07-19T20:49:45.929 DEBUG:teuthology.orchestra.run.smithi130:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.WX1oxq0LGuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-07-19T20:49:47.791 INFO:teuthology.orchestra.run.smithi130.stdout:FSTYP -- ceph 2023-07-19T20:49:47.803 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM -- Linux/x86_64 smithi130 6.5.0-rc1-ga440c79eee02 #1 SMP PREEMPT_DYNAMIC Thu Jul 13 12:15:30 UTC 2023 2023-07-19T20:49:47.804 INFO:teuthology.orchestra.run.smithi130.stdout:MKFS_OPTIONS -- 172.21.15.117:6789:/scratch 2023-07-19T20:49:47.807 INFO:teuthology.orchestra.run.smithi130.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQACS7hkwU4VBhAAiPG9OjvC296T9MaER6pAOw==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.117:6789:/scratch /tmp/tmp.moYJlVBlsTscratch 2023-07-19T20:49:47.808 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-19T20:49:48.018 INFO:teuthology.orchestra.run.smithi130.stdout:ceph/001 [expunged] 2023-07-19T20:49:48.395 INFO:teuthology.orchestra.run.smithi130.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-19T20:49:48.747 INFO:teuthology.orchestra.run.smithi130.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-19T20:49:49.194 INFO:teuthology.orchestra.run.smithi130.stdout:ceph/004 1s 2023-07-19T20:49:49.512 INFO:teuthology.orchestra.run.smithi130.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-19T20:49:57.037 INFO:teuthology.orchestra.run.smithi130.stdout:generic/001 8s 2023-07-19T20:49:57.683 INFO:teuthology.orchestra.run.smithi130.stdout:generic/002 0s 2023-07-19T20:49:57.695 INFO:teuthology.orchestra.run.smithi130.stdout:generic/003 [expunged] 2023-07-19T20:49:58.028 INFO:teuthology.orchestra.run.smithi130.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-07-19T20:49:58.624 INFO:teuthology.orchestra.run.smithi130.stdout:generic/005 0s 2023-07-19T20:50:15.651 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:50:15.653 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:50:15.655 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:50:23.423 INFO:teuthology.orchestra.run.smithi130.stdout:generic/006 25s 2023-07-19T20:50:45.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:50:45.779 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:50:45.782 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:51:13.900 INFO:teuthology.orchestra.run.smithi130.stdout:generic/007 50s 2023-07-19T20:51:15.968 INFO:teuthology.orchestra.run.smithi130.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-19T20:51:16.066 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:51:16.070 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:51:16.073 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:51:17.938 INFO:teuthology.orchestra.run.smithi130.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-19T20:51:46.189 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:51:46.202 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:51:46.205 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:51:48.238 INFO:teuthology.orchestra.run.smithi130.stdout:generic/011 31s 2023-07-19T20:51:50.191 INFO:teuthology.orchestra.run.smithi130.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T20:52:16.458 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:52:16.467 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:52:16.472 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:52:26.938 INFO:teuthology.orchestra.run.smithi130.stdout:generic/013 36s 2023-07-19T20:52:46.753 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:52:46.755 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:52:46.758 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:53:17.171 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:53:17.181 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:53:17.184 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:53:47.606 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:53:47.609 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:53:47.612 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:54:17.972 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:54:17.975 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:54:17.978 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:54:42.988 INFO:teuthology.orchestra.run.smithi130.stdout:generic/014 136s 2023-07-19T20:54:43.315 INFO:teuthology.orchestra.run.smithi130.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-19T20:54:48.084 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:54:48.086 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:54:48.088 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:54:48.147 INFO:tasks.ceph.mds.c.smithi117.stderr:2023-07-19T20:54:48.148+0000 7f0b65752700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 159804) UID: 0 2023-07-19T20:54:48.147 INFO:tasks.ceph.mds.a.smithi117.stderr:2023-07-19T20:54:48.148+0000 7f33d31a2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 159804) UID: 0 2023-07-19T20:54:48.364 INFO:teuthology.orchestra.run.smithi130.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T20:54:48.845 INFO:teuthology.orchestra.run.smithi130.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-07-19T20:54:48.884 INFO:teuthology.orchestra.run.smithi130.stdout:generic/020 [expunged] 2023-07-19T20:54:56.738 INFO:teuthology.orchestra.run.smithi130.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T20:55:01.451 INFO:teuthology.orchestra.run.smithi130.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T20:55:42.276 INFO:teuthology.orchestra.run.smithi130.stdout:generic/023 41s 2023-07-19T20:55:42.618 INFO:teuthology.orchestra.run.smithi130.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-07-19T20:55:42.966 INFO:teuthology.orchestra.run.smithi130.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-07-19T20:55:43.343 INFO:teuthology.orchestra.run.smithi130.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-07-19T20:55:48.698 INFO:teuthology.orchestra.run.smithi130.stdout:generic/028 5s 2023-07-19T20:55:49.838 INFO:teuthology.orchestra.run.smithi130.stdout:generic/029 1s 2023-07-19T20:55:57.498 INFO:teuthology.orchestra.run.smithi130.stdout:generic/030 8s 2023-07-19T20:56:03.839 INFO:teuthology.orchestra.run.smithi130.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-19T20:56:04.178 INFO:teuthology.orchestra.run.smithi130.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T20:56:07.994 INFO:teuthology.orchestra.run.smithi130.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-19T20:56:08.347 INFO:teuthology.orchestra.run.smithi130.stdout:generic/034 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:56:08.764 INFO:teuthology.orchestra.run.smithi130.stdout:generic/035 0s 2023-07-19T20:56:16.076 INFO:teuthology.orchestra.run.smithi130.stdout:generic/037 8s 2023-07-19T20:56:16.498 INFO:teuthology.orchestra.run.smithi130.stdout:generic/039 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:56:16.860 INFO:teuthology.orchestra.run.smithi130.stdout:generic/040 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:56:17.228 INFO:teuthology.orchestra.run.smithi130.stdout:generic/041 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:56:17.719 INFO:teuthology.orchestra.run.smithi130.stdout:generic/042 [not run] ceph does not support shutdown 2023-07-19T20:56:18.219 INFO:teuthology.orchestra.run.smithi130.stdout:generic/050 [not run] ceph does not support shutdown 2023-07-19T20:56:18.718 INFO:teuthology.orchestra.run.smithi130.stdout:generic/052 [not run] ceph does not support shutdown 2023-07-19T20:56:19.756 INFO:teuthology.orchestra.run.smithi130.stdout:generic/053 1s 2023-07-19T20:56:20.181 INFO:teuthology.orchestra.run.smithi130.stdout:generic/056 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:56:20.547 INFO:teuthology.orchestra.run.smithi130.stdout:generic/057 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:56:30.245 INFO:teuthology.orchestra.run.smithi130.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T20:56:30.602 INFO:teuthology.orchestra.run.smithi130.stdout:generic/059 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:56:35.461 INFO:teuthology.orchestra.run.smithi130.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T20:56:41.088 INFO:teuthology.orchestra.run.smithi130.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T20:56:43.335 INFO:teuthology.orchestra.run.smithi130.stdout:generic/062 2s 2023-07-19T20:56:49.312 INFO:teuthology.orchestra.run.smithi130.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T20:56:49.674 INFO:teuthology.orchestra.run.smithi130.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-19T20:56:50.036 INFO:teuthology.orchestra.run.smithi130.stdout:generic/065 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:56:50.391 INFO:teuthology.orchestra.run.smithi130.stdout:generic/066 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:56:50.791 INFO:teuthology.orchestra.run.smithi130.stdout:generic/067 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:57:11.007 INFO:teuthology.orchestra.run.smithi130.stdout:generic/069 20s 2023-07-19T20:57:20.839 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:57:20.842 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:57:20.844 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:57:23.962 INFO:teuthology.orchestra.run.smithi130.stdout:generic/070 12s 2023-07-19T20:57:24.310 INFO:teuthology.orchestra.run.smithi130.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-19T20:57:24.656 INFO:teuthology.orchestra.run.smithi130.stdout:generic/073 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:57:24.680 INFO:teuthology.orchestra.run.smithi130.stdout:generic/075 [expunged] 2023-07-19T20:57:24.998 INFO:teuthology.orchestra.run.smithi130.stdout:generic/076 [not run] require 172.21.15.117:6789:/scratch to be local device 2023-07-19T20:57:25.367 INFO:teuthology.orchestra.run.smithi130.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-07-19T20:57:25.695 INFO:teuthology.orchestra.run.smithi130.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-07-19T20:57:28.084 INFO:teuthology.orchestra.run.smithi130.stdout:generic/080 3s 2023-07-19T20:57:28.465 INFO:teuthology.orchestra.run.smithi130.stdout:generic/081 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:57:28.800 INFO:teuthology.orchestra.run.smithi130.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-19T20:57:35.164 INFO:teuthology.orchestra.run.smithi130.stdout:generic/084 7s 2023-07-19T20:57:35.618 INFO:teuthology.orchestra.run.smithi130.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T20:57:36.059 INFO:teuthology.orchestra.run.smithi130.stdout:generic/087 1s 2023-07-19T20:57:36.435 INFO:teuthology.orchestra.run.smithi130.stdout:generic/088 0s 2023-07-19T20:57:36.809 INFO:teuthology.orchestra.run.smithi130.stdout:generic/090 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:57:50.952 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:57:50.954 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:57:50.956 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:58:21.064 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:58:21.067 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:58:21.069 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:58:34.436 INFO:teuthology.orchestra.run.smithi130.stdout:generic/091 58s 2023-07-19T20:58:34.782 INFO:teuthology.orchestra.run.smithi130.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T20:58:35.168 INFO:teuthology.orchestra.run.smithi130.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-19T20:58:42.361 INFO:teuthology.orchestra.run.smithi130.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-19T20:58:43.041 INFO:teuthology.orchestra.run.smithi130.stdout:generic/097 1s 2023-07-19T20:58:44.103 INFO:teuthology.orchestra.run.smithi130.stdout:generic/098 1s 2023-07-19T20:58:45.439 INFO:teuthology.orchestra.run.smithi130.stdout:generic/099 1s 2023-07-19T20:58:45.783 INFO:teuthology.orchestra.run.smithi130.stdout:generic/101 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:58:46.131 INFO:teuthology.orchestra.run.smithi130.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T20:58:46.501 INFO:teuthology.orchestra.run.smithi130.stdout:generic/104 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:58:47.337 INFO:teuthology.orchestra.run.smithi130.stdout:generic/105 1s 2023-07-19T20:58:47.759 INFO:teuthology.orchestra.run.smithi130.stdout:generic/106 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:58:48.120 INFO:teuthology.orchestra.run.smithi130.stdout:generic/107 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:58:48.586 INFO:teuthology.orchestra.run.smithi130.stdout:generic/108 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T20:58:48.958 INFO:teuthology.orchestra.run.smithi130.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T20:58:49.325 INFO:teuthology.orchestra.run.smithi130.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T20:58:51.177 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:58:51.180 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:58:51.183 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:59:12.177 INFO:teuthology.orchestra.run.smithi130.stdout:generic/112 23s 2023-07-19T20:59:21.285 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:59:21.327 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:59:21.338 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:59:51.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:59:51.492 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T20:59:51.494 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:00:21.613 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:00:21.615 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:00:21.618 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:00:51.849 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:00:51.852 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:00:51.854 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:01:05.232 INFO:teuthology.orchestra.run.smithi130.stdout:generic/113 113s 2023-07-19T21:01:05.626 INFO:teuthology.orchestra.run.smithi130.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-07-19T21:01:05.994 INFO:teuthology.orchestra.run.smithi130.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:01:06.364 INFO:teuthology.orchestra.run.smithi130.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:01:12.838 INFO:teuthology.orchestra.run.smithi130.stdout:generic/117 6s 2023-07-19T21:01:13.281 INFO:teuthology.orchestra.run.smithi130.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:01:13.643 INFO:teuthology.orchestra.run.smithi130.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:01:13.973 INFO:teuthology.orchestra.run.smithi130.stdout:generic/120 [not run] atime not maintained by ceph 2023-07-19T21:01:14.347 INFO:teuthology.orchestra.run.smithi130.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-19T21:01:14.724 INFO:teuthology.orchestra.run.smithi130.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-19T21:01:15.483 INFO:teuthology.orchestra.run.smithi130.stdout:generic/123 1s 2023-07-19T21:01:21.962 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:01:21.976 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:01:22.058 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:01:50.883 INFO:teuthology.orchestra.run.smithi130.stdout:generic/124 35s 2023-07-19T21:01:51.491 INFO:teuthology.orchestra.run.smithi130.stdout:generic/126 1s 2023-07-19T21:01:52.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:01:52.446 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:01:52.448 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:01:53.498 INFO:teuthology.orchestra.run.smithi130.stdout:generic/128 2s 2023-07-19T21:02:22.696 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:02:22.700 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:02:22.702 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:02:52.915 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:02:52.917 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:02:52.934 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:03:23.686 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:03:23.690 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:03:23.695 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:03:53.880 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:03:53.886 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:03:53.931 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:04:24.034 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:04:24.050 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:04:24.066 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:04:54.216 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:04:54.219 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:04:54.221 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:05:24.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:05:24.543 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:05:24.545 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:05:54.697 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:05:54.722 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:05:54.730 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:06:25.138 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:06:25.141 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:06:25.143 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:06:55.264 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:06:55.274 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:06:55.304 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:07:25.419 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:07:25.422 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:07:25.425 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:07:55.561 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:07:55.565 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:07:55.579 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:08:25.757 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:08:25.759 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:08:25.763 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:08:55.872 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:08:55.875 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:08:55.885 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:09:26.296 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:09:26.299 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:09:26.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:09:56.447 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:09:56.449 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:09:56.452 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:10:26.569 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:10:26.576 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:10:26.581 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:10:56.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:10:56.963 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:10:56.988 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:11:27.103 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:11:27.120 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:11:27.162 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:11:57.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:11:57.269 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:11:57.272 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:12:27.408 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:12:27.416 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:12:27.455 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:12:57.602 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:12:57.613 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:12:57.619 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:13:28.087 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:13:28.115 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:13:28.127 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:13:58.339 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:13:58.375 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:13:58.392 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:14:28.580 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:14:28.601 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:14:28.604 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:14:58.826 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:14:58.829 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:14:58.900 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:15:29.315 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:15:29.320 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:15:29.325 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:15:59.636 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:15:59.652 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:15:59.677 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:16:29.800 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:16:29.819 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:16:29.849 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:17:00.005 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:17:00.027 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:17:00.063 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:17:30.201 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:17:30.205 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:17:30.235 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:18:00.501 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:18:00.504 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:18:00.506 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:18:30.987 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:18:30.990 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:18:30.995 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:19:01.361 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:19:01.391 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:19:01.408 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:19:31.521 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:19:31.534 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:19:31.541 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:20:01.684 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:20:01.693 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:20:01.700 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:20:31.977 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:20:31.996 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:20:32.034 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:21:02.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:21:02.194 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:21:02.214 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:21:32.440 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:21:32.442 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:21:32.444 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:22:02.615 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:22:02.618 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:22:02.624 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:22:33.094 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:22:33.099 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:22:33.122 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:23:03.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:23:03.300 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:23:03.306 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:23:33.523 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:23:33.526 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:23:33.528 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:24:03.773 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:24:03.788 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:24:03.796 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:24:33.962 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:24:33.964 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:24:33.966 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:24:39.408 INFO:teuthology.orchestra.run.smithi130.stdout:generic/129 1366s 2023-07-19T21:24:51.918 INFO:teuthology.orchestra.run.smithi130.stdout:generic/130 12s 2023-07-19T21:24:53.457 INFO:teuthology.orchestra.run.smithi130.stdout:generic/131 2s 2023-07-19T21:24:53.826 INFO:teuthology.orchestra.run.smithi130.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:24:55.466 INFO:teuthology.orchestra.run.smithi130.stdout:generic/135 2s 2023-07-19T21:24:55.923 INFO:teuthology.orchestra.run.smithi130.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-19T21:24:56.300 INFO:teuthology.orchestra.run.smithi130.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:24:56.670 INFO:teuthology.orchestra.run.smithi130.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:24:57.050 INFO:teuthology.orchestra.run.smithi130.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:24:59.191 INFO:teuthology.orchestra.run.smithi130.stdout:generic/141 2s 2023-07-19T21:24:59.641 INFO:teuthology.orchestra.run.smithi130.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:00.015 INFO:teuthology.orchestra.run.smithi130.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:00.381 INFO:teuthology.orchestra.run.smithi130.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:00.750 INFO:teuthology.orchestra.run.smithi130.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:01.120 INFO:teuthology.orchestra.run.smithi130.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:01.484 INFO:teuthology.orchestra.run.smithi130.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:01.854 INFO:teuthology.orchestra.run.smithi130.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:02.591 INFO:teuthology.orchestra.run.smithi130.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:02.967 INFO:teuthology.orchestra.run.smithi130.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:03.336 INFO:teuthology.orchestra.run.smithi130.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:03.703 INFO:teuthology.orchestra.run.smithi130.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:04.072 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:25:04.074 INFO:teuthology.orchestra.run.smithi130.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:04.074 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:25:04.077 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:25:04.448 INFO:teuthology.orchestra.run.smithi130.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:04.825 INFO:teuthology.orchestra.run.smithi130.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:05.197 INFO:teuthology.orchestra.run.smithi130.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:05.569 INFO:teuthology.orchestra.run.smithi130.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-19T21:25:05.902 INFO:teuthology.orchestra.run.smithi130.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-07-19T21:25:06.233 INFO:teuthology.orchestra.run.smithi130.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-07-19T21:25:06.863 INFO:teuthology.orchestra.run.smithi130.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:07.405 INFO:teuthology.orchestra.run.smithi130.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-19T21:25:08.092 INFO:teuthology.orchestra.run.smithi130.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-19T21:25:09.323 INFO:teuthology.orchestra.run.smithi130.stdout:generic/169 1s 2023-07-19T21:25:10.005 INFO:teuthology.orchestra.run.smithi130.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:10.647 INFO:teuthology.orchestra.run.smithi130.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:11.273 INFO:teuthology.orchestra.run.smithi130.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:11.915 INFO:teuthology.orchestra.run.smithi130.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:18.104 INFO:teuthology.orchestra.run.smithi130.stdout:generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T21:25:18.479 INFO:teuthology.orchestra.run.smithi130.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:18.849 INFO:teuthology.orchestra.run.smithi130.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:19.221 INFO:teuthology.orchestra.run.smithi130.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:19.586 INFO:teuthology.orchestra.run.smithi130.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:25:19.962 INFO:teuthology.orchestra.run.smithi130.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-19T21:25:20.621 INFO:teuthology.orchestra.run.smithi130.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:21.011 INFO:teuthology.orchestra.run.smithi130.stdout:generic/184 0s 2023-07-19T21:25:21.606 INFO:teuthology.orchestra.run.smithi130.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:22.257 INFO:teuthology.orchestra.run.smithi130.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:22.898 INFO:teuthology.orchestra.run.smithi130.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:23.592 INFO:teuthology.orchestra.run.smithi130.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:24.229 INFO:teuthology.orchestra.run.smithi130.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:25.653 INFO:teuthology.orchestra.run.smithi130.stdout:generic/193 1s 2023-07-19T21:25:26.304 INFO:teuthology.orchestra.run.smithi130.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:26.958 INFO:teuthology.orchestra.run.smithi130.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:27.606 INFO:teuthology.orchestra.run.smithi130.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:28.257 INFO:teuthology.orchestra.run.smithi130.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:34.230 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:25:34.245 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:25:34.253 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:25:56.698 INFO:teuthology.orchestra.run.smithi130.stdout:generic/198 28s 2023-07-19T21:25:57.325 INFO:teuthology.orchestra.run.smithi130.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:57.953 INFO:teuthology.orchestra.run.smithi130.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:58.580 INFO:teuthology.orchestra.run.smithi130.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:59.223 INFO:teuthology.orchestra.run.smithi130.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:25:59.842 INFO:teuthology.orchestra.run.smithi130.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:26:00.477 INFO:teuthology.orchestra.run.smithi130.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:26:01.128 INFO:teuthology.orchestra.run.smithi130.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:26:04.678 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:26:04.682 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:26:04.685 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:26:18.083 INFO:teuthology.orchestra.run.smithi130.stdout:generic/207 17s 2023-07-19T21:26:18.528 INFO:teuthology.orchestra.run.smithi130.stdout:generic/210 0s 2023-07-19T21:26:19.568 INFO:teuthology.orchestra.run.smithi130.stdout:generic/211 1s 2023-07-19T21:26:19.986 INFO:teuthology.orchestra.run.smithi130.stdout:generic/212 0s 2023-07-19T21:26:20.339 INFO:teuthology.orchestra.run.smithi130.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T21:26:20.696 INFO:teuthology.orchestra.run.smithi130.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T21:26:23.104 INFO:teuthology.orchestra.run.smithi130.stdout:generic/215 3s 2023-07-19T21:26:23.736 INFO:teuthology.orchestra.run.smithi130.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:26:24.428 INFO:teuthology.orchestra.run.smithi130.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:26:25.088 INFO:teuthology.orchestra.run.smithi130.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:26:25.417 INFO:teuthology.orchestra.run.smithi130.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-19T21:26:26.080 INFO:teuthology.orchestra.run.smithi130.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:26:27.446 INFO:teuthology.orchestra.run.smithi130.stdout:generic/221 1s 2023-07-19T21:26:28.070 INFO:teuthology.orchestra.run.smithi130.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:26:28.425 INFO:teuthology.orchestra.run.smithi130.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T21:26:28.820 INFO:teuthology.orchestra.run.smithi130.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-19T21:26:29.437 INFO:teuthology.orchestra.run.smithi130.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:26:29.821 INFO:teuthology.orchestra.run.smithi130.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T21:26:30.442 INFO:teuthology.orchestra.run.smithi130.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:26:30.791 INFO:teuthology.orchestra.run.smithi130.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-19T21:26:31.117 INFO:teuthology.orchestra.run.smithi130.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-19T21:26:32.582 INFO:teuthology.orchestra.run.smithi130.stdout:generic/236 1s 2023-07-19T21:26:33.016 INFO:teuthology.orchestra.run.smithi130.stdout:generic/237 1s 2023-07-19T21:26:33.651 INFO:teuthology.orchestra.run.smithi130.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:26:34.803 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:26:34.844 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:26:34.846 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:26:46.589 INFO:teuthology.orchestra.run.smithi130.stdout:generic/240 13s 2023-07-19T21:26:46.904 INFO:teuthology.orchestra.run.smithi130.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-19T21:26:47.321 INFO:teuthology.orchestra.run.smithi130.stdout:generic/245 1s 2023-07-19T21:26:47.677 INFO:teuthology.orchestra.run.smithi130.stdout:generic/246 0s 2023-07-19T21:27:05.075 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:27:05.078 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:27:05.118 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:27:36.029 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:27:36.047 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:27:36.062 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:28:06.385 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:28:06.388 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:28:06.446 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:28:36.823 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:28:36.826 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:28:36.828 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:28:36.874 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-07-19T21:28:36.871+0000 7fc2edf52700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 161689) UID: 0 2023-07-19T21:28:36.875 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-07-19T21:28:36.871+0000 7fe82fa8c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 161689) UID: 0 2023-07-19T21:28:36.875 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-07-19T21:28:36.871+0000 7f3ad3144700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 161689) UID: 0 2023-07-19T21:28:36.876 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-07-19T21:28:36.871+0000 7fc9d96c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 161689) UID: 0 2023-07-19T21:31:22.006 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:31:22.008 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:31:22.011 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:31:22.699 INFO:tasks.ceph.osd.6.smithi124.stderr:2023-07-19T21:31:22.695+0000 7f633211f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154878) UID: 0 2023-07-19T21:31:22.699 INFO:tasks.ceph.osd.7.smithi124.stderr:2023-07-19T21:31:22.695+0000 7f13010b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154878) UID: 0 2023-07-19T21:31:22.700 INFO:tasks.ceph.osd.5.smithi124.stderr:2023-07-19T21:31:22.695+0000 7f67d31c2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154878) UID: 0 2023-07-19T21:31:22.701 INFO:tasks.ceph.osd.4.smithi124.stderr:2023-07-19T21:31:22.698+0000 7f684ce03700 -1 Fail to open '/proc/154878/cmdline' error = (2) No such file or directory 2023-07-19T21:31:22.701 INFO:tasks.ceph.osd.4.smithi124.stderr:2023-07-19T21:31:22.698+0000 7f684ce03700 -1 received signal: Hangup from (PID: 154878) UID: 0 2023-07-19T21:31:44.961 INFO:teuthology.orchestra.run.smithi130.stdout:generic/247 297s 2023-07-19T21:31:45.409 INFO:teuthology.orchestra.run.smithi130.stdout:generic/248 1s 2023-07-19T21:32:15.975 INFO:teuthology.orchestra.run.smithi130.stdout:generic/249 30s 2023-07-19T21:32:16.322 INFO:teuthology.orchestra.run.smithi130.stdout:generic/250 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:32:16.671 INFO:teuthology.orchestra.run.smithi130.stdout:generic/252 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:32:17.315 INFO:teuthology.orchestra.run.smithi130.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:32:17.932 INFO:teuthology.orchestra.run.smithi130.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:32:27.098 INFO:teuthology.orchestra.run.smithi130.stdout:generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T21:32:39.256 INFO:teuthology.orchestra.run.smithi130.stdout:generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T21:32:40.318 INFO:teuthology.orchestra.run.smithi130.stdout:generic/257 1s 2023-07-19T21:32:40.633 INFO:teuthology.orchestra.run.smithi130.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-07-19T21:32:41.381 INFO:teuthology.orchestra.run.smithi130.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:32:41.867 INFO:teuthology.orchestra.run.smithi130.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.moYJlVBlsTscratch 2023-07-19T21:32:42.500 INFO:teuthology.orchestra.run.smithi130.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:32:43.114 INFO:teuthology.orchestra.run.smithi130.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:33:56.599 INFO:teuthology.orchestra.run.smithi130.stdout:generic/263 73s 2023-07-19T21:33:57.237 INFO:teuthology.orchestra.run.smithi130.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:33:57.937 INFO:teuthology.orchestra.run.smithi130.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:33:58.601 INFO:teuthology.orchestra.run.smithi130.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:33:59.278 INFO:teuthology.orchestra.run.smithi130.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:33:59.924 INFO:teuthology.orchestra.run.smithi130.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:00.596 INFO:teuthology.orchestra.run.smithi130.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:01.239 INFO:teuthology.orchestra.run.smithi130.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:01.925 INFO:teuthology.orchestra.run.smithi130.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:02.267 INFO:teuthology.orchestra.run.smithi130.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-07-19T21:34:02.892 INFO:teuthology.orchestra.run.smithi130.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:03.601 INFO:teuthology.orchestra.run.smithi130.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:04.238 INFO:teuthology.orchestra.run.smithi130.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:04.906 INFO:teuthology.orchestra.run.smithi130.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:05.590 INFO:teuthology.orchestra.run.smithi130.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:06.204 INFO:teuthology.orchestra.run.smithi130.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:06.564 INFO:teuthology.orchestra.run.smithi130.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T21:34:07.220 INFO:teuthology.orchestra.run.smithi130.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:07.733 INFO:teuthology.orchestra.run.smithi130.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.moYJlVBlsTscratch 2023-07-19T21:34:08.394 INFO:teuthology.orchestra.run.smithi130.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:09.058 INFO:teuthology.orchestra.run.smithi130.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:09.708 INFO:teuthology.orchestra.run.smithi130.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:10.335 INFO:teuthology.orchestra.run.smithi130.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:10.989 INFO:teuthology.orchestra.run.smithi130.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:11.852 INFO:teuthology.orchestra.run.smithi130.stdout:generic/294 0s 2023-07-19T21:34:12.564 INFO:teuthology.orchestra.run.smithi130.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:13.204 INFO:teuthology.orchestra.run.smithi130.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:13.834 INFO:teuthology.orchestra.run.smithi130.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:14.478 INFO:teuthology.orchestra.run.smithi130.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:14.906 INFO:teuthology.orchestra.run.smithi130.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:34:15.282 INFO:teuthology.orchestra.run.smithi130.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-19T21:34:15.918 INFO:teuthology.orchestra.run.smithi130.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:16.660 INFO:teuthology.orchestra.run.smithi130.stdout:generic/306 1s 2023-07-19T21:34:18.849 INFO:teuthology.orchestra.run.smithi130.stdout:generic/307 2s 2023-07-19T21:34:19.289 INFO:teuthology.orchestra.run.smithi130.stdout:generic/308 1s 2023-07-19T21:34:20.692 INFO:teuthology.orchestra.run.smithi130.stdout:generic/309 1s 2023-07-19T21:34:21.020 INFO:teuthology.orchestra.run.smithi130.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T21:34:25.417 INFO:teuthology.orchestra.run.smithi130.stdout:generic/313 4s 2023-07-19T21:34:26.059 INFO:teuthology.orchestra.run.smithi130.stdout:generic/314 1s 2023-07-19T21:34:26.398 INFO:teuthology.orchestra.run.smithi130.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-19T21:34:35.319 INFO:teuthology.orchestra.run.smithi130.stdout:generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T21:34:35.346 INFO:teuthology.orchestra.run.smithi130.stdout:generic/317 [expunged] 2023-07-19T21:34:36.231 INFO:teuthology.orchestra.run.smithi130.stdout:generic/318 1s 2023-07-19T21:34:36.910 INFO:teuthology.orchestra.run.smithi130.stdout:generic/319 0s 2023-07-19T21:34:37.327 INFO:teuthology.orchestra.run.smithi130.stdout:generic/321 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:34:37.673 INFO:teuthology.orchestra.run.smithi130.stdout:generic/322 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:34:37.996 INFO:teuthology.orchestra.run.smithi130.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-07-19T21:34:38.346 INFO:teuthology.orchestra.run.smithi130.stdout:generic/325 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:34:38.991 INFO:teuthology.orchestra.run.smithi130.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:39.653 INFO:teuthology.orchestra.run.smithi130.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:40.278 INFO:teuthology.orchestra.run.smithi130.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:40.935 INFO:teuthology.orchestra.run.smithi130.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:41.549 INFO:teuthology.orchestra.run.smithi130.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:42.196 INFO:teuthology.orchestra.run.smithi130.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:42.837 INFO:teuthology.orchestra.run.smithi130.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:34:43.205 INFO:teuthology.orchestra.run.smithi130.stdout:generic/335 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:34:43.574 INFO:teuthology.orchestra.run.smithi130.stdout:generic/336 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:34:44.473 INFO:teuthology.orchestra.run.smithi130.stdout:generic/337 1s 2023-07-19T21:34:44.896 INFO:teuthology.orchestra.run.smithi130.stdout:generic/338 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:34:45.249 INFO:teuthology.orchestra.run.smithi130.stdout:generic/341 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:34:45.596 INFO:teuthology.orchestra.run.smithi130.stdout:generic/342 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:34:45.963 INFO:teuthology.orchestra.run.smithi130.stdout:generic/343 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:36:03.760 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:36:03.789 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:36:03.795 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:36:34.128 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:36:34.132 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:36:34.138 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:37:04.357 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:37:04.359 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:37:04.375 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:37:34.547 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:37:34.549 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:37:34.552 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:38:05.072 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:38:05.074 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:38:05.120 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:38:05.306 INFO:tasks.ceph.osd.4.smithi124.stderr:2023-07-19T21:38:05.301+0000 7f684ce03700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155069) UID: 0 2023-07-19T21:38:05.306 INFO:tasks.ceph.osd.7.smithi124.stderr:2023-07-19T21:38:05.301+0000 7f13010b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155069) UID: 0 2023-07-19T21:38:05.308 INFO:tasks.ceph.osd.5.smithi124.stderr:2023-07-19T21:38:05.304+0000 7f67d31c2700 -1 Fail to open '/proc/155069/cmdline' error = (2) No such file or directory 2023-07-19T21:38:05.308 INFO:tasks.ceph.osd.5.smithi124.stderr:2023-07-19T21:38:05.304+0000 7f67d31c2700 -1 received signal: Hangup from (PID: 155069) UID: 0 2023-07-19T21:38:05.309 INFO:tasks.ceph.osd.6.smithi124.stderr:2023-07-19T21:38:05.301+0000 7f633211f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155069) UID: 0 2023-07-19T21:38:48.096 INFO:teuthology.orchestra.run.smithi130.stdout:generic/346 243s 2023-07-19T21:38:48.599 INFO:teuthology.orchestra.run.smithi130.stdout:generic/347 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:38:48.967 INFO:teuthology.orchestra.run.smithi130.stdout:generic/348 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:38:49.589 INFO:teuthology.orchestra.run.smithi130.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:38:50.441 INFO:teuthology.orchestra.run.smithi130.stdout:generic/355 1s 2023-07-19T21:38:51.042 INFO:teuthology.orchestra.run.smithi130.stdout:generic/356 [not run] swapfiles are not supported 2023-07-19T21:38:51.632 INFO:teuthology.orchestra.run.smithi130.stdout:generic/357 [not run] swapfiles are not supported 2023-07-19T21:38:52.269 INFO:teuthology.orchestra.run.smithi130.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:38:52.919 INFO:teuthology.orchestra.run.smithi130.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:38:53.325 INFO:teuthology.orchestra.run.smithi130.stdout:generic/360 1s 2023-07-19T21:38:53.648 INFO:teuthology.orchestra.run.smithi130.stdout:generic/361 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:38:53.971 INFO:teuthology.orchestra.run.smithi130.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-19T21:38:54.291 INFO:teuthology.orchestra.run.smithi130.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-19T21:38:54.609 INFO:teuthology.orchestra.run.smithi130.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-19T21:38:54.925 INFO:teuthology.orchestra.run.smithi130.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-19T21:38:55.245 INFO:teuthology.orchestra.run.smithi130.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-19T21:38:55.564 INFO:teuthology.orchestra.run.smithi130.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-19T21:38:55.879 INFO:teuthology.orchestra.run.smithi130.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-19T21:38:56.198 INFO:teuthology.orchestra.run.smithi130.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-19T21:38:56.519 INFO:teuthology.orchestra.run.smithi130.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-19T21:38:56.856 INFO:teuthology.orchestra.run.smithi130.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T21:38:57.517 INFO:teuthology.orchestra.run.smithi130.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:38:58.131 INFO:teuthology.orchestra.run.smithi130.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:38:58.696 INFO:teuthology.orchestra.run.smithi130.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-19T21:38:59.286 INFO:teuthology.orchestra.run.smithi130.stdout:generic/375 1s 2023-07-19T21:38:59.630 INFO:teuthology.orchestra.run.smithi130.stdout:generic/376 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:39:00.559 INFO:teuthology.orchestra.run.smithi130.stdout:generic/377 1s 2023-07-19T21:39:01.296 INFO:teuthology.orchestra.run.smithi130.stdout:generic/378 1s 2023-07-19T21:39:01.623 INFO:teuthology.orchestra.run.smithi130.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-19T21:39:01.948 INFO:teuthology.orchestra.run.smithi130.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-19T21:39:02.268 INFO:teuthology.orchestra.run.smithi130.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-19T21:39:02.593 INFO:teuthology.orchestra.run.smithi130.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-19T21:39:02.918 INFO:teuthology.orchestra.run.smithi130.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-19T21:39:03.254 INFO:teuthology.orchestra.run.smithi130.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-19T21:39:03.579 INFO:teuthology.orchestra.run.smithi130.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-19T21:39:03.890 INFO:teuthology.orchestra.run.smithi130.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-19T21:39:04.233 INFO:teuthology.orchestra.run.smithi130.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-07-19T21:39:04.576 INFO:teuthology.orchestra.run.smithi130.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T21:39:05.072 INFO:teuthology.orchestra.run.smithi130.stdout:generic/392 [not run] ceph does not support shutdown 2023-07-19T21:39:06.498 INFO:teuthology.orchestra.run.smithi130.stdout:generic/393 1s 2023-07-19T21:39:06.949 INFO:teuthology.orchestra.run.smithi130.stdout:generic/394 0s 2023-07-19T21:39:07.366 INFO:teuthology.orchestra.run.smithi130.stdout:generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-19T21:39:07.788 INFO:teuthology.orchestra.run.smithi130.stdout:generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-19T21:39:08.228 INFO:teuthology.orchestra.run.smithi130.stdout:generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-19T21:39:08.659 INFO:teuthology.orchestra.run.smithi130.stdout:generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-19T21:39:08.970 INFO:teuthology.orchestra.run.smithi130.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-19T21:39:09.932 INFO:teuthology.orchestra.run.smithi130.stdout:generic/401 1s 2023-07-19T21:39:10.623 INFO:teuthology.orchestra.run.smithi130.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-07-19T21:39:12.198 INFO:teuthology.orchestra.run.smithi130.stdout:generic/403 2s 2023-07-19T21:39:12.605 INFO:teuthology.orchestra.run.smithi130.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T21:39:14.967 INFO:teuthology.orchestra.run.smithi130.stdout:generic/406 2s 2023-07-19T21:39:15.459 INFO:teuthology.orchestra.run.smithi130.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:39:15.847 INFO:teuthology.orchestra.run.smithi130.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-19T21:39:16.187 INFO:teuthology.orchestra.run.smithi130.stdout:generic/409 [not run] require 172.21.15.117:6789:/scratch to be local device 2023-07-19T21:39:16.530 INFO:teuthology.orchestra.run.smithi130.stdout:generic/410 [not run] require 172.21.15.117:6789:/scratch to be local device 2023-07-19T21:39:16.864 INFO:teuthology.orchestra.run.smithi130.stdout:generic/411 [not run] require 172.21.15.117:6789:/scratch to be local device 2023-07-19T21:39:18.063 INFO:teuthology.orchestra.run.smithi130.stdout:generic/412 2s 2023-07-19T21:39:18.598 INFO:teuthology.orchestra.run.smithi130.stdout:generic/413 [not run] mount 172.21.15.117:6789:/scratch with dax failed 2023-07-19T21:39:19.229 INFO:teuthology.orchestra.run.smithi130.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:39:19.764 INFO:teuthology.orchestra.run.smithi130.stdout:generic/417 [not run] ceph does not support shutdown 2023-07-19T21:39:20.210 INFO:teuthology.orchestra.run.smithi130.stdout:generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-19T21:39:30.143 INFO:teuthology.orchestra.run.smithi130.stdout:generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T21:39:30.571 INFO:teuthology.orchestra.run.smithi130.stdout:generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-19T21:39:30.927 INFO:teuthology.orchestra.run.smithi130.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-19T21:39:31.391 INFO:teuthology.orchestra.run.smithi130.stdout:generic/423 1s 2023-07-19T21:39:31.737 INFO:teuthology.orchestra.run.smithi130.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-07-19T21:39:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-07-19T21:39:52.414 INFO:teuthology.orchestra.run.smithi130.stdout:generic/426 20s 2023-07-19T21:39:53.163 INFO:teuthology.orchestra.run.smithi130.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-19T21:39:53.557 INFO:teuthology.orchestra.run.smithi130.stdout:generic/428 0s 2023-07-19T21:39:54.065 INFO:teuthology.orchestra.run.smithi130.stdout:generic/430 1s 2023-07-19T21:39:54.530 INFO:teuthology.orchestra.run.smithi130.stdout:generic/431 0s 2023-07-19T21:39:55.028 INFO:teuthology.orchestra.run.smithi130.stdout:generic/432 1s 2023-07-19T21:39:55.482 INFO:teuthology.orchestra.run.smithi130.stdout:generic/433 0s 2023-07-19T21:39:55.948 INFO:teuthology.orchestra.run.smithi130.stdout:generic/434 0s 2023-07-19T21:39:56.512 INFO:teuthology.orchestra.run.smithi130.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T21:39:57.597 INFO:teuthology.orchestra.run.smithi130.stdout:generic/437 1s 2023-07-19T21:40:04.684 INFO:teuthology.orchestra.run.smithi130.stdout:generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T21:40:05.120 INFO:teuthology.orchestra.run.smithi130.stdout:generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-19T21:40:05.515 INFO:teuthology.orchestra.run.smithi130.stdout:generic/441 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:40:05.907 INFO:teuthology.orchestra.run.smithi130.stdout:generic/443 0s 2023-07-19T21:40:06.385 INFO:teuthology.orchestra.run.smithi130.stdout:generic/444 1s 2023-07-19T21:40:06.908 INFO:teuthology.orchestra.run.smithi130.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T21:40:14.729 INFO:teuthology.orchestra.run.smithi130.stdout:generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-19T21:40:15.439 INFO:teuthology.orchestra.run.smithi130.stdout:generic/448 1s 2023-07-19T21:40:15.813 INFO:teuthology.orchestra.run.smithi130.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-19T21:40:22.442 INFO:teuthology.orchestra.run.smithi130.stdout:generic/450 7s 2023-07-19T21:40:34.044 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:40:34.047 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:40:34.049 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:40:52.920 INFO:teuthology.orchestra.run.smithi130.stdout:generic/451 30s 2023-07-19T21:40:54.263 INFO:teuthology.orchestra.run.smithi130.stdout:generic/452 2s 2023-07-19T21:40:54.651 INFO:teuthology.orchestra.run.smithi130.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-07-19T21:40:54.995 INFO:teuthology.orchestra.run.smithi130.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-07-19T21:40:55.384 INFO:teuthology.orchestra.run.smithi130.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-19T21:40:56.041 INFO:teuthology.orchestra.run.smithi130.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-19T21:41:04.654 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:41:04.698 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:41:04.754 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:41:35.542 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:41:35.596 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:41:35.607 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:41:35.924 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-07-19T21:41:35.921+0000 7fc2edf52700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 162047) UID: 0 2023-07-19T21:41:35.931 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-07-19T21:41:35.928+0000 7fc9d96c4700 -1 Fail to open '/proc/162047/cmdline' error = (2) No such file or directory 2023-07-19T21:41:35.931 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-07-19T21:41:35.928+0000 7fc9d96c4700 -1 received signal: Hangup from (PID: 162047) UID: 0 2023-07-19T21:41:35.934 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-07-19T21:41:35.923+0000 7f3ad3144700 -1 Fail to open '/proc/162047/cmdline' error = (2) No such file or directory 2023-07-19T21:41:35.934 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-07-19T21:41:35.923+0000 7f3ad3144700 -1 received signal: Hangup from (PID: 162047) UID: 0 2023-07-19T21:41:35.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-07-19T21:41:35.931+0000 7fe82fa8c700 -1 Fail to open '/proc/162047/cmdline' error = (2) No such file or directory 2023-07-19T21:41:35.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-07-19T21:41:35.931+0000 7fe82fa8c700 -1 received signal: Hangup from (PID: 162047) UID: 0 2023-07-19T21:44:14.030 INFO:teuthology.orchestra.run.smithi117.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.0.log.1: 2023-07-19T21:44:14.031 INFO:teuthology.orchestra.run.smithi117.stderr:gzip: stdin: file size changed while zipping 2023-07-19T21:44:45.731 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:44:45.737 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:44:45.744 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:44:45.813 INFO:tasks.ceph.osd.7.smithi124.stderr:2023-07-19T21:44:45.808+0000 7f13010b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155242) UID: 0 2023-07-19T21:44:45.813 INFO:tasks.ceph.osd.6.smithi124.stderr:2023-07-19T21:44:45.808+0000 7f633211f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155242) UID: 0 2023-07-19T21:44:45.816 INFO:tasks.ceph.osd.4.smithi124.stderr:2023-07-19T21:44:45.807+0000 7f684ce03700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155242) UID: 0 2023-07-19T21:44:45.816 INFO:tasks.ceph.osd.5.smithi124.stderr:2023-07-19T21:44:45.809+0000 7f67d31c2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155242) UID: 0 2023-07-19T21:46:00.722 INFO:teuthology.orchestra.run.smithi130.stdout:generic/460 304s 2023-07-19T21:46:01.265 INFO:teuthology.orchestra.run.smithi130.stdout:generic/462 [not run] mount 172.21.15.117:6789:/scratch with dax failed 2023-07-19T21:46:01.694 INFO:teuthology.orchestra.run.smithi130.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-07-19T21:46:05.959 INFO:teuthology.orchestra.run.smithi130.stdout:generic/465 4s 2023-07-19T21:46:06.384 INFO:teuthology.orchestra.run.smithi130.stdout:generic/466 [not run] require 172.21.15.117:6789:/scratch to be valid block disk 2023-07-19T21:47:12.567 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:47:12.571 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:47:12.573 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:47:43.255 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:47:43.257 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:47:43.259 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:48:13.357 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:48:13.381 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:48:13.384 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:48:13.413 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-07-19T21:48:13.409+0000 7f3ad3144700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 162223) UID: 0 2023-07-19T21:48:13.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-07-19T21:48:13.409+0000 7fe82fa8c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 162223) UID: 0 2023-07-19T21:48:13.414 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-07-19T21:48:13.409+0000 7fc9d96c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 162223) UID: 0 2023-07-19T21:48:13.414 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-07-19T21:48:13.409+0000 7fc2edf52700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 162223) UID: 0 2023-07-19T21:50:24.488 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:50:24.490 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:50:24.493 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:50:54.618 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:50:54.620 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:50:54.623 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:51:24.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:51:24.768 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:51:24.770 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:51:54.879 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:51:54.882 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:51:54.884 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:52:25.010 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:52:25.012 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:52:25.014 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:52:55.181 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:52:55.183 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:52:55.186 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:53:25.515 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:53:25.519 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:53:25.522 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:53:55.617 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:53:55.620 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:53:55.623 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:54:25.716 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:54:25.720 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:54:25.723 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:54:55.876 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:54:55.879 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:54:55.882 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:55:25.999 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:55:26.002 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:55:26.004 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:55:56.139 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:55:56.142 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:55:56.145 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:56:26.236 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:56:26.238 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:56:26.241 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:56:56.341 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:56:56.344 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:56:56.346 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:57:26.476 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:57:26.479 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:57:26.483 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:57:56.592 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:57:56.595 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:57:56.597 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:58:26.733 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:58:26.736 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:58:26.740 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:58:56.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:58:56.867 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:58:56.869 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:59:26.965 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:59:26.968 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:59:26.970 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:59:57.100 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:59:57.103 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T21:59:57.106 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:00:27.239 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:00:27.246 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:00:27.249 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:00:57.387 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:00:57.390 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:00:57.392 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:01:27.512 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:01:27.515 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:01:27.519 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:01:57.634 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:01:57.636 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:01:57.640 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:02:27.763 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:02:27.766 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:02:27.769 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:02:57.912 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:02:57.914 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:02:57.917 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:03:28.019 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:03:28.022 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:03:28.024 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:03:58.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:03:58.150 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:03:58.154 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:04:28.271 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:04:28.274 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:04:28.276 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:04:58.398 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:04:58.401 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:04:58.404 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:05:28.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:05:28.563 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:05:28.567 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:05:58.666 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:05:58.668 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:05:58.673 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:06:28.827 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:06:28.831 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:06:28.833 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:06:58.934 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:06:58.937 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:06:58.941 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:07:29.097 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:07:29.101 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:07:29.103 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:07:59.229 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:07:59.232 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:07:59.234 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:08:29.351 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:08:29.355 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:08:29.359 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:08:59.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:08:59.493 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:08:59.495 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:09:29.629 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:09:29.632 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:09:29.634 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:09:59.775 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:09:59.778 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:09:59.781 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:10:29.917 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:10:29.919 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:10:29.922 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:11:00.082 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:11:00.084 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:11:00.087 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:11:30.213 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:11:30.216 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:11:30.218 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:12:00.353 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:12:00.355 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:12:00.358 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:12:30.468 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:12:30.470 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:12:30.472 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:13:00.614 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:13:00.617 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:13:00.619 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:13:30.736 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:13:30.740 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:13:30.744 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:14:00.842 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:14:00.845 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:14:00.847 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:14:30.972 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:14:30.975 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:14:30.977 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:15:01.130 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:15:01.133 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:15:01.136 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:15:31.251 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:15:31.254 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:15:31.256 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:16:01.391 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:16:01.394 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:16:01.397 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:16:31.521 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:16:31.524 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:16:31.526 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:17:01.677 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:17:01.680 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:17:01.683 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:17:31.803 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:17:31.805 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:17:31.808 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:18:01.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:18:01.961 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:18:01.963 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:18:32.103 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:18:32.106 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:18:32.108 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:19:02.279 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:19:02.281 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:19:02.283 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:19:32.392 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:19:32.394 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:19:32.397 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:20:02.507 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:20:02.509 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:20:02.512 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:20:32.661 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:20:32.664 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:20:32.667 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:21:02.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:21:02.779 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:21:02.782 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:21:32.944 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:21:32.947 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:21:32.949 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:22:03.045 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:22:03.047 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:22:03.050 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:22:33.201 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:22:33.203 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:22:33.205 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:23:03.332 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:23:03.334 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:23:03.336 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:23:33.479 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:23:33.481 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:23:33.484 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:24:03.607 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:24:03.609 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:24:03.611 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:24:33.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:24:33.743 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:24:33.745 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:25:03.850 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:25:03.853 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:25:03.855 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:25:34.003 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:25:34.005 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:25:34.007 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:26:04.167 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:26:04.170 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:26:04.172 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:26:34.307 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:26:34.309 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:26:34.312 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:27:04.405 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:27:04.408 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:27:04.410 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:27:34.552 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:27:34.554 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:27:34.556 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:28:04.649 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:28:04.651 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:28:04.654 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:28:34.837 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:28:34.839 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:28:34.842 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:29:04.951 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:29:04.954 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:29:04.956 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:29:35.100 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:29:35.103 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:29:35.105 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:30:05.255 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:30:05.258 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:30:05.260 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:30:35.371 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:30:35.374 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:30:35.376 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:31:05.521 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:31:05.523 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:31:05.525 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:31:35.636 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:31:35.639 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:31:35.641 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:32:05.795 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:32:05.797 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:32:05.800 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:32:35.936 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:32:35.939 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:32:35.941 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:33:06.040 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:33:06.043 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:33:06.045 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:33:36.194 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:33:36.197 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:33:36.199 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:34:06.485 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:34:06.487 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:34:06.490 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:34:36.586 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:34:36.589 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:34:36.591 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:35:06.684 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:35:06.687 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:35:06.690 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:35:36.825 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:35:36.828 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:35:36.830 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:36:06.998 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:36:07.001 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:36:07.003 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:36:37.104 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:36:37.107 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:36:37.109 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:37:07.194 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:37:07.196 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:37:07.199 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:37:37.311 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:37:37.314 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:37:37.316 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:38:07.424 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:38:07.426 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:38:07.428 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:38:37.546 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:38:37.549 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:38:37.552 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:39:07.677 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:39:07.679 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:39:07.682 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:39:37.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:39:37.780 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:39:37.784 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:40:07.915 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:40:07.918 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:40:07.920 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:40:38.039 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:40:38.041 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:40:38.044 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:41:08.144 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:41:08.147 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:41:08.149 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:41:38.289 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:41:38.291 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:41:38.293 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:42:08.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:42:08.432 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:42:08.435 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:42:38.547 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:42:38.549 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:42:38.551 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:43:08.669 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:43:08.672 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:43:08.674 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:43:38.766 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:43:38.768 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:43:38.771 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:44:08.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:44:08.960 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:44:08.963 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:44:39.111 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:44:39.113 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:44:39.116 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:45:09.246 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:45:09.249 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:45:09.251 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:45:39.386 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:45:39.388 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:45:39.391 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:46:09.551 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:46:09.553 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:46:09.556 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:46:39.683 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:46:39.685 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:46:39.688 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:47:09.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:47:09.794 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:47:09.796 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:47:39.955 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:47:39.958 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:47:39.960 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:48:10.087 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:48:10.089 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:48:10.092 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:48:40.226 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:48:40.229 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:48:40.231 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:49:10.350 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:49:10.353 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:49:10.356 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:49:40.474 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:49:40.478 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:49:40.482 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:50:10.591 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:50:10.593 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:50:10.596 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:50:40.745 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:50:40.748 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:50:40.750 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:51:10.852 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:51:10.854 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:51:10.857 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:51:40.968 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:51:40.970 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:51:40.972 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:52:11.090 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:52:11.093 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:52:11.096 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:52:41.246 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:52:41.249 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:52:41.251 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:53:11.395 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:53:11.398 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:53:11.400 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:53:41.526 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:53:41.529 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:53:41.532 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:54:11.634 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:54:11.637 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:54:11.639 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:54:41.739 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:54:41.741 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:54:41.744 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:55:11.880 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:55:11.882 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:55:11.884 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:55:42.012 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:55:42.014 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:55:42.017 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:56:12.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:56:12.125 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:56:12.128 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:56:42.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:56:42.270 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:56:42.272 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:57:12.408 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:57:12.411 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:57:12.414 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:57:42.556 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:57:42.558 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:57:42.561 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:58:12.705 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:58:12.707 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:58:12.710 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:58:42.824 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:58:42.826 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:58:42.828 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:59:12.938 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:59:12.941 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:59:12.943 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:59:43.082 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:59:43.085 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T22:59:43.087 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:00:13.234 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:00:13.236 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:00:13.238 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:00:43.371 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:00:43.374 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:00:43.376 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:01:13.486 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:01:13.488 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:01:13.491 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:01:43.634 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:01:43.637 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:01:43.639 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:02:13.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:02:13.745 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:02:13.747 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:02:43.843 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:02:43.846 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:02:43.848 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:03:13.968 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:03:13.971 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:03:13.973 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:03:44.110 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:03:44.113 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:03:44.115 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:04:14.209 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:04:14.211 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:04:14.213 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:04:44.356 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:04:44.359 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:04:44.361 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:05:14.493 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:05:14.496 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:05:14.499 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:05:44.614 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:05:44.617 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:05:44.619 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:06:14.723 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:06:14.727 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:06:14.729 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:06:44.818 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:06:44.821 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:06:44.823 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:07:14.922 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:07:14.925 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:07:14.927 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:07:45.026 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:07:45.029 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:07:45.031 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:08:15.121 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:08:15.124 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:08:15.126 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:08:45.217 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:08:45.220 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:08:45.222 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:09:15.332 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:09:15.334 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:09:15.336 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:09:45.427 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:09:45.429 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:09:45.432 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:10:15.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:10:15.543 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:10:15.545 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:10:45.662 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:10:45.665 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:10:45.668 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:11:15.799 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:11:15.802 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:11:15.805 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:11:45.938 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:11:45.940 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:11:45.943 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:12:16.044 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:12:16.047 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:12:16.049 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:12:46.200 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:12:46.203 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:12:46.206 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:13:16.300 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:13:16.303 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:13:16.306 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:13:46.447 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:13:46.449 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:13:46.452 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:14:16.575 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:14:16.578 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:14:16.580 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:14:46.725 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:14:46.727 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:14:46.730 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:15:16.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:15:16.866 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:15:16.870 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:15:46.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:15:46.975 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:15:46.978 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:16:17.119 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:16:17.122 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:16:17.124 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:16:47.250 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:16:47.253 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:16:47.255 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:17:17.361 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:17:17.363 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:17:17.366 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:17:47.489 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:17:47.491 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:17:47.493 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:18:17.587 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:18:17.589 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:18:17.592 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:18:47.751 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:18:47.754 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:18:47.756 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:19:17.883 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:19:17.885 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:19:17.888 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:19:48.007 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:19:48.010 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:19:48.012 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:20:18.161 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:20:18.165 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:20:18.167 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:20:48.292 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:20:48.294 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:20:48.297 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:21:18.400 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:21:18.403 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:21:18.405 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:21:48.563 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:21:48.566 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:21:48.569 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:22:18.711 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:22:18.713 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:22:18.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:22:48.867 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:22:48.869 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:22:48.871 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:23:18.979 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:23:18.981 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:23:18.983 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:23:49.083 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:23:49.086 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:23:49.088 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:24:19.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:24:19.213 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:24:19.216 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:24:49.373 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:24:49.376 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:24:49.379 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:25:19.496 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:25:19.498 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:25:19.500 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:25:49.643 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:25:49.646 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:25:49.648 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:26:19.732 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:26:19.735 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:26:19.738 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:26:49.836 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:26:49.839 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:26:49.841 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:27:19.951 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:27:19.953 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:27:19.955 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:27:50.067 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:27:50.070 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:27:50.072 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:28:20.224 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:28:20.226 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:28:20.228 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:28:50.388 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:28:50.392 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:28:50.394 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:29:20.496 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:29:20.498 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:29:20.500 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:29:50.634 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:29:50.636 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:29:50.639 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:30:20.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:30:20.744 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:30:20.747 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:30:50.889 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:30:50.907 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:30:50.910 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:31:21.010 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:31:21.012 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:31:21.015 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:31:51.210 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:31:51.213 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:31:51.215 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:32:21.320 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:32:21.322 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:32:21.325 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:32:51.465 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:32:51.469 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:32:51.472 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:32:51.506 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-07-19T23:32:51.506+0000 7f3ad3144700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 168063) UID: 0 2023-07-19T23:32:51.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-07-19T23:32:51.506+0000 7fe82fa8c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 168063) UID: 0 2023-07-19T23:32:51.507 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-07-19T23:32:51.506+0000 7fc2edf52700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 168063) UID: 0 2023-07-19T23:32:51.508 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-07-19T23:32:51.506+0000 7fc9d96c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 168063) UID: 0 2023-07-19T23:34:35.431 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:34:35.433 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:34:35.436 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:35:05.631 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:35:05.634 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:35:05.637 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:35:35.747 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:35:35.749 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:35:35.752 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:36:05.869 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:36:05.872 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:36:05.874 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:36:35.965 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:36:35.967 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:36:35.970 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:37:06.070 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:37:06.072 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:37:06.075 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:37:36.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:37:36.181 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:37:36.184 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:38:06.327 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:38:06.330 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:38:06.332 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:38:36.436 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:38:36.439 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:38:36.441 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:39:06.546 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:39:06.548 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:39:06.551 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:39:36.663 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:39:36.665 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:39:36.668 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:40:06.813 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:40:06.815 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:40:06.817 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:40:36.938 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:40:36.941 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:40:36.943 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:41:07.073 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:41:07.075 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:41:07.078 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:41:37.240 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:41:37.243 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:41:37.245 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:42:07.383 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:42:07.385 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:42:07.387 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:42:37.508 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:42:37.511 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:42:37.514 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:43:07.619 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:43:07.622 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:43:07.624 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:43:37.767 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:43:37.770 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:43:37.773 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:44:07.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:44:07.896 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:44:07.898 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:44:38.058 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:44:38.061 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:44:38.063 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:45:08.184 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:45:08.186 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:45:08.188 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:45:38.298 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:45:38.301 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:45:38.304 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:46:08.424 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:46:08.427 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:46:08.429 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:46:38.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:46:38.568 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:46:38.571 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:47:08.660 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:47:08.662 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:47:08.665 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:47:38.792 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:47:38.794 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:47:38.797 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:48:08.916 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:48:08.919 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:48:08.921 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:48:39.041 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:48:39.043 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:48:39.046 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:49:09.181 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:49:09.184 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:49:09.187 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:49:39.323 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:49:39.326 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:49:39.328 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:49:45.981 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-07-19T23:50:09.472 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:50:09.475 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:50:09.478 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:50:39.610 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:50:39.612 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:50:39.615 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:51:09.724 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:51:09.727 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:51:09.729 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:51:39.831 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:51:39.833 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:51:39.836 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:52:09.975 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:52:09.979 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:52:09.981 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:52:40.107 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:52:40.110 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:52:40.113 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:53:10.240 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:53:10.242 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:53:10.245 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:53:40.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:53:40.375 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:53:40.377 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:54:10.513 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:54:10.516 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:54:10.518 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:54:40.653 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:54:40.655 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:54:40.658 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:55:10.749 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:55:10.752 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:55:10.755 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:55:40.900 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:55:40.903 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:55:40.906 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:56:11.050 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:56:11.052 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:56:11.054 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:56:41.198 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:56:41.201 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:56:41.203 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:57:11.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:57:11.374 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:57:11.377 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:57:41.495 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:57:41.498 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:57:41.500 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:58:11.619 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:58:11.622 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:58:11.624 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:58:41.726 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:58:41.729 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:58:41.731 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:59:11.850 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:59:11.853 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:59:11.856 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:59:41.999 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:59:42.003 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-19T23:59:42.006 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:00:12.165 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:00:12.169 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:00:12.171 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:00:42.330 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:00:42.332 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:00:42.335 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:01:12.425 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:01:12.428 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:01:12.430 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:01:42.531 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:01:42.533 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:01:42.536 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:02:12.637 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:02:12.639 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:02:12.642 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:02:42.735 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:02:42.737 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:02:42.740 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:03:12.873 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:03:12.875 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:03:12.878 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:03:43.022 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:03:43.028 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:03:43.032 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:04:13.170 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:04:13.172 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:04:13.175 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:04:43.293 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:04:43.296 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:04:43.299 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:05:13.605 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:05:13.607 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:05:13.610 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:05:43.710 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:05:43.713 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:05:43.715 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:06:13.865 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:06:13.868 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:06:13.870 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:06:43.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:06:43.975 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:06:43.978 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:07:14.088 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:07:14.090 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:07:14.093 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:07:44.341 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:07:44.344 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:07:44.346 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:08:14.493 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:08:14.495 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:08:14.498 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:08:44.597 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:08:44.600 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:08:44.602 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:09:14.725 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:09:14.728 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:09:14.730 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:09:44.873 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:09:44.876 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:09:44.878 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:10:15.004 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:10:15.006 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:10:15.009 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:10:45.169 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:10:45.172 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:10:45.175 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:11:15.318 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:11:15.320 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:11:15.323 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:11:45.466 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:11:45.468 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:11:45.471 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:12:15.580 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:12:15.583 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:12:15.585 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:12:45.720 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:12:45.723 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:12:45.725 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:13:15.858 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:13:15.860 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:13:15.863 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:13:46.005 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:13:46.008 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:13:46.011 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:14:16.136 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:14:16.138 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:14:16.140 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:14:46.235 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:14:46.238 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:14:46.240 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:15:16.348 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:15:16.350 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:15:16.352 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:15:46.552 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:15:46.554 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:15:46.557 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:16:16.648 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:16:16.650 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:16:16.653 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:16:46.813 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:16:46.815 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:16:46.818 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:17:16.924 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:17:16.926 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:17:16.929 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:17:47.020 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:17:47.022 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:17:47.024 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:18:17.155 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:18:17.157 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:18:17.160 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:18:47.444 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:18:47.446 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:18:47.449 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:19:17.559 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:19:17.562 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:19:17.564 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:19:47.705 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:19:47.707 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:19:47.710 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:20:17.987 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:20:17.990 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:20:17.992 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:20:48.101 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:20:48.103 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:20:48.106 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:21:18.230 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:21:18.232 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:21:18.234 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:21:48.352 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:21:48.354 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:21:48.357 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:22:18.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:22:18.502 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:22:18.504 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:22:48.612 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:22:48.615 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:22:48.617 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:23:18.786 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:23:18.789 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:23:18.791 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:23:48.942 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:23:48.944 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:23:48.947 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:24:19.072 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:24:19.075 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:24:19.077 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:24:49.212 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:24:49.214 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:24:49.216 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:25:19.328 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:25:19.332 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:25:19.336 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:25:49.458 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:25:49.460 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:25:49.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:26:19.614 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:26:19.616 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:26:19.619 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:26:49.761 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:26:49.764 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:26:49.766 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:27:19.909 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:27:19.911 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:27:19.913 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:27:50.039 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:27:50.042 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:27:50.044 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:28:20.162 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:28:20.165 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:28:20.167 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:28:50.265 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:28:50.268 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:28:50.270 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:29:20.408 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:29:20.411 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:29:20.414 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:29:50.518 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:29:50.521 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:29:50.523 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:30:20.615 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:30:20.617 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:30:20.620 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:30:50.777 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:30:50.779 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:30:50.782 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:31:20.916 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:31:20.920 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:31:20.923 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:31:51.273 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:31:51.276 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:31:51.278 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:32:21.377 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:32:21.380 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:32:21.382 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:32:51.502 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:32:51.504 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:32:51.506 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:33:21.641 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:33:21.645 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:33:21.649 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:33:51.785 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:33:51.787 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:33:51.790 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:34:21.888 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:34:21.891 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:34:21.893 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:34:52.020 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:34:52.023 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:34:52.025 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:35:22.152 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:35:22.154 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:35:22.157 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:35:52.247 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:35:52.250 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:35:52.252 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:36:22.388 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:36:22.391 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:36:22.394 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:36:52.579 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:36:52.582 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:36:52.585 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:37:22.680 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:37:22.682 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:37:22.685 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:37:52.799 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:37:52.802 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:37:52.805 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:38:22.938 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:38:22.941 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:38:22.943 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:38:53.077 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:38:53.080 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:38:53.082 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:39:23.226 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:39:23.229 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:39:23.231 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:39:53.323 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:39:53.326 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:39:53.329 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:40:23.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:40:23.432 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:40:23.434 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:40:53.569 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:40:53.572 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:40:53.574 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:41:23.685 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:41:23.688 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:41:23.690 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:41:53.787 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:41:53.790 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:41:53.793 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:42:23.938 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:42:23.940 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:42:23.943 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:42:54.077 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:42:54.080 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:42:54.082 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:43:24.217 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:43:24.220 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:43:24.222 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:43:54.322 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:43:54.325 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:43:54.327 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:44:24.454 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:44:24.456 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:44:24.458 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:44:54.552 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:44:54.554 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:44:54.557 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:45:24.674 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:45:24.677 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:45:24.680 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:45:54.781 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:45:54.784 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:45:54.787 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:46:06.413 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-07-20T00:46:24.898 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:46:24.900 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:46:24.903 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:46:55.044 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:46:55.046 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:46:55.049 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:47:25.172 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:47:25.174 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:47:25.177 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:47:55.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:47:55.289 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:47:55.292 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:48:25.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:48:25.492 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:48:25.495 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:48:55.648 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:48:55.650 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:48:55.653 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:49:25.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:49:25.783 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:49:25.785 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:49:55.890 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:49:55.893 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:49:55.896 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:50:25.985 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:50:25.988 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:50:25.991 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:50:56.114 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:50:56.116 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:50:56.119 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:51:26.227 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:51:26.229 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:51:26.231 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:51:56.381 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:51:56.383 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:51:56.386 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:52:26.510 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:52:26.513 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:52:26.515 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:52:56.648 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:52:56.651 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:52:56.653 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:53:26.778 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:53:26.781 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:53:26.783 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:53:56.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:53:56.880 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:53:56.882 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:54:26.982 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:54:26.985 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:54:26.989 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:54:57.109 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:54:57.112 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:54:57.115 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:55:27.248 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:55:27.251 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:55:27.253 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:55:57.387 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:55:57.390 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:55:57.393 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:56:27.525 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:56:27.528 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:56:27.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:56:57.639 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:56:57.642 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:56:57.645 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:57:27.786 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:57:27.788 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:57:27.791 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:57:57.924 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:57:57.926 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:57:57.929 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:58:28.037 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:58:28.040 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:58:28.042 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:58:58.185 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:58:58.188 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:58:58.191 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:59:28.291 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:59:28.293 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:59:28.295 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:59:58.454 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:59:58.457 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T00:59:58.460 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:00:28.601 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:00:28.604 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:00:28.606 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:00:58.731 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:00:58.734 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:00:58.736 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:01:28.844 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:01:28.846 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:01:28.849 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:01:59.103 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:01:59.105 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:01:59.108 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:02:29.219 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:02:29.221 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:02:29.224 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:02:59.361 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:02:59.364 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:02:59.366 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:03:29.483 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:03:29.486 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:03:29.489 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:03:59.590 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:03:59.593 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:03:59.595 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:04:29.700 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:04:29.702 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:04:29.705 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:04:59.835 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:04:59.838 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:04:59.840 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:05:29.929 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:05:29.932 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:05:29.934 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:06:00.054 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:06:00.156 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:06:00.159 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:06:30.311 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:06:30.313 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:06:30.315 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:07:00.441 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:07:00.444 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:07:00.446 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:07:30.531 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:07:30.533 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:07:30.536 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:08:00.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:08:00.672 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:08:00.674 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:08:30.784 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:08:30.787 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:08:30.789 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:09:00.888 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:09:00.891 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:09:00.893 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:09:30.994 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:09:30.997 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:09:31.000 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:10:01.101 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:10:01.103 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:10:01.106 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:10:31.231 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:10:31.233 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:10:31.236 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:11:01.376 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:11:01.379 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:11:01.381 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:11:31.525 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:11:31.527 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:11:31.530 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:12:01.634 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:12:01.636 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:12:01.639 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:12:31.753 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:12:31.755 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:12:31.758 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:13:01.852 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:13:01.854 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:13:01.856 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:13:31.998 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:13:32.000 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:13:32.004 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:14:02.153 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:14:02.155 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:14:02.158 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:14:32.308 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:14:32.311 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:14:32.313 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:15:02.473 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:15:02.475 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:15:02.478 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:15:32.570 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:15:32.572 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:15:32.575 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:16:02.717 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:16:02.719 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:16:02.722 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:16:33.019 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:16:33.022 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:16:33.026 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:17:03.118 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:17:03.121 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:17:03.124 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:17:33.250 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:17:33.252 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:17:33.255 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:17:33.287 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-07-20T01:17:33.302+0000 7f3ad3144700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 173991) UID: 0 2023-07-20T01:17:33.287 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-07-20T01:17:33.302+0000 7fc2edf52700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 173991) UID: 0 2023-07-20T01:17:33.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-07-20T01:17:33.302+0000 7fe82fa8c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 173991) UID: 0 2023-07-20T01:17:33.288 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-07-20T01:17:33.302+0000 7fc9d96c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 173991) UID: 0 2023-07-20T01:19:17.284 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:19:17.286 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:19:17.289 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:19:47.438 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:19:47.440 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:19:47.443 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:20:17.601 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:20:17.604 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:20:17.606 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:20:47.731 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:20:47.734 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:20:47.736 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:21:17.887 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:21:17.890 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:21:17.893 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:21:48.018 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:21:48.021 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:21:48.023 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:22:18.117 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:22:18.120 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:22:18.123 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:22:48.246 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:22:48.248 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:22:48.251 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:23:18.427 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:23:18.429 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:23:18.432 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:23:48.582 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:23:48.584 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:23:48.587 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:24:18.678 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:24:18.681 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:24:18.684 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:24:48.818 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:24:48.821 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:24:48.824 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:25:18.929 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:25:18.932 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:25:18.936 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:25:49.063 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:25:49.065 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:25:49.067 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:26:19.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:26:19.175 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:26:19.178 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:26:49.291 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:26:49.293 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:26:49.296 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:27:19.446 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:27:19.449 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:27:19.452 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:27:49.577 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:27:49.579 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:27:49.582 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:28:19.717 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:28:19.719 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:28:19.722 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:28:49.863 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:28:49.867 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:28:49.870 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:29:20.020 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:29:20.022 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:29:20.025 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:29:50.159 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:29:50.162 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:29:50.165 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:30:20.314 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:30:20.317 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:30:20.322 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:30:50.464 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:30:50.467 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:30:50.469 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:31:20.609 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:31:20.611 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:31:20.614 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:31:50.739 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:31:50.742 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:31:50.744 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:32:20.870 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:32:20.873 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:32:20.875 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:32:50.970 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:32:50.973 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:32:50.977 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:33:21.106 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:33:21.109 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:33:21.111 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:33:51.205 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:33:51.207 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:33:51.210 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:34:21.395 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:34:21.398 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:34:21.400 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:34:51.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:34:51.543 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:34:51.545 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:35:21.687 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:35:21.689 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:35:21.692 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:35:51.800 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:35:51.803 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:35:51.805 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:36:21.949 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:36:21.951 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:36:21.954 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:36:52.051 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:36:52.054 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:36:52.056 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:37:22.418 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:37:22.421 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:37:22.424 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:37:52.519 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:37:52.521 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:37:52.525 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:38:22.615 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:38:22.618 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:38:22.620 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:38:52.777 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:38:52.779 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:38:52.782 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:39:22.933 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:39:22.935 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:39:22.938 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:39:53.039 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:39:53.042 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:39:53.044 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:40:23.169 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:40:23.172 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:40:23.174 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:40:53.284 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:40:53.286 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:40:53.288 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:41:23.442 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:41:23.445 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:41:23.447 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:41:53.603 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:41:53.608 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:41:53.610 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:42:23.751 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:42:23.753 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:42:23.756 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:42:53.865 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:42:53.870 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:42:53.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:43:24.021 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:43:24.024 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:43:24.027 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:43:54.121 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:43:54.124 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:43:54.126 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:44:24.250 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:44:24.252 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:44:24.255 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:44:54.376 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:44:54.379 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:44:54.382 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:45:24.528 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:45:24.532 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:45:24.534 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:45:54.668 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:45:54.671 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:45:54.673 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:46:24.816 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:46:24.818 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:46:24.821 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:46:54.909 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:46:54.912 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:46:54.914 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:47:25.027 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:47:25.029 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:47:25.032 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:47:55.175 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:47:55.178 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:47:55.180 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:48:25.290 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:48:25.293 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:48:25.296 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:48:55.412 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:48:55.414 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:48:55.417 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:49:25.550 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:49:25.553 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:49:25.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:49:55.691 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:49:55.693 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:49:55.696 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:50:25.837 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:50:25.840 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:50:25.842 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:50:55.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:50:55.953 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:50:55.955 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:51:26.056 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:51:26.058 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:51:26.060 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:51:56.205 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:51:56.207 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:51:56.210 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:52:26.327 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:52:26.330 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:52:26.332 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:52:56.458 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:52:56.461 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:52:56.463 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:53:26.614 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:53:26.616 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:53:26.619 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:53:56.770 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:53:56.773 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:53:56.776 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:54:26.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:54:26.952 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:54:26.955 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:54:57.064 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:54:57.067 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:54:57.069 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:55:27.178 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:55:27.181 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:55:27.183 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:55:57.329 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:55:57.332 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:55:57.335 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:56:27.425 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:56:27.428 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:56:27.431 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:56:57.575 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:56:57.579 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:56:57.582 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:57:27.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:57:27.744 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:57:27.747 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:57:57.882 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:57:57.884 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:57:57.886 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:58:28.022 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:58:28.025 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:58:28.027 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:58:58.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:58:58.181 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:58:58.184 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:59:28.319 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:59:28.322 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:59:28.325 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:59:58.418 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:59:58.420 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T01:59:58.422 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:00:28.550 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:00:28.552 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:00:28.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:00:58.709 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:00:58.712 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:00:58.714 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:01:28.829 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:01:28.832 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:01:28.835 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:01:58.962 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:01:58.965 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:01:58.967 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:02:29.068 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:02:29.070 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:02:29.073 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:02:59.200 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:02:59.202 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:02:59.205 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:03:29.292 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:03:29.295 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:03:29.297 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:03:59.421 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:03:59.423 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:03:59.426 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:04:29.561 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:04:29.563 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:04:29.566 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:04:59.710 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:04:59.713 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:04:59.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:05:29.850 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:05:29.852 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:05:29.856 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:05:59.989 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:05:59.991 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:05:59.994 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:06:30.163 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:06:30.166 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:06:30.169 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:07:00.265 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:07:00.267 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:07:00.270 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:07:30.400 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:07:30.402 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:07:30.405 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:08:00.509 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:08:00.512 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:08:00.514 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:08:30.614 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:08:30.617 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:08:30.619 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:09:00.720 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:09:00.722 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:09:00.726 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:09:30.817 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:09:30.819 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:09:30.822 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:10:00.942 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:10:00.945 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:10:00.947 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:10:31.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:10:31.092 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:10:31.095 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:11:01.219 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:11:01.222 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:11:01.225 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:11:31.343 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:11:31.347 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:11:31.351 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:12:01.466 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:12:01.468 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:12:01.471 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:12:31.567 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:12:31.570 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:12:31.572 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:13:01.698 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:13:01.700 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:13:01.703 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:13:31.802 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:13:31.805 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:13:31.807 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:14:01.935 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:14:01.937 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:14:01.940 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:14:32.063 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:14:32.065 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:14:32.068 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:15:02.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:15:02.213 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:15:02.216 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:15:32.307 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:15:32.310 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:15:32.312 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:16:02.456 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:16:02.459 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:16:02.461 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:16:32.567 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:16:32.569 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:16:32.572 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:17:02.671 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:17:02.674 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:17:02.677 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:17:32.794 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:17:32.796 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:17:32.799 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:18:02.892 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:18:02.894 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:18:02.896 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:18:32.988 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:18:32.990 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:18:32.992 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:19:03.303 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:19:03.306 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:19:03.309 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:19:33.415 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:19:33.418 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:19:33.421 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:20:03.522 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:20:03.524 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:20:03.527 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:20:33.685 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:20:33.688 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:20:33.691 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:21:03.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:21:03.793 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:21:03.796 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:21:33.896 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:21:33.898 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:21:33.901 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:22:04.043 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:22:04.045 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:22:04.047 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:22:34.182 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:22:34.185 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:22:34.188 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:23:04.288 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:23:04.291 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:23:04.294 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:23:34.437 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:23:34.440 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:23:34.443 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:24:04.617 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:24:04.621 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:24:04.624 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:24:34.710 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:24:34.713 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:24:34.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:25:04.807 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:25:04.811 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:25:04.813 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:25:34.938 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:25:34.941 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:25:34.943 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:26:05.060 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:26:05.062 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:26:05.065 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:26:35.190 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:26:35.193 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:26:35.195 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:27:05.329 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:27:05.332 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:27:05.334 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:27:35.433 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:27:35.436 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:27:35.439 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:28:05.582 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:28:05.585 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:28:05.588 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:28:35.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:28:35.679 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:28:35.682 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:29:05.781 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:29:05.783 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:29:05.785 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:29:35.884 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:29:35.887 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:29:35.890 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:30:05.991 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:30:05.993 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:30:05.996 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:30:36.103 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:30:36.105 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:30:36.108 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:31:06.250 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:31:06.253 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:31:06.255 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:31:36.428 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:31:36.431 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:31:36.434 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:32:06.557 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:32:06.560 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:32:06.563 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:32:36.672 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:32:36.675 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:32:36.677 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:33:06.771 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:33:06.774 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:33:06.776 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:33:36.911 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:33:36.914 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:33:36.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:34:07.126 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:34:07.128 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:34:07.130 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:34:37.224 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:34:37.226 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:34:37.229 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:35:07.357 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:35:07.359 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:35:07.362 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:35:37.469 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:35:37.472 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:35:37.475 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:36:07.617 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:36:07.621 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:36:07.624 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:36:37.753 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:36:37.755 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:36:37.758 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:37:07.892 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:37:07.895 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:37:07.898 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:37:38.033 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:37:38.036 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:37:38.039 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:38:08.156 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:38:08.158 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:38:08.160 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:38:38.296 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:38:38.298 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:38:38.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:39:08.436 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:39:08.438 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:39:08.441 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:39:38.544 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:39:38.547 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:39:38.549 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:40:08.650 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:40:08.652 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:40:08.655 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:40:38.775 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:40:38.779 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:40:38.782 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:41:08.941 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:41:08.943 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:41:08.948 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:41:39.086 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:41:39.088 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:41:39.091 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:42:09.209 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:42:09.211 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:42:09.213 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:42:39.314 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:42:39.316 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:42:39.319 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:43:09.420 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:43:09.423 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:43:09.425 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:43:39.525 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:43:39.528 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:43:39.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:44:09.685 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:44:09.688 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:44:09.690 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:44:39.816 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:44:39.819 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:44:39.822 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:45:09.966 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:45:09.969 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:45:09.972 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:45:40.240 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:45:40.243 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:45:40.246 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:46:10.362 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:46:10.366 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:46:10.368 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:46:40.493 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:46:40.496 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:46:40.499 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:47:10.608 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:47:10.611 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:47:10.614 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:47:40.711 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:47:40.714 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:47:40.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:48:10.862 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:48:10.865 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:48:10.867 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:48:40.994 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:48:40.997 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:48:40.999 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:49:11.133 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:49:11.135 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:49:11.138 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:49:41.272 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:49:41.275 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:49:41.277 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:50:11.420 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:50:11.423 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:50:11.425 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:50:41.542 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:50:41.545 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:50:41.548 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:51:11.651 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:51:11.653 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:51:11.655 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:51:41.781 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:51:41.783 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:51:41.786 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:52:11.879 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:52:11.881 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:52:11.884 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:52:41.984 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:52:41.987 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:52:41.989 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:53:12.082 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:53:12.085 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:53:12.088 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:53:42.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:53:42.181 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:53:42.184 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:54:12.284 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:54:12.287 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:54:12.289 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:54:42.406 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:54:42.409 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:54:42.411 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:55:12.511 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:55:12.513 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:55:12.516 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:55:42.617 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:55:42.619 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:55:42.621 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:56:12.730 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:56:12.732 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:56:12.734 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:56:42.827 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:56:42.830 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:56:42.833 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:57:12.932 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:57:12.935 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:57:12.938 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:57:43.046 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:57:43.048 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:57:43.051 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:58:13.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:58:13.162 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:58:13.165 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:58:43.308 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:58:43.310 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:58:43.313 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:59:13.481 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:59:13.483 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:59:13.486 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:59:43.596 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:59:43.599 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T02:59:43.601 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:00:14.015 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:00:14.018 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:00:14.021 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:00:44.155 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:00:44.157 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:00:44.159 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:01:14.269 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:01:14.271 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:01:14.275 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:01:14.308 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-07-20T03:01:14.288+0000 7f3ad3144700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179792) UID: 0 2023-07-20T03:01:14.309 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-07-20T03:01:14.288+0000 7fc2edf52700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179792) UID: 0 2023-07-20T03:01:14.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-07-20T03:01:14.288+0000 7fe82fa8c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179792) UID: 0 2023-07-20T03:01:14.310 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-07-20T03:01:14.288+0000 7fc9d96c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179792) UID: 0 2023-07-20T03:02:58.549 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:02:58.552 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:02:58.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:03:28.655 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:03:28.658 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:03:28.660 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:03:58.759 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:03:58.761 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:03:58.764 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:04:28.854 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:04:28.857 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:04:28.859 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:04:58.959 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:04:58.962 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:04:58.964 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:05:29.054 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:05:29.057 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:05:29.060 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:05:59.167 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:05:59.170 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:05:59.172 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:06:29.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:06:29.312 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:06:29.315 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:06:59.489 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:06:59.491 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:06:59.494 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:07:29.644 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:07:29.646 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:07:29.649 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:07:59.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:07:59.794 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:07:59.796 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:08:29.896 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:08:29.899 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:08:29.901 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:09:00.028 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:09:00.030 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:09:00.032 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:09:30.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:09:30.150 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:09:30.152 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:10:00.296 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:10:00.298 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:10:00.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:10:30.446 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:10:30.449 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:10:30.451 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:11:00.590 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:11:00.593 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:11:00.595 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:11:30.737 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:11:30.740 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:11:30.745 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:12:00.885 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:12:00.888 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:12:00.890 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:12:31.029 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:12:31.032 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:12:31.034 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:13:01.380 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:13:01.383 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:13:01.385 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:13:31.478 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:13:31.481 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:13:31.483 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:14:01.617 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:14:01.619 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:14:01.622 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:14:31.747 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:14:31.749 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:14:31.752 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:15:01.887 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:15:01.892 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:15:01.895 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:15:31.989 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:15:31.992 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:15:31.997 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:16:02.107 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:16:02.109 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:16:02.111 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:16:32.254 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:16:32.256 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:16:32.259 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:17:02.354 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:17:02.357 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:17:02.359 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:17:32.636 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:17:32.639 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:17:32.641 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:18:02.739 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:18:02.742 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:18:02.744 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:18:32.844 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:18:32.846 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:18:32.849 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:19:02.940 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:19:02.942 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:19:02.945 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:19:33.039 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:19:33.042 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:19:33.045 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:20:03.142 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:20:03.145 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:20:03.147 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:20:33.476 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:20:33.479 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:20:33.481 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:21:03.579 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:21:03.581 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:21:03.583 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:21:33.684 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:21:33.687 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:21:33.689 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:22:03.781 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:22:03.783 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:22:03.786 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:22:33.885 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:22:33.890 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:22:33.894 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:23:03.999 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:23:04.001 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:23:04.003 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:23:34.096 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:23:34.098 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:23:34.101 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:24:04.197 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:24:04.200 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:24:04.203 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:24:34.314 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:24:34.317 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:24:34.321 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:25:04.419 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:25:04.421 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:25:04.423 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:25:34.535 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:25:34.538 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:25:34.540 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:26:04.655 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:26:04.658 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:26:04.660 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:26:34.766 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:26:34.768 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:26:34.771 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:27:04.870 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:27:04.873 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:27:04.876 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:27:35.022 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:27:35.025 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:27:35.027 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:28:05.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:28:05.137 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:28:05.140 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:28:35.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:28:35.265 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:28:35.268 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:29:05.373 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:29:05.376 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:29:05.378 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:29:35.511 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:29:35.513 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:29:35.516 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:30:05.647 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:30:05.650 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:30:05.652 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:30:35.770 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:30:35.772 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:30:35.774 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:31:05.913 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:31:05.916 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:31:05.918 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:31:36.052 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:31:36.055 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:31:36.057 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:32:06.183 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:32:06.186 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:32:06.188 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:32:36.297 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:32:36.300 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:32:36.302 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:33:06.417 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:33:06.419 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:33:06.421 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:33:36.526 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:33:36.528 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:33:36.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:34:06.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:34:06.629 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:34:06.632 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:34:36.734 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:34:36.736 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:34:36.738 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:35:06.853 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:35:06.856 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:35:06.858 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:35:36.982 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:35:36.984 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:35:36.986 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:36:07.126 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:36:07.128 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:36:07.131 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:36:37.219 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:36:37.221 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:36:37.223 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:37:07.315 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:37:07.318 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:37:07.320 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:37:37.434 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:37:37.436 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:37:37.439 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:38:07.537 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:38:07.539 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:38:07.541 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:38:37.733 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:38:37.735 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:38:37.737 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:39:07.833 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:39:07.836 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:39:07.838 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:39:37.980 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:39:37.983 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:39:37.985 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:40:08.120 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:40:08.123 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:40:08.125 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:40:38.229 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:40:38.231 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:40:38.233 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:41:08.369 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:41:08.371 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:41:08.373 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:41:38.483 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:41:38.485 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:41:38.487 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:42:08.606 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:42:08.609 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:42:08.611 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:42:38.764 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:42:38.766 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:42:38.769 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:43:08.921 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:43:08.924 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:43:08.926 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:43:39.061 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:43:39.064 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:43:39.066 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:44:09.235 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:44:09.238 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:44:09.241 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:44:39.393 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:44:39.395 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:44:39.397 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:45:09.532 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:45:09.535 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:45:09.537 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:45:39.680 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:45:39.683 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:45:39.685 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:46:09.803 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:46:09.806 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:46:09.808 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:46:39.952 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:46:39.955 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:46:39.957 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:47:10.117 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:47:10.120 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:47:10.122 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:47:40.268 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:47:40.271 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:47:40.273 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:48:10.393 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:48:10.396 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:48:10.399 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:48:40.517 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:48:40.519 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:48:40.521 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:49:10.622 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:49:10.624 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:49:10.627 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:49:40.767 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:49:40.770 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:49:40.772 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:50:10.875 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:50:10.878 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:50:10.880 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:50:41.047 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:50:41.049 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:50:41.052 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:51:11.137 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:51:11.140 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:51:11.142 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:51:41.260 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:51:41.262 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:51:41.265 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:52:11.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:52:11.369 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:52:11.371 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:52:41.472 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:52:41.475 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:52:41.477 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:53:11.798 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:53:11.800 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:53:11.802 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:53:41.898 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:53:41.900 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:53:41.903 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:54:12.004 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:54:12.007 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:54:12.009 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:54:42.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:54:42.137 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:54:42.139 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:55:12.238 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:55:12.240 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:55:12.245 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:55:42.349 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:55:42.351 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:55:42.353 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:56:12.469 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:56:12.471 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:56:12.474 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:56:42.606 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:56:42.609 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:56:42.611 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:57:12.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:57:12.746 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:57:12.748 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:57:42.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:57:42.866 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:57:42.869 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:58:12.975 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:58:12.978 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:58:12.980 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:58:43.125 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:58:43.128 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:58:43.130 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:59:13.256 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:59:13.259 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:59:13.261 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:59:43.361 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:59:43.363 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T03:59:43.366 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:00:13.461 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:00:13.463 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:00:13.466 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:00:43.584 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:00:43.587 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:00:43.589 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:01:13.682 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:01:13.685 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:01:13.688 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:01:43.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:01:43.781 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:01:43.784 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:02:13.876 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:02:13.878 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:02:13.880 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:02:43.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:02:43.976 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:02:43.978 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:03:14.085 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:03:14.088 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:03:14.090 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:03:44.189 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:03:44.191 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:03:44.194 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:04:14.289 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:04:14.292 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:04:14.294 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:04:44.386 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:04:44.388 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:04:44.390 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:05:14.483 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:05:14.485 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:05:14.488 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:05:44.589 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:05:44.591 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:05:44.594 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:06:14.712 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:06:14.714 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:06:14.717 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:06:44.817 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:06:44.820 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:06:44.822 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:07:15.182 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:07:15.184 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:07:15.187 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:07:45.297 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:07:45.299 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:07:45.302 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:08:15.436 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:08:15.438 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:08:15.441 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:08:45.539 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:08:45.541 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:08:45.544 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:09:15.691 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:09:15.693 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:09:15.696 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:09:45.797 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:09:45.799 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:09:45.802 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:10:15.954 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:10:15.956 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:10:15.959 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:10:46.079 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:10:46.082 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:10:46.084 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:11:16.175 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:11:16.178 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:11:16.180 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:11:46.305 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:11:46.308 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:11:46.310 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:12:16.444 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:12:16.446 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:12:16.448 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:12:46.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:12:46.543 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:12:46.545 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:13:16.662 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:13:16.664 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:13:16.667 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:13:46.759 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:13:46.761 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:13:46.764 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:14:16.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:14:16.880 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:14:16.882 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:14:47.023 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:14:47.026 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:14:47.028 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:15:17.153 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:15:17.156 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:15:17.158 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:15:47.254 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:15:47.256 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:15:47.258 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:16:17.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:16:17.362 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:16:17.365 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:16:47.456 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:16:47.459 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:16:47.461 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:17:17.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:17:17.563 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:17:17.565 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:17:47.674 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:17:47.676 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:17:47.679 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:18:17.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:18:17.782 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:18:17.784 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:18:47.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:18:47.879 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:18:47.882 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:19:17.982 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:19:17.984 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:19:17.987 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:19:48.079 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:19:48.082 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:19:48.084 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:20:18.191 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:20:18.195 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:20:18.198 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:20:48.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:20:48.313 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:20:48.315 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:21:18.456 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:21:18.458 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:21:18.461 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:21:48.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:21:48.562 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:21:48.564 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:22:18.657 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:22:18.659 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:22:18.661 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:22:48.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:22:48.768 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:22:48.770 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:23:18.886 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:23:18.888 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:23:18.891 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:23:48.997 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:23:49.000 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:23:49.002 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:24:19.111 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:24:19.113 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:24:19.116 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:24:49.217 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:24:49.219 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:24:49.222 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:25:19.341 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:25:19.344 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:25:19.346 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:25:49.469 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:25:49.472 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:25:49.474 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:26:19.581 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:26:19.583 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:26:19.585 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:26:49.693 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:26:49.696 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:26:49.698 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:27:19.799 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:27:19.801 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:27:19.803 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:27:49.924 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:27:49.927 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:27:49.929 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:28:20.136 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:28:20.139 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:28:20.141 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:28:50.296 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:28:50.298 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:28:50.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:29:20.412 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:29:20.415 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:29:20.417 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:29:50.508 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:29:50.510 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:29:50.513 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:30:20.615 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:30:20.617 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:30:20.619 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:30:50.737 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:30:50.740 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:30:50.743 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:31:20.842 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:31:20.844 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:31:20.847 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:31:50.964 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:31:50.967 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:31:50.969 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:32:21.069 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:32:21.071 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:32:21.074 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:32:51.166 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:32:51.168 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:32:51.171 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:33:21.288 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:33:21.290 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:33:21.293 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:33:51.384 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:33:51.387 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:33:51.389 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:34:21.481 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:34:21.484 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:34:21.486 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:34:51.586 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:34:51.589 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:34:51.592 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:35:21.702 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:35:21.705 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:35:21.707 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:35:51.822 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:35:51.824 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:35:51.827 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:36:21.919 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:36:21.922 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:36:21.924 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:36:52.016 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:36:52.018 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:36:52.021 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:37:22.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:37:22.143 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:37:22.145 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:37:52.243 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:37:52.245 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:37:52.248 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:38:22.340 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:38:22.343 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:38:22.345 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:38:52.454 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:38:52.456 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:38:52.459 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:39:22.559 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:39:22.562 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:39:22.564 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:39:52.674 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:39:52.676 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:39:52.679 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:40:22.778 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:40:22.781 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:40:22.783 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:40:52.883 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:40:52.886 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:40:52.889 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:41:23.024 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:41:23.026 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:41:23.028 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:41:53.119 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:41:53.122 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:41:53.124 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:42:23.245 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:42:23.247 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:42:23.250 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:42:53.385 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:42:53.387 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:42:53.390 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:43:23.508 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:43:23.511 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:43:23.513 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:43:53.706 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:43:53.709 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:43:53.711 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:44:23.838 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:44:23.840 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:44:23.843 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:44:53.943 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:44:53.946 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:44:53.948 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:44:53.987 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-07-20T04:44:53.929+0000 7f3ad3144700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 185594) UID: 0 2023-07-20T04:44:53.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-07-20T04:44:53.929+0000 7fe82fa8c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 185594) UID: 0 2023-07-20T04:44:53.988 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-07-20T04:44:53.930+0000 7fc2edf52700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 185594) UID: 0 2023-07-20T04:44:53.988 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-07-20T04:44:53.930+0000 7fc9d96c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 185594) UID: 0 2023-07-20T04:46:38.069 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:46:38.072 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:46:38.074 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:47:08.159 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:47:08.161 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:47:08.164 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:47:38.270 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:47:38.272 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:47:38.274 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:48:08.391 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:48:08.393 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:48:08.395 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:48:38.506 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:48:38.509 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:48:38.511 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:49:08.610 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:49:08.612 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:49:08.614 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:49:38.712 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:49:38.714 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:49:38.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:50:08.813 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:50:08.816 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:50:08.818 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:50:38.917 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:50:38.920 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:50:38.922 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:51:09.020 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:51:09.022 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:51:09.025 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:51:39.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:51:39.142 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:51:39.145 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:52:09.242 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:52:09.244 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:52:09.247 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:52:39.365 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:52:39.367 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:52:39.369 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:53:09.481 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:53:09.483 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:53:09.486 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:53:39.593 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:53:39.595 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:53:39.597 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:54:09.696 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:54:09.698 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:54:09.700 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:54:39.810 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:54:39.812 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:54:39.814 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:55:09.911 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:55:09.913 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:55:09.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:55:40.027 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:55:40.029 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:55:40.031 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:56:10.126 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:56:10.129 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:56:10.132 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:56:40.229 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:56:40.232 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:56:40.234 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:57:10.352 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:57:10.354 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:57:10.357 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:57:40.481 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:57:40.484 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:57:40.486 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:58:10.736 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:58:10.739 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:58:10.741 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:58:40.828 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:58:40.830 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:58:40.833 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:59:11.004 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:59:11.007 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:59:11.009 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:59:41.103 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:59:41.106 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T04:59:41.108 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:00:11.264 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:00:11.266 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:00:11.269 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:00:41.410 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:00:41.412 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:00:41.415 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:01:11.533 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:01:11.536 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:01:11.538 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:01:41.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:01:41.672 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:01:41.675 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:02:11.808 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:02:11.810 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:02:11.812 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:02:41.980 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:02:41.982 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:02:41.985 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:03:12.090 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:03:12.093 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:03:12.095 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:03:42.186 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:03:42.189 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:03:42.191 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:04:12.291 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:04:12.293 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:04:12.296 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:04:42.423 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:04:42.426 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:04:42.428 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:05:12.537 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:05:12.539 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:05:12.542 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:05:42.746 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:05:42.748 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:05:42.751 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:06:12.880 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:06:12.882 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:06:12.885 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:06:43.027 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:06:43.030 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:06:43.035 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:07:13.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:07:13.136 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:07:13.139 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:07:43.238 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:07:43.240 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:07:43.242 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:08:13.334 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:08:13.337 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:08:13.339 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:08:43.438 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:08:43.440 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:08:43.442 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:09:13.534 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:09:13.536 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:09:13.538 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:09:43.630 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:09:43.633 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:09:43.635 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:10:13.736 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:10:13.739 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:10:13.741 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:10:43.857 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:10:43.860 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:10:43.863 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:11:13.962 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:11:13.965 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:11:13.967 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:11:44.078 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:11:44.081 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:11:44.083 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:12:14.224 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:12:14.227 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:12:14.229 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:12:44.379 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:12:44.382 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:12:44.384 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:13:14.501 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:13:14.504 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:13:14.506 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:13:44.624 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:13:44.626 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:13:44.629 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:14:14.745 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:14:14.747 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:14:14.750 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:14:45.025 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:14:45.027 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:14:45.030 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:15:15.164 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:15:15.166 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:15:15.168 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:15:45.260 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:15:45.263 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:15:45.265 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:16:15.399 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:16:15.402 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:16:15.404 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:16:45.546 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:16:45.549 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:16:45.551 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:17:15.648 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:17:15.650 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:17:15.653 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:17:45.775 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:17:45.777 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:17:45.779 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:18:15.913 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:18:15.915 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:18:15.918 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:18:46.021 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:18:46.024 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:18:46.026 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:19:16.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:19:16.163 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:19:16.165 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:19:46.280 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:19:46.283 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:19:46.286 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:20:16.427 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:20:16.430 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:20:16.432 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:20:46.552 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:20:46.554 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:20:46.557 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:21:16.710 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:21:16.713 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:21:16.715 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:21:46.867 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:21:46.870 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:21:46.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:22:17.009 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:22:17.011 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:22:17.014 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:22:47.130 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:22:47.133 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:22:47.135 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:23:17.244 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:23:17.246 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:23:17.248 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:23:47.342 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:23:47.344 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:23:47.346 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:24:17.432 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:24:17.434 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:24:17.436 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:24:47.547 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:24:47.549 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:24:47.551 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:25:17.654 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:25:17.657 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:25:17.659 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:25:47.784 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:25:47.787 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:25:47.789 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:26:17.881 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:26:17.884 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:26:17.886 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:26:47.979 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:26:47.981 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:26:47.984 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:27:18.076 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:27:18.079 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:27:18.081 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:27:48.183 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:27:48.185 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:27:48.188 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:28:18.288 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:28:18.291 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:28:18.293 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:28:48.393 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:28:48.396 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:28:48.398 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:29:18.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:29:18.501 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:29:18.503 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:29:48.588 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:29:48.591 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:29:48.593 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:30:18.686 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:30:18.688 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:30:18.690 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:30:48.808 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:30:48.810 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:30:48.813 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:31:18.921 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:31:18.924 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:31:18.926 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:31:49.018 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:31:49.021 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:31:49.024 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:32:19.116 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:32:19.119 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:32:19.122 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:32:49.251 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:32:49.254 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:32:49.256 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:33:19.408 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:33:19.411 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:33:19.413 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:33:49.501 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:33:49.504 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:33:49.506 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:34:19.654 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:34:19.656 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:34:19.659 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:34:49.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:34:49.747 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:34:49.750 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:35:19.842 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:35:19.844 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:35:19.847 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:35:49.948 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:35:49.951 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:35:49.953 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:36:20.053 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:36:20.056 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:36:20.058 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:36:50.163 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:36:50.165 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:36:50.167 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:37:20.298 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:37:20.300 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:37:20.303 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:37:50.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:37:50.431 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:37:50.434 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:38:20.548 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:38:20.551 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:38:20.553 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:38:50.700 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:38:50.703 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:38:50.705 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:39:20.847 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:39:20.849 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:39:20.852 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:39:50.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:39:50.976 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:39:50.978 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:40:21.109 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:40:21.111 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:40:21.114 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:40:51.243 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:40:51.245 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:40:51.248 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:41:21.371 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:41:21.373 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:41:21.376 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:41:51.493 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:41:51.496 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:41:51.498 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:42:21.601 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:42:21.603 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:42:21.606 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:42:51.705 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:42:51.708 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:42:51.710 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:43:21.828 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:43:21.831 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:43:21.834 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:43:51.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:43:51.970 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:43:51.972 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:44:22.106 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:44:22.108 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:44:22.111 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:44:52.245 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:44:52.248 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:44:52.250 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:45:22.376 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:45:22.379 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:45:22.381 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:45:52.477 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:45:52.480 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:45:52.482 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:46:22.596 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:46:22.599 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:46:22.601 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:46:52.688 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:46:52.690 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:46:52.693 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:47:22.816 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:47:22.819 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:47:22.821 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:47:52.947 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:47:52.950 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:47:52.952 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:48:23.094 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:48:23.097 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:48:23.099 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:48:53.218 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:48:53.220 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:48:53.223 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:49:23.373 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:49:23.376 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:49:23.378 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:49:53.538 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:49:53.540 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:49:53.543 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:50:23.684 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:50:23.687 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:50:23.689 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:50:53.803 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:50:53.806 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:50:53.808 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:51:23.899 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:51:23.902 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:51:23.904 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:51:54.028 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:51:54.030 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:51:54.033 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:52:24.183 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:52:24.186 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:52:24.188 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:52:54.340 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:52:54.342 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:52:54.345 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:53:24.486 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:53:24.489 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:53:24.491 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:53:54.583 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:53:54.585 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:53:54.588 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:54:24.733 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:54:24.736 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:54:24.738 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:54:54.856 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:54:54.858 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:54:54.860 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:55:24.997 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:55:25.000 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:55:25.002 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:55:55.098 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:55:55.100 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:55:55.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:56:25.203 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:56:25.205 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:56:25.208 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:56:55.317 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:56:55.319 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:56:55.322 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:57:25.415 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:57:25.418 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:57:25.420 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:57:55.512 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:57:55.515 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:57:55.517 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:58:25.609 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:58:25.611 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:58:25.614 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:58:55.707 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:58:55.709 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:58:55.711 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:59:25.812 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:59:25.815 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:59:25.817 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:59:55.935 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:59:55.937 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T05:59:55.940 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:00:26.079 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:00:26.081 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:00:26.083 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:00:56.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:00:56.214 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:00:56.216 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:01:26.350 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:01:26.356 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:01:26.359 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:01:56.498 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:01:56.501 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:01:56.503 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:02:26.662 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:02:26.664 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:02:26.667 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:02:56.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:02:56.779 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:02:56.781 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:03:26.883 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:03:26.885 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:03:26.888 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:03:57.016 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:03:57.018 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:03:57.020 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:04:27.155 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:04:27.157 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:04:27.159 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:04:57.286 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:04:57.289 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:04:57.291 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:05:27.435 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:05:27.438 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:05:27.440 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:05:57.565 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:05:57.568 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:05:57.571 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:06:27.798 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:06:27.800 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:06:27.803 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:06:57.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:06:57.896 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:06:57.898 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:07:28.012 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:07:28.014 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:07:28.017 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:07:58.131 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:07:58.134 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:07:58.136 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:08:28.243 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:08:28.246 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:08:28.248 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:08:58.371 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:08:58.374 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:08:58.376 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:09:28.491 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:09:28.493 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:09:28.495 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:09:58.632 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:09:58.634 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:09:58.637 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:10:28.746 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:10:28.748 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:10:28.750 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:10:58.870 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:10:58.873 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:10:58.875 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:11:28.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:11:28.969 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:11:28.971 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:11:59.098 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:11:59.101 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:11:59.103 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:12:29.254 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:12:29.256 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:12:29.259 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:12:59.401 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:12:59.404 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:12:59.406 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:13:29.550 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:13:29.552 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:13:29.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:13:59.690 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:13:59.692 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:13:59.694 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:14:29.789 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:14:29.792 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:14:29.794 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:14:59.911 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:14:59.913 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:14:59.915 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:15:30.024 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:15:30.027 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:15:30.029 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:16:00.156 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:16:00.159 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:16:00.161 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:16:30.410 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:16:30.412 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:16:30.415 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:17:00.561 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:17:00.563 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:17:00.565 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:17:30.708 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:17:30.711 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:17:30.713 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:18:00.836 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:18:00.839 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:18:00.842 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:18:30.955 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:18:30.957 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:18:30.960 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:19:01.060 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:19:01.062 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:19:01.064 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:19:31.192 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:19:31.194 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:19:31.196 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:20:01.330 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:20:01.333 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:20:01.335 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:20:31.468 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:20:31.470 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:20:31.473 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:21:01.585 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:21:01.587 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:21:01.589 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:21:31.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:21:31.743 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:21:31.746 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:22:01.863 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:22:01.865 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:22:01.868 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:22:32.002 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:22:32.004 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:22:32.006 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:23:02.141 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:23:02.144 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:23:02.146 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:23:32.289 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:23:32.291 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:23:32.293 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:24:02.427 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:24:02.429 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:24:02.432 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:24:32.583 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:24:32.586 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:24:32.588 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:25:02.740 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:25:02.742 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:25:02.745 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:25:32.846 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:25:32.848 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:25:32.850 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:26:02.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:26:02.960 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:26:02.963 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:26:33.124 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:26:33.127 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:26:33.129 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:27:03.272 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:27:03.274 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:27:03.276 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:27:33.428 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:27:33.431 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:27:33.433 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:28:03.550 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:28:03.553 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:28:03.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:28:33.664 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:28:33.666 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:28:33.668 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:28:33.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-07-20T06:28:33.699+0000 7fe82fa8c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 191395) UID: 0 2023-07-20T06:28:33.700 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-07-20T06:28:33.699+0000 7f3ad3144700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 191395) UID: 0 2023-07-20T06:28:33.701 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-07-20T06:28:33.699+0000 7fc9d96c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 191395) UID: 0 2023-07-20T06:28:33.701 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-07-20T06:28:33.699+0000 7fc2edf52700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 191395) UID: 0 2023-07-20T06:30:18.425 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:30:18.428 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:30:18.430 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:30:48.567 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:30:48.570 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:30:48.573 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:31:18.706 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:31:18.708 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:31:18.711 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:31:48.845 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:31:48.848 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:31:48.850 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:32:18.975 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:32:18.978 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:32:18.980 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:32:49.131 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:32:49.134 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:32:49.136 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:33:19.229 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:33:19.232 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:33:19.234 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:33:49.392 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:33:49.395 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:33:49.397 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:34:19.532 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:34:19.534 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:34:19.537 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:34:49.654 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:34:49.656 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:34:49.659 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:35:19.802 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:35:19.804 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:35:19.806 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:35:50.023 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:35:50.025 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:35:50.028 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:36:20.120 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:36:20.122 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:36:20.125 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:36:50.236 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:36:50.238 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:36:50.240 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:37:20.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:37:20.360 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:37:20.362 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:37:50.489 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:37:50.491 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:37:50.494 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:38:20.611 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:38:20.614 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:38:20.616 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:38:50.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:38:50.744 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:38:50.746 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:39:20.872 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:39:20.874 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:39:20.877 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:39:50.971 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:39:50.974 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:39:50.977 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:40:21.077 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:40:21.079 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:40:21.082 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:40:51.218 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:40:51.220 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:40:51.223 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:41:21.347 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:41:21.349 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:41:21.352 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:41:51.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:41:51.445 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:41:51.447 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:42:21.539 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:42:21.542 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:42:21.544 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:42:51.636 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:42:51.639 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:42:51.641 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:43:21.793 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:43:21.795 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:43:21.797 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:43:51.924 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:43:51.926 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:43:51.929 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:44:22.063 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:44:22.066 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:44:22.068 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:44:52.194 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:44:52.196 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:44:52.198 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:45:22.333 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:45:22.336 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:45:22.338 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:45:52.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:45:52.445 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:45:52.448 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:46:22.611 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:46:22.613 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:46:22.615 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:46:52.742 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:46:52.745 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:46:52.747 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:47:22.897 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:47:22.900 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:47:22.902 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:47:53.037 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:47:53.040 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:47:53.042 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:48:23.167 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:48:23.169 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:48:23.172 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:48:53.435 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:48:53.438 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:48:53.440 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:49:23.553 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:49:23.555 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:49:23.558 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:49:53.658 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:49:53.660 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:49:53.663 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:50:23.763 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:50:23.766 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:50:23.768 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:50:53.878 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:50:53.880 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:50:53.882 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:51:23.974 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:51:23.977 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:51:23.979 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:51:54.072 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:51:54.074 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:51:54.076 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:52:24.168 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:52:24.171 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:52:24.173 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:52:54.266 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:52:54.268 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:52:54.271 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:53:24.362 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:53:24.365 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:53:24.367 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:53:54.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:53:54.486 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:53:54.488 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:54:24.580 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:54:24.583 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:54:24.585 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:54:54.686 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:54:54.689 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:54:54.691 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:55:24.774 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:55:24.777 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:55:24.779 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:55:54.871 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:55:54.873 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:55:54.875 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:56:25.017 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:56:25.019 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:56:25.021 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:56:55.164 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:56:55.167 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:56:55.169 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:57:25.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:57:25.432 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:57:25.435 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:57:55.534 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:57:55.537 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:57:55.539 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:58:25.639 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:58:25.641 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:58:25.644 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:58:55.763 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:58:55.766 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:58:55.768 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:59:25.911 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:59:25.913 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:59:25.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:59:56.037 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:59:56.040 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T06:59:56.042 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:00:26.156 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:00:26.158 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:00:26.161 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:00:56.296 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:00:56.299 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:00:56.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:01:26.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:01:26.445 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:01:26.448 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:01:56.583 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:01:56.586 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:01:56.588 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:02:26.813 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:02:26.815 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:02:26.818 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:02:56.938 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:02:56.941 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:02:56.943 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:03:27.071 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:03:27.073 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:03:27.076 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:03:57.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:03:57.214 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:03:57.216 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:04:27.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:04:27.313 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:04:27.317 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:04:57.476 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:04:57.478 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:04:57.481 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:05:27.607 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:05:27.610 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:05:27.612 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:05:57.712 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:05:57.714 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:05:57.717 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:06:27.846 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:06:27.849 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:06:27.852 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:06:57.979 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:06:57.982 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:06:57.984 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:07:28.127 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:07:28.130 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:07:28.132 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:07:58.270 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:07:58.272 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:07:58.274 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:08:28.391 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:08:28.393 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:08:28.396 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:08:58.506 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:08:58.509 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:08:58.511 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:09:28.638 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:09:28.640 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:09:28.642 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:09:58.756 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:09:58.759 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:09:58.761 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:10:28.879 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:10:28.881 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:10:28.884 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:10:58.985 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:10:58.988 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:10:58.990 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:11:29.093 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:11:29.095 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:11:29.098 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:11:59.207 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:11:59.209 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:11:59.212 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:12:29.320 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:12:29.323 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:12:29.325 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:12:59.459 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:12:59.462 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:12:59.464 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:13:29.608 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:13:29.611 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:13:29.613 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:13:59.740 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:13:59.742 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:13:59.745 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:14:29.888 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:14:29.891 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:14:29.893 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:15:00.011 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:15:00.014 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:15:00.016 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:15:30.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:15:30.137 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:15:30.139 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:16:00.283 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:16:00.286 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:16:00.288 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:16:30.414 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:16:30.417 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:16:30.419 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:17:00.554 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:17:00.557 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:17:00.559 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:17:30.686 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:17:30.689 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:17:30.692 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:18:00.851 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:18:00.854 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:18:00.856 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:18:31.000 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:18:31.003 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:18:31.006 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:19:01.172 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:19:01.175 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:19:01.178 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:19:31.313 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:19:31.315 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:19:31.318 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:20:01.444 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:20:01.449 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:20:01.452 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:20:31.601 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:20:31.603 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:20:31.606 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:21:01.749 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:21:01.751 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:21:01.754 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:21:31.873 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:21:31.875 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:21:31.878 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:22:01.997 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:22:02.000 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:22:02.002 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:22:32.162 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:22:32.164 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:22:32.167 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:23:02.302 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:23:02.305 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:23:02.308 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:23:32.404 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:23:32.406 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:23:32.409 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:24:02.505 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:24:02.508 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:24:02.510 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:24:32.618 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:24:32.622 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:24:32.624 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:25:02.729 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:25:02.732 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:25:02.735 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:25:32.856 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:25:32.858 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:25:32.861 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:26:02.972 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:26:02.975 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:26:02.977 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:26:33.074 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:26:33.076 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:26:33.078 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:27:03.175 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:27:03.177 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:27:03.180 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:27:33.319 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:27:33.322 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:27:33.324 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:28:03.431 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:28:03.434 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:28:03.436 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:28:33.551 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:28:33.553 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:28:33.556 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:29:03.667 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:29:03.670 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:29:03.672 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:29:33.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:29:33.767 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:29:33.770 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:30:03.879 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:30:03.881 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:30:03.884 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:30:33.993 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:30:33.995 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:30:33.997 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:31:04.123 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:31:04.126 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:31:04.129 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:31:34.521 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:31:34.524 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:31:34.527 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:32:04.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:32:04.629 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:32:04.632 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:32:34.731 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:32:34.734 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:32:34.736 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:33:04.854 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:33:04.856 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:33:04.859 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:33:34.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:33:34.953 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:33:34.956 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:34:05.076 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:34:05.079 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:34:05.082 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:34:35.170 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:34:35.173 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:34:35.176 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:35:05.288 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:35:05.290 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:35:05.293 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:35:35.416 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:35:35.419 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:35:35.421 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:36:05.527 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:36:05.529 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:36:05.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:36:35.633 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:36:35.636 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:36:35.639 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:37:05.746 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:37:05.749 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:37:05.752 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:37:35.869 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:37:35.872 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:37:35.875 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:38:06.151 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:38:06.153 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:38:06.156 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:38:36.254 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:38:36.257 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:38:36.259 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:39:06.361 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:39:06.364 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:39:06.366 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:39:36.470 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:39:36.472 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:39:36.474 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:40:06.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:40:06.563 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:40:06.565 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:40:36.667 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:40:36.670 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:40:36.672 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:41:06.801 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:41:06.803 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:41:06.806 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:41:36.951 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:41:36.953 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:41:36.956 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:42:07.109 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:42:07.112 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:42:07.115 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:42:37.230 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:42:37.232 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:42:37.234 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:43:07.327 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:43:07.330 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:43:07.332 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:43:37.426 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:43:37.428 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:43:37.431 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:44:07.524 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:44:07.531 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:44:07.533 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:44:37.655 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:44:37.657 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:44:37.660 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:45:07.827 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:45:07.830 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:45:07.832 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:45:37.944 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:45:37.946 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:45:37.949 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:46:08.067 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:46:08.069 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:46:08.072 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:46:38.217 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:46:38.220 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:46:38.222 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:47:08.346 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:47:08.348 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:47:08.350 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:47:38.513 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:47:38.515 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:47:38.517 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:48:08.673 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:48:08.675 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:48:08.678 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:48:38.822 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:48:38.825 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:48:38.828 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:49:08.937 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:49:08.939 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:49:08.942 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:49:39.060 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:49:39.063 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:49:39.065 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:50:09.210 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:50:09.212 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:50:09.215 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:50:39.341 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:50:39.343 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:50:39.346 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:51:09.482 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:51:09.485 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:51:09.487 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:51:39.640 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:51:39.642 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:51:39.645 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:52:09.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:52:09.781 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:52:09.784 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:52:39.936 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:52:39.938 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:52:39.941 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:53:10.063 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:53:10.065 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:53:10.068 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:53:40.192 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:53:40.195 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:53:40.197 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:54:10.326 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:54:10.328 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:54:10.331 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:54:40.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:54:40.446 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:54:40.448 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:55:10.564 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:55:10.567 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:55:10.569 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:55:40.680 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:55:40.682 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:55:40.684 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:56:10.812 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:56:10.814 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:56:10.817 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:56:40.944 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:56:40.946 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:56:40.948 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:57:11.060 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:57:11.062 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:57:11.065 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:57:41.225 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:57:41.228 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:57:41.230 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:58:11.374 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:58:11.376 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:58:11.378 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:58:41.507 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:58:41.509 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:58:41.512 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:59:11.704 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:59:11.706 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:59:11.708 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:59:41.826 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:59:41.829 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T07:59:41.832 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:00:12.098 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:00:12.101 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:00:12.103 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:00:42.227 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:00:42.230 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:00:42.232 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:01:12.350 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:01:12.352 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:01:12.355 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:01:42.488 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:01:42.490 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:01:42.493 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:02:12.637 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:02:12.639 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:02:12.642 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:02:42.777 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:02:42.779 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:02:42.782 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:03:12.892 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:03:12.894 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:03:12.897 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:03:43.025 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:03:43.027 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:03:43.030 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:04:13.152 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:04:13.154 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:04:13.156 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:04:43.248 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:04:43.250 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:04:43.253 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:05:13.362 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:05:13.364 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:05:13.367 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:05:43.502 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:05:43.505 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:05:43.507 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:06:13.770 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:06:13.773 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:06:13.775 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:06:43.907 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:06:43.910 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:06:43.912 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:07:14.056 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:07:14.059 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:07:14.061 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:07:44.157 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:07:44.159 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:07:44.162 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:08:14.503 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:08:14.505 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:08:14.508 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:08:44.601 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:08:44.603 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:08:44.606 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:09:14.717 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:09:14.719 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:09:14.722 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:09:44.866 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:09:44.868 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:09:44.871 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:10:14.998 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:10:15.001 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:10:15.003 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T08:10:24.094 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-07-20T08:10:24.095 DEBUG:teuthology.task.console_log:Killing console logger for smithi117 2023-07-20T08:10:24.096 DEBUG:teuthology.task.console_log:Killing console logger for smithi124 2023-07-20T08:10:24.096 DEBUG:teuthology.task.console_log:Killing console logger for smithi130 2023-07-20T08:10:24.097 DEBUG:teuthology.exit:Finished running handlers